Senior Remote Business Analyst – AI Chatbot Evaluation & Performance Optimization Specialist (Conversational AI & Data Analytics Lead) – Empowering AI Experiences at brighthush

Welcome to brighthush – Where AI Meets Human Insight

Since our inception in 2020, brighthush has evolved from a passionate startup into a global hub of conversational AI expertise. With a dedicated team of 11‑50 specialists, we are redefining how businesses interact with customers through intelligent, natural‑sounding chatbots. Our mission is to make artificial intelligence intuitive, accessible, and indispensable for everyday interactions. Whether you’re a data scientist, product manager, or business analyst, brighthush offers a platform where your ideas shape the future of AI and your career can soar.

Why This Role is a Game‑Changer

Chatbots are the frontline of customer engagement for countless brands, and the stakes are higher than ever. As a Senior Remote Business Analyst – AI Chatbot Evaluation & Performance Optimization Specialist, you will be the linchpin that translates business goals into measurable AI outcomes. Your insights will directly influence how our chatbots understand users, deliver value, and drive business results. In this role, you’ll:

• Lead rigorous evaluation of chatbot interactions across web, mobile, and messaging platforms.
• Translate complex business requirements into clear, actionable AI performance metrics.
• Identify gaps, recommend enhancements, and champion continuous improvement.
• Produce data‑rich reports that inform stakeholders and shape product strategy.

Key Responsibilities

1. Chatbot Response Evaluation

Systematically assess chatbot outputs against predefined business criteria—accuracy, relevance, tone, compliance, and user satisfaction. Combine automated scoring tools with meticulous manual reviews to ensure consistency and quality across all touchpoints.

2. Requirements Analysis & Documentation

Collaborate with product managers, UX designers, and data scientists to capture functional and non‑functional requirements. Translate business needs into testable specifications, user stories, and acceptance criteria that guide development and QA teams.

3. Process Mapping & Workflow Design

Create detailed flowcharts and process maps that illustrate current chatbot workflows, highlight inefficiencies, and propose streamlined pathways. Leverage BPMN or similar notations to communicate complex processes to both technical and non‑technical stakeholders.

4. Gap Identification & Root Cause Analysis

Detect inconsistencies, missing features, and performance bottlenecks that hinder optimal chatbot performance. Conduct root cause analyses to uncover underlying issues and recommend targeted fixes.

5. Recommendation Development & Prioritization

Formulate actionable improvement plans, prioritizing initiatives based on business impact, technical feasibility, and resource availability. Develop roadmaps that align with product strategy and organizational goals.

6. Reporting & Documentation

Compile comprehensive assessment reports, executive summaries, and technical documentation for cross‑functional teams. Ensure clarity, accuracy, and accessibility of all deliverables.

7. Stakeholder Collaboration & Presentation

Present findings to senior leadership, product owners, and engineering teams, facilitating informed decision‑making. Translate data insights into compelling narratives that drive consensus and action.

8. Continuous Improvement & Post‑Implementation Review

Monitor post‑implementation results, refine evaluation criteria, and iterate on recommendations to sustain high performance. Champion a culture of data‑driven decision making and iterative enhancement.

Essential Qualifications

• Minimum 3 years of proven experience as a Business Analyst in technology or AI‑driven environments.
• Bachelor’s degree in Business Administration, Finance, Computer Science, Information Systems, or a related discipline.
• Strong analytical mindset with the ability to dissect complex processes and translate them into clear, actionable insights.
• Proficiency in data analysis tools such as Excel, SQL, Power BI, Tableau, or equivalent platforms.
• Hands‑on experience with requirements gathering, user story creation, and process mapping techniques.
• Exceptional written and verbal communication skills, capable of articulating technical concepts to non‑technical stakeholders.
• Meticulous attention to detail and a disciplined approach to documentation.
• Experience evaluating conversational AI or chatbot systems is highly desirable.

Preferred Skills & Competencies

• Knowledge of natural language processing (NLP) fundamentals and chatbot architecture.
• Familiarity with agile development methodologies and sprint planning.
• Experience with A/B testing, user feedback loops, and performance metrics in AI products.
• Strong problem‑solving abilities and a proactive attitude toward continuous improvement.
• Ability to work independently in a remote setting while maintaining high levels of collaboration.
• Adaptability to fast‑paced environments and changing project priorities.

Skills & Competencies for Success

• Data‑Driven Decision Making: Ability to extract insights from large datasets and translate them into business recommendations.
• Stakeholder Management: Skilled at building trust and influencing decision makers across all levels.
• Technical Fluency: Comfortable working with data engineers, developers, and product owners to implement solutions.
• Communication Excellence: Clear, concise, and persuasive communication in both written and verbal formats.
• Project Management: Proven track record of managing multiple initiatives simultaneously with tight deadlines.
• Innovation Mindset: Constantly exploring new tools, techniques, and methodologies to improve processes.

Career Growth & Learning Opportunities

At brighthush, we’re committed to nurturing talent and fostering career progression. As a Senior Remote Business Analyst, you’ll have the chance to:

• Lead cross‑functional initiatives that shape the future of conversational AI.
• Mentor junior analysts and contribute to the development of internal knowledge bases.
• Participate in hackathons, innovation labs, and AI research projects.
• Advance into senior analyst, product owner, or AI strategy roles based on performance and interest.
• Access continuous learning resources, including online courses, certifications, and industry conferences.
• Engage with a global community of AI professionals and thought leaders.

Work Environment & Company Culture

brighthush thrives on a culture of transparency, empowerment, and mutual respect. Our remote‑first approach means you can work from anywhere in the USA while staying connected through:

• Weekly virtual stand‑ups and monthly all‑hands meetings.
• Collaborative tools such as Slack, Microsoft Teams, and Confluence.
• Flexible work hours that accommodate different time zones and personal commitments.
• Regular virtual coffee breaks and team‑building activities.
• Annual company retreats and team‑offsite events.

We celebrate diversity and encourage every team member to bring their authentic self to work. Our inclusive policies ensure that all voices are heard and that innovation thrives.

Compensation, Perks, and Benefits

While specific figures vary based on experience and location, brighthush offers a competitive salary package that reflects the value of your expertise. In addition to base pay, you can expect:

• Performance‑based bonuses tied to project milestones and company growth.
• Comprehensive health, dental, and vision insurance plans.
• 401(k) retirement plan with company match.
• Generous paid time off (PTO) and flexible vacation policies.
• Professional development stipend for courses, certifications, and conferences.
• Access to cutting‑edge AI tools and platforms for personal and professional use.
• Annual company retreats and team‑offsite events.

Application Process

Ready to make a tangible impact on the future of AI? Submit your resume and a cover letter detailing your experience with chatbot evaluation or similar projects. Highlight any measurable outcomes you’ve achieved and explain why you’re excited to join brighthush.

Our hiring process is designed to be transparent and respectful of your time:

• Initial Screening: A brief phone call with our recruiting team to discuss your background and the role.
• Technical Assessment: A case study or live exercise focused on chatbot evaluation and data analysis.
• Panel Interview: Conversations with product managers, data scientists, and senior leadership to assess fit and expertise.
• Offer & Onboarding: A competitive offer followed by a structured onboarding program that integrates you into our remote culture.

We look forward to exploring how your expertise can help us elevate our conversational AI solutions to new heights.