Senior Remote Business Analyst – AI Chatbot Evaluation & Performance Optimization Specialist (Conversational AI & Data Analytics Lead) at brighthush

About brighthush

brighthush is a forward‑thinking, people‑centric technology firm that has been redefining the conversational AI landscape since its inception in 2020. With a vibrant team of 11‑50 professionals headquartered in India and a global footprint that spans every continent, we blend cutting‑edge artificial intelligence with human‑centered design to create solutions that empower businesses and delight users worldwide. Our mission is simple yet ambitious: to bring AI to life by making it intuitive, accessible, and genuinely helpful for everyday interactions.

Why This Role Matters

Artificial intelligence is reshaping how businesses engage with customers, and chatbots are at the forefront of this transformation. As a Senior Remote Business Analyst – AI Chatbot Evaluation & Performance Optimization Specialist, you will be the critical bridge between business objectives and AI capabilities. Your analyses will guide the refinement of chatbot responses, ensuring they meet stringent business criteria, deliver consistent value, and align with user expectations. In this role, you will:

• Drive the evaluation of chatbot interactions across multiple platforms.
• Translate complex business requirements into actionable AI performance metrics.
• Identify gaps and recommend enhancements that elevate user experience and operational efficiency.
• Produce clear, data‑driven reports that inform stakeholders and shape product strategy.

Key Responsibilities

Chatbot Response Evaluation

Systematically assess chatbot outputs against predefined business criteria, scoring accuracy, relevance, tone, and compliance. Use a combination of automated tools and manual reviews to ensure high quality and consistency.

Requirements Analysis

Collaborate with product managers, UX designers, and data scientists to capture and document functional and non‑functional requirements. Translate business needs into clear, testable specifications that guide development and QA.

Process Mapping & Workflow Design

Create detailed flowcharts and process maps that illustrate current chatbot workflows, highlight inefficiencies, and propose streamlined pathways. Leverage BPMN or similar notations to communicate complex processes to technical and non‑technical stakeholders.

Gap Identification & Root Cause Analysis

Detect inconsistencies, missing features, and performance bottlenecks that hinder optimal chatbot performance. Conduct root cause analyses to uncover underlying issues and recommend targeted fixes.

Recommendation Development & Prioritization

Formulate actionable improvement plans, prioritizing initiatives based on business impact, technical feasibility, and resource availability. Develop roadmaps that align with product strategy and organizational goals.

Reporting & Documentation

Compile comprehensive assessment reports, executive summaries, and technical documentation for cross‑functional teams. Ensure clarity, accuracy, and accessibility of all deliverables.

Stakeholder Collaboration & Presentation

Present findings to senior leadership, product owners, and engineering teams, facilitating informed decision‑making. Translate data insights into compelling narratives that drive consensus and action.

Continuous Improvement & Post‑Implementation Review

Monitor post‑implementation results, refine evaluation criteria, and iterate on recommendations to sustain high performance. Champion a culture of data‑driven decision making and iterative enhancement.

Essential Qualifications

• Minimum 3 years of proven experience as a Business Analyst in technology or AI‑driven environments.
• Bachelor’s degree in Business Administration, Finance, Computer Science, Information Systems, or a related discipline.
• Strong analytical mindset with the ability to dissect complex processes and translate them into clear, actionable insights.
• Proficiency in data analysis tools such as Excel, SQL, Power BI, Tableau, or equivalent platforms.
• Hands‑on experience with requirements gathering, user story creation, and process mapping techniques.
• Exceptional written and verbal communication skills, capable of articulating technical concepts to non‑technical stakeholders.
• Meticulous attention to detail and a disciplined approach to documentation.
• Experience evaluating conversational AI or chatbot systems is highly desirable.

Preferred Skills & Competencies

• Knowledge of natural language processing (NLP) fundamentals and chatbot architecture.
• Familiarity with agile development methodologies and sprint planning.
• Experience with A/B testing, user feedback loops, and performance metrics in AI products.
• Strong problem‑solving abilities and a proactive attitude toward continuous improvement.
• Ability to work independently in a remote setting while maintaining high levels of collaboration.
• Adaptability to fast‑paced environments and changing project priorities.

Skills & Competencies for Success

• Data‑Driven Decision Making: Ability to extract insights from large datasets and translate them into business recommendations.
• Stakeholder Management: Skilled at building trust and influencing decision makers across all levels.
• Technical Fluency: Comfortable working with data engineers, developers, and product owners to implement solutions.
• Communication Excellence: Clear, concise, and persuasive communication in both written and verbal formats.
• Project Management: Proven track record of managing multiple initiatives simultaneously with tight deadlines.
• Innovation Mindset: Constantly exploring new tools, techniques, and methodologies to improve processes.

Career Growth & Learning Opportunities

At brighthush, we’re committed to nurturing talent and fostering career progression. As a Senior Remote Business Analyst, you will have the chance to:

• Lead cross‑functional initiatives that shape the future of conversational AI.
• Mentor junior analysts and contribute to the development of internal knowledge bases.
• Participate in hackathons, innovation labs, and AI research projects.
• Advance into senior analyst, product owner, or AI strategy roles based on performance and interest.
• Access continuous learning resources, including online courses, certifications, and industry conferences.
• Engage with a global community of AI professionals and thought leaders.

Work Environment & Company Culture

brighthush thrives on a culture of transparency, empowerment, and mutual respect. Our remote‑first approach means you can work from anywhere in the USA while staying connected through:

• Weekly virtual stand‑ups and monthly all‑hands meetings.
• Collaborative tools such as Slack, Microsoft Teams, and Confluence.
• Flexible work hours that accommodate different time zones and personal commitments.
• Regular virtual coffee breaks and team‑building activities.
• Annual company retreats and team‑offsite events.

We celebrate diversity and encourage every team member to bring their authentic self to work. Our inclusive policies ensure that all voices are heard and that innovation thrives.

Compensation, Perks, and Benefits

While specific figures vary based on experience and location, brighthush offers a competitive salary package that reflects the value of your expertise. In addition to base pay, you can expect:

• Performance‑based bonuses tied to project milestones and company growth.
• Comprehensive health, dental, and vision insurance plans.
• 401(k) retirement plan with company match.
• Generous paid time off (PTO) and flexible vacation policies.
• Professional development stipend for courses, certifications, and conferences.
• Access to cutting‑edge AI tools and platforms for personal and professional use.
• Annual company retreats and team‑offsite events.

Application Process

Ready to make a tangible impact on the future of AI? Submit your resume and a cover letter detailing your experience with chatbot evaluation or similar projects. Highlight any measurable outcomes you’ve achieved and explain why you’re excited to join brighthush.

Our hiring process is designed to be transparent and respectful of your time:

• Initial Screening: A brief phone call with our recruiting team to discuss your background and the role.
• Technical Assessment: A case study or live exercise focused on chatbot evaluation and data analysis.
• Panel Interview: Conversations with product managers, data scientists, and senior leadership to assess fit and expertise.
• Offer & Onboarding: A competitive offer followed by a structured onboarding program that integrates you into our remote culture.

We look forward to exploring how your expertise can help us elevate our conversational AI solutions to new heights.