Remote Business Analyst – AI Chatbot Evaluation & Performance Optimization Specialist

About brighthush

At brighthush, we’re on a mission to bring AI to life with people. Founded in 2020, brighthush has quickly grown into a vibrant, people‑centric tech company that blends cutting‑edge artificial intelligence with human‑centered design. With a dedicated team of 11‑50 professionals headquartered in India and a global footprint that reaches every corner of the world, we’re building the next generation of conversational AI solutions that empower businesses and delight users.

Our culture is built on curiosity, collaboration, and a relentless drive to solve real‑world problems. We believe that the best ideas come from diverse perspectives, so we foster an inclusive environment where every voice is heard. Whether you’re a seasoned analyst or a fresh graduate, you’ll find a place at brighthush where your contributions matter, your growth is accelerated, and your work has a tangible impact on millions of people.

Why This Role Matters

Artificial intelligence is reshaping how businesses interact with customers, and chatbots are at the forefront of this transformation. As a Remote Business Analyst – AI Chatbot Evaluation & Performance Optimization Specialist, you will be the critical bridge between business objectives and AI capabilities. Your analyses will guide the refinement of chatbot responses, ensuring they meet stringent business criteria, deliver consistent value, and align with user expectations.

In this role, you’ll:

• Drive the evaluation of chatbot interactions across multiple platforms.
• Translate complex business requirements into actionable AI performance metrics.
• Identify gaps and recommend enhancements that elevate user experience and operational efficiency.
• Produce clear, data‑driven reports that inform stakeholders and shape product strategy.

Key Responsibilities

• Chatbot Response Evaluation: Systematically assess chatbot outputs against predefined business criteria, scoring accuracy, relevance, tone, and compliance.
• Requirements Analysis: Collaborate with product managers, UX designers, and data scientists to capture and document functional and non‑functional requirements.
• Process Mapping: Create detailed flowcharts and process maps that illustrate current chatbot workflows and highlight inefficiencies.
• Gap Identification: Detect inconsistencies, missing features, and performance bottlenecks that hinder optimal chatbot performance.
• Recommendation Development: Formulate actionable improvement plans, prioritizing initiatives based on business impact and technical feasibility.
• Reporting & Documentation: Compile comprehensive assessment reports, executive summaries, and technical documentation for cross‑functional teams.
• Stakeholder Collaboration: Present findings to senior leadership, product owners, and engineering teams, facilitating informed decision‑making.
• Continuous Improvement: Monitor post‑implementation results, refine evaluation criteria, and iterate on recommendations to sustain high performance.

Essential Qualifications

• Minimum 3 years of proven experience as a Business Analyst in technology or AI‑driven environments.
• Bachelor’s degree in Business Administration, Finance, Computer Science, Information Systems, or a related discipline.
• Strong analytical mindset with the ability to dissect complex processes and translate them into clear, actionable insights.
• Proficiency in data analysis tools such as Excel, SQL, Power BI, Tableau, or equivalent platforms.
• Hands‑on experience with requirements gathering, user story creation, and process mapping techniques.
• Exceptional written and verbal communication skills, capable of articulating technical concepts to non‑technical stakeholders.
• Meticulous attention to detail and a disciplined approach to documentation.
• Experience evaluating conversational AI or chatbot systems is highly desirable.

Preferred Skills & Competencies

• Knowledge of natural language processing (NLP) fundamentals and chatbot architecture.
• Familiarity with agile development methodologies and sprint planning.
• Experience with A/B testing, user feedback loops, and performance metrics in AI products.
• Strong problem‑solving abilities and a proactive attitude toward continuous improvement.
• Ability to work independently in a remote setting while maintaining high levels of collaboration.
• Adaptability to fast‑paced environments and changing project priorities.

Career Growth & Learning Opportunities

At brighthush, we’re committed to nurturing talent and fostering career progression. As a Remote Business Analyst, you’ll have the chance to:

• Lead cross‑functional initiatives that shape the future of conversational AI.
• Mentor junior analysts and contribute to the development of internal knowledge bases.
• Participate in hackathons, innovation labs, and AI research projects.
• Advance into senior analyst, product owner, or AI strategy roles based on performance and interest.
• Access continuous learning resources, including online courses, certifications, and industry conferences.

Work Environment & Company Culture

brighthush thrives on a culture of transparency, empowerment, and mutual respect. Our remote‑first approach means you can work from anywhere in the USA while staying connected through:

• Weekly virtual stand‑ups and monthly all‑hands meetings.
• Collaborative tools such as Slack, Microsoft Teams, and Confluence.
• Flexible work hours that accommodate different time zones and personal commitments.
• Regular virtual coffee breaks and team‑building activities.

We celebrate diversity and encourage every team member to bring their authentic self to work. Our inclusive policies ensure that all voices are heard and that innovation thrives.

Compensation, Perks, and Benefits

While specific figures vary based on experience and location, brighthush offers a competitive salary package that reflects the value of your expertise. In addition to base pay, you can expect:

• Performance‑based bonuses tied to project milestones and company growth.
• Comprehensive health, dental, and vision insurance plans.
• 401(k) retirement plan with company match.
• Generous paid time off (PTO) and flexible vacation policies.
• Professional development stipend for courses, certifications, and conferences.
• Access to cutting‑edge AI tools and platforms for personal and professional use.
• Annual company retreats and team‑offsite events.

How to Apply

Ready to make a tangible impact on the future of AI? Submit your resume and a cover letter detailing your experience with chatbot evaluation or similar projects. Highlight any measurable outcomes you’ve achieved and explain why you’re excited to join brighthush.

We look forward to exploring how your expertise can help us elevate our conversational AI solutions to new heights.