[Remote] Quality Analyst - AI Evaluation | USA

Note: The job is a remote job and is open to candidates in USA. eDataBae is seeking Quality Analysts to evaluate and compare AI-generated chatbot responses. The role assesses response quality, identifies issues, provides structured feedback, and maintains consistent standards while meeting quality and productivity targets.

Responsibilities

• Evaluate and compare responses from multiple chatbots
• Assess accuracy, relevance, completeness, clarity, and guideline adherence
• Identify errors, inconsistencies, and missing information
• Provide structured feedback and final assessments
• Maintain consistent quality across evaluation tasks
• Meet assigned quality, productivity, and turnaround targets

Skills

• 3+ years of experience in QA, data annotation, content evaluation, testing, or a similar role
• Strong analytical and critical-thinking skills
• Excellent written and verbal communication
• High attention to detail
• Ability to follow detailed evaluation guidelines
• Comfortable working with AI tools, chatbots, and online platforms
• Ability to work independently and manage multiple tasks
• Chatbot evaluation, LLM testing, or data-quality experience is a plus

Company Overview