[Remote] Data Analyst (AI Evaluation)

Note: The job is a remote job and is open to candidates in USA. The hiring company is an AI organization that combines human expertise with machine learning workflows to build, evaluate, and improve intelligent systems. The company is seeking a Data Analyst to review and evaluate datasets, identify quality issues, apply structured criteria, and provide feedback that supports the training of next-generation AI models.

Responsibilities

• Review datasets and detailed task outputs for accuracy, completeness, and adherence to guidelines
• Identify and flag inconsistencies, errors, and outputs that deviate from provided instructions
• Apply structured rubrics and evaluation criteria consistently across large data sets
• Exercise sound judgment and document rationale in ambiguous scenarios where guidelines are unclear
• Escalate patterns or recurring data issues for further analysis rather than addressing them individually
• Provide clear, actionable written and verbal feedback pinpointing issues and suggesting resolution paths
• Maintain meticulous attention to detail while working through high volumes of repetitive data review assignments

Skills

• 3–5+ years of experience in data review, data quality, quality assurance, or analytical roles
• Proven expertise in reviewing, validating, and critiquing data or deliverables based on explicit criteria
• Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely
• Demonstrated comfort with ambiguity, including making justifiable decisions when guidelines are incomplete
• Advanced attention to detail and error-spotting capabilities across repetitive or high-volume work
• Strong written and verbal communication skills for documenting findings and providing feedback
• Baseline fluency with spreadsheets (sorting, filtering, simple formulas)
• SQL or hands-on data querying

Benefits

• Remote work

Company Overview