AI Data Quality Analyst
Scale AI is seeking fluent English speakers to help improve the quality, reliability, and realism of advanced artificial intelligence systems. This remote, independent-contractor opportunity is available through Outlier, an AI training platform owned and operated by Scale AI. About The Company Scale AI supports the development of advanced AI by helping organizations build, evaluate, and improve their models. Through Outlier, experts contribute human feedback that helps AI systems better understand instructions and respond effectively in real-world situations. Outlier’s global community includes more than 900,000 experts across 52 countries, and the platform has paid more than $600 million to contributors. About The Role As an AI Media Evaluator, you will assess AI-generated voice, image, and video content. You will conduct scenario-based conversations with AI voice models, compare generated media against prompts, identify quality issues, and write concise, evidence-based feedback in English. Assignments vary by project and may include image ranking, video evaluation, action labeling, audio assessment, or voice quality review. This is flexible, project-based work that can be completed remotely and on your own schedule. There is no minimum number of hours, and availability depends on project needs, qualifications, and successful completion of any required assessments. Applicants are currently being accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.
Qualifications
Applicants should be fluent in English and comfortable communicating naturally in everyday conversation. Strong written communication skills are important, as you will explain decisions clearly and refer to specific evidence in the content you review. You should have strong attention to detail, patience to replay audio or zoom in on images and videos, and the ability to make a reasoned choice when both options have flaws. Experience writing reviews, evaluations, or other concise, evidence-based explanations is helpful. A bachelor’s degree or higher is an advantage but is not required. To sign up, you will need a valid identification document and mobile phone from your country of residence, an up-to-date resume, and a LinkedIn profile that reflects your education and work experience. You must be authorized to work in your country of residence.
Responsibilities
Conduct live, scenario-based conversations in English with AI voice models, then assess each exchange for naturalness, clarity, and usefulness. Compare pairs of AI-generated images or videos to determine which better follows the prompt, and evaluate outputs for adherence, quality, and realism. Carefully inspect media for issues such as distorted anatomy, visual artifacts, flickering, unnatural movement, text errors, pronunciation problems, or audio that does not match the video. For video-labeling assignments, divide first-person footage into individual actions and create accurate captions, correcting AI-generated drafts as needed. Provide specific written explanations that describe what you observed or heard, and complete assigned ratings consistently and accurately.
Benefits
Contributors can work from anywhere in an eligible country, set their own schedule, and choose their availability without a minimum-hour commitment. Project work can pay up to USD $15 per hour, with actual rates determined by factors such as expertise, skills assessments, location, and project requirements. Some projects offer additional incentives; contributor earnings vary, and incentive amounts are not guaranteed. Payments are processed weekly on Tuesdays for work completed during the previous Tuesday-to-Monday pay period. Available payment methods include PayPal, AirTM, and ACH transfer, subject to eligibility. Contributors may also receive free access to leading large language models and opportunities to collaborate with experts on emerging AI systems. Apply by creating an Outlier account, uploading your resume and valid ID, and completing available project tasks. Equal Opportunity Scale AI and Outlier welcome qualified applicants and contributors from diverse backgrounds. Selection and project access are based on applicable requirements, qualifications, assessments, and project availability. This is a freelance 1099 independent-contractor opportunity, not employment. It does not include internships or sponsorship. Rates and task availability may vary, and lower rates may apply to onboarding or other non-core work. Consult a tax or immigration advisor with questions about your individual circumstances.