Content Writer
Outlier, a platform operated by Scale AI, helps some of the world’s most innovative companies improve artificial intelligence by providing human feedback. We are seeking thoughtful, fluent English speakers who can assess AI-generated voice, image, and video content with care, consistency, and clear reasoning. About The Company Scale AI works with organizations developing and deploying advanced AI systems. Through Outlier, qualified contributors support the improvement of generative AI models by evaluating model responses and providing human judgments. This freelance opportunity connects contributors with project-based work that helps AI systems better understand language, follow instructions, and produce useful, realistic outputs. Project availability and requirements may vary according to business needs, contributor qualifications, and location. About The Role As an English-language AI Content Evaluator, you will review and compare generated media, participate in scenario-based conversations with AI voice models, and explain your assessments in writing. You will judge how well outputs follow prompts and evaluate qualities such as clarity, naturalness, usefulness, realism, and overall quality. This is remote freelance work with flexible scheduling, allowing you to complete available tasks at times that suit your schedule. Assignments may focus on voice, images, video, or a combination of media types.
Qualifications
Fluent English skills, including clear written communication and comfort speaking naturally in everyday conversations. Strong attention to detail and the patience to inspect content carefully, replay audio or video, and zoom in on visual details when needed. Ability to compare imperfect outputs and make a well-supported decision about which performs better. Comfort thinking on your feet and responding naturally in realistic, scenario-based conversations. Experience writing concise, evidence-based explanations, feedback, reviews, or evaluations. Pursuing or holding a bachelor’s degree or higher is desirable. Access to a computer, reliable internet connection, and headphones. A quiet environment is required for assignments involving live conversation.
Responsibilities
Hold live, scenario-based conversations in English with AI voice models and assess whether responses sound natural, clear, and useful. Compare pairs of AI-generated images and videos to determine which better follows the instructions or prompt. Review generated content closely for issues such as distorted anatomy, visual artifacts, flickering, unnatural movement, text errors, or mismatched audio and video. Rate outputs across relevant dimensions, including prompt adherence, quality, clarity, and realism. Provide specific written explanations that identify observable evidence supporting your ratings and decisions. Follow project guidelines, meet quality expectations, and complete required screening and onboarding activities. Submit original judgments and explanations. AI tools must not be used to write your evaluations.
Benefits
Contributors can work remotely and choose flexible hours based on project availability. Core project work may pay up to USD $18 per hour; actual rates vary based on expertise, skills assessments, location, project needs, and other factors. Some projects may offer higher rates for specialized qualifications, such as a PhD. Eligible projects may also provide Missions, Outlier’s incentive program. Based on payments during the past six months, contributors earned an average of 7.5% above core project rates through Missions, while contributors in the top quartile increased earnings by an average of 11%. Incentives and rates are not guaranteed and may change. Lower rates may apply to onboarding or other non-core work. Review the payment terms for each project before accepting assignments. Equal Opportunity Scale AI and Outlier welcome qualified contributors from a range of backgrounds and experiences. Selection is based on project requirements, skills, and relevant qualifications. We are committed to providing fair consideration and an inclusive opportunity to participate, subject to applicable laws and project eligibility requirements.