UX/UI Designer
AI Media Evaluator – Freelance Independent Contractor Pay: Up to USD $15 per hour, with weekly payments Location: Remote; applicants must reside in an eligible country Schedule: Flexible, with no minimum hours Engagement type: Freelance / independent contractor (1099) About The Company Outlier is an AI training platform owned and operated by Scale AI. Outlier connects experts with projects that help improve artificial intelligence systems through training data, feedback, and evaluation. Contributors review and assess AI-generated content, helping teams understand how models respond to prompts and perform in practical situations. The platform’s work supports the development of AI systems that are more useful, capable, and reliable. About The Role Outlier is seeking detail-oriented English speakers to evaluate AI-generated media remotely. In this flexible freelance role, you may hold scenario-based conversations with AI voice models, compare generated images or videos, assess speech, or label actions in video clips. You will use project guidelines to evaluate each output and provide clear, evidence-based feedback in English. Project availability and task types may vary, and assignments depend on current platform needs. You can choose when to work, with no minimum weekly hours.
Qualifications
Candidates should be fluent in English, with strong written communication skills and comfort speaking naturally in everyday conversations. You should be patient and attentive when reviewing visual or audio content, including replaying clips or zooming in to identify issues. The role requires sound judgment, the ability to make a clear choice when both options have limitations, and skill in explaining decisions with specific observations. Experience writing short reviews or evidence-based assessments is helpful. Pursuing or holding a bachelor’s degree or higher is an advantage, but is not required for every project. To sign up, you will need a valid ID and mobile phone from your country of residence, an up-to-date resume, and a LinkedIn profile showing your education and work experience. Applicants must be authorized to work in their country of residence. Current applicant locations include Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.
Responsibilities
Conduct live, scenario-based conversations in English with AI voice models, then evaluate how natural, clear, and useful their responses sound. Compare pairs of AI-generated images or videos and determine which better follows the supplied prompt. Review media closely for issues such as distorted anatomy, unnatural movement, flickering, inaccurate text, poor visual quality, or audio that does not match the video. Rate outputs according to project criteria, which may include prompt adherence, quality, and realism, and write concise explanations that identify the evidence behind your assessment. Depending on project availability, tasks may also include comparing edited images with originals, ranking generated videos against prompts or source clips, labeling actions in first-person videos, correcting AI-drafted captions, and assessing speech naturalness, pronunciation, or similarity to a target voice. Some assignments may ask you to record a brief spoken explanation.
Benefits
Work remotely and set a schedule that fits your availability, whether you choose a few hours or substantially more each week. Project work pays up to USD $15 per hour, with rates varying according to skills, expertise, location, project requirements, and assessment results. Some projects offer additional incentives through Missions; contributor earnings vary, and incentive availability and terms depend on the project. Payments are processed weekly on Tuesdays for the previous pay period, through PayPal, AirTM, or ACH transfer. Eligible contributors may also receive free access to leading LLMs, valued at more than $200 per month, and opportunities to collaborate with experts on pre-release models. To apply, create an Outlier account, upload your resume and valid ID, and complete available onboarding steps. This is a contractor opportunity, not employment. Outlier does not offer internships, sponsorship, or employee benefits through this engagement. Consult a tax or immigration professional if you have questions about your circumstances. Equal Opportunity Outlier welcomes qualified applicants from eligible locations and evaluates contributors based on project requirements, skills, and qualifications. Applicants must be authorized to work in their country of residence. This freelance opportunity does not provide employment, visa sponsorship, or immigration support.