Data Scientist - AI Evaluator
About the Company
Handshake offers project-based opportunities that connect experienced professionals with AI research initiatives. Through this engagement, data scientists can contribute their expertise to evaluating AI-generated content and helping AI models improve their ability to reason through real-world data science problems.
About the Role
Handshake is seeking experienced Data Scientists for an ongoing, part-time contract opportunity focused on AI research and model evaluation. In this role, you will create data science problems based on real modeling, analysis, and experimentation work, assess AI-generated responses, and provide structured feedback to improve model performance. This is a fully remote opportunity for candidates based in the United States. The work is flexible and can be completed alongside an existing role, with no set schedule or minimum number of working hours. You can complete project tasks at your own pace.
Key Responsibilities
Create expert-level data science problems and scenarios based on real-world modeling, analysis, and experimentation. Evaluate AI-generated responses for technical accuracy, practical feasibility, and alignment with real-world data science practices. Provide structured, detailed feedback to help improve AI model performance and reasoning. Complete project tasks independently and manage your work at your own pace without a fixed schedule or minimum hour requirement.
Required Qualifications
At least 1 year of professional, hands-on data science experience in industry or research at a top company. Bachelor's degree in Data Science, Statistics, Mathematics, Computer Science, or a related field. Demonstrated depth in at least one of the following areas: machine learning and applied ML; statistical modeling and experimentation, including A/B testing or causal inference; or large-scale data analysis and feature engineering. Based in the United States. Strong written communication skills and attention to detail. Ability to explain complex data science concepts clearly. Ability to work independently in a remote, asynchronous environment. Preferred Qualifications / Requirements Experience at a recognized, top-tier technology company is advantageous but not required. Salary & Benefits Compensation is advertised at $239,600–$249,600 per year, while the role description also specifies an hourly rate of up to $120. The opportunity is part-time and project-based, so compensation details should be confirmed during the engagement process. Location and Work Arrangement This is a fully remote contract opportunity for candidates based in the United States. The work is flexible and asynchronous, with no fixed schedule or minimum hour requirement. The engagement is ongoing and project-based.