Software Engineer - Python/Typescript - 100% Remote
About the Company
Turing is a leading AGI infrastructure company that works with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.
About the Role
Turing is seeking an engineer with strong technical judgment and hands-on experience in preference data and rubric creation. This role focuses on developing evaluation criteria, reviewing data for quality, and building the infrastructure needed to support data generation and evaluation workflows. The ideal candidate can distinguish high-quality examples from weaker ones, communicate technical findings clearly, and make effective decisions in fast-moving, ambiguous environments.
Key Responsibilities
Design, refine, and iterate on rubrics and evaluation criteria for preference data. Review and label data, identifying subtle quality issues and maintaining high standards. Build and maintain pipelines and infrastructure for data generation, collection, and evaluation workflows. Prepare clear write-ups, updates, and recommendations based on findings from data-related work. Collaborate with researchers and engineers to turn qualitative judgments into scalable processes.
Required Qualifications
Proficiency in Python, particularly for building and maintaining pipelines and infrastructure, or TypeScript. Hands-on experience with preference data collection and/or rubric creation. Strong written and verbal communication skills, with the ability to translate technical work into clear, actionable summaries. Strong quality judgment and the ability to explain why an example or output is good, rather than simply identifying it as such. Preferred Experience Experience contributing to or navigating large codebases, such as VSCode, is a plus for candidates working with TypeScript. Work Arrangement and Engagement Details Work Arrangement: Fully remote. Employment Type: Independent contractor. Duration: 3 months, with an expected start as soon as possible. Availability: 40 hours per week preferred, with at least 6 hours of overlap with Pacific Time. Candidates with lower availability should share their available hours and overlap window. Compensation: Market rate. Candidates should provide a specific rate expectation rather than a range to help assess mutual fit. Benefits: The independent contractor engagement does not include medical or paid leave benefits. Evaluation Process The evaluation process consists of one approximately 30-minute interview covering technical skills and cultural fit. Project Opportunities Freelancers will have the opportunity to contribute to cutting-edge AI projects with leading large language model (LLM) companies while working remotely.