Software Engineer
About The Company Based in San Francisco, California, Turing is recognized as the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing's mission is to accelerate frontiers of AI research by providing high-quality data, sophisticated training pipelines, and access to top-tier AI researchers specializing in software engineering, logical reasoning, STEM disciplines, multilinguality, multimodality, and autonomous agents. The company supports its clients in transforming AI from proof of concept to proprietary intelligence, ensuring systems that perform reliably, deliver measurable impact, and generate lasting results on the P&L. Turing’s innovative approach and commitment to excellence have positioned it at the forefront of AI research and enterprise deployment, fostering a collaborative environment that drives technological advancements and industry-leading solutions. About The Role As a Software Engineering Evaluator at Turing, you will play a pivotal role in creating and curating cutting-edge datasets used for training, benchmarking, and advancing large language models. Your primary responsibility will be to collaborate closely with researchers to develop high-quality code examples, provide precise solutions, and make necessary corrections. The role requires a strong focus on Python, especially in backend services, data pipelines, and machine learning infrastructure, along with proficiency in JavaScript (including ReactJS), C/C++, Java, Rust, and Go. You will evaluate AI-generated code for efficiency, scalability, and reliability, working with cross-functional teams to enhance enterprise-level AI-driven coding solutions. This position offers an exciting opportunity to contribute to the development of next-generation AI systems that impact the industry at large, leveraging your expertise to ensure the robustness and performance of AI models and solutions.
Qualifications
Minimum of three years of professional software engineering experience, preferably at high-scale organizations such as Google, Microsoft, Apple, Amazon, or Meta. Strong expertise in Python, with a comprehensive understanding of frameworks, tooling, and best practices for building production-grade software. Proven experience in developing full-stack applications and deploying scalable software solutions using modern programming languages and tools. Deep knowledge of software architecture, design principles, debugging techniques, and code quality assessment. Excellent communication skills, both oral and written, with the ability to articulate evaluation rationales clearly and effectively. Graduates from top computer science programs such as Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, or similar institutions are preferred, though exceptional experience and skills are prioritized. Ability to work independently in a remote environment, with a commitment of at least 10 hours per week.
Responsibilities
Curate and generate code examples, primarily in Python, to support AI model training and benchmarking efforts. Build solutions and correct code snippets across multiple programming languages, including JavaScript, C/C++, Java, Rust, and Go. Evaluate AI-generated code to ensure it meets standards of efficiency, scalability, and reliability, providing detailed feedback and suggestions for improvement. Collaborate with research and engineering teams to enhance AI-driven coding tools and solutions, aligning with industry performance benchmarks. Develop agents and automated verification tools in Python to assess code quality, identify error patterns, and automate quality assurance processes. Design and implement verification mechanisms that can automatically validate solutions to various software engineering tasks, supporting continuous improvement of AI models. Participate in hypothesis generation around software engineering cycles, including prototyping, architecture design, API development, deployment, monitoring, and operational maintenance.
Benefits
While this role is structured as a flexible contractor engagement, it offers the opportunity to work remotely with a minimum commitment of 10 hours per week, up to 40 hours. The contract duration is initially set for one month, with the possibility of extension based on performance and project needs. Although this position does not include medical or paid leave benefits, it provides valuable experience working on cutting-edge AI research and development initiatives alongside leading experts in the field. You will gain exposure to large-scale AI systems, contribute directly to impactful projects, and enhance your skills in a dynamic, innovative environment. This role is ideal for professionals seeking flexible, project-based work that complements their existing commitments while advancing their expertise in AI and software engineering. Equal Opportunity Turing is committed to creating an inclusive environment and is proud to be an equal opportunity employer. We celebrate diversity and are dedicated to fostering a workplace that respects and values individual differences. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, age, disability, or any other protected status. We believe that diverse teams drive innovation and success, and we encourage candidates from all backgrounds to apply.