Remote Software Engineer
About The Company Based in San Francisco, California, Turing is recognized as the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing’s mission is to accelerate frontier research by providing high-quality data, advanced training pipelines, and top-tier AI researchers specializing in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents. The company also focuses on transforming AI from proof of concept into proprietary intelligence that performs reliably, delivers measurable impact, and drives lasting results on the profit and loss statement for enterprise clients. With a commitment to innovation and excellence, Turing supports organizations in harnessing the power of AI to revolutionize their operations and achieve strategic objectives. About The Role We are seeking a highly skilled Software Engineering Evaluator to join our dynamic team at Turing. In this role, you will be instrumental in creating and curating cutting-edge datasets for training, benchmarking, and advancing large language models. Your primary responsibilities will include collaborating closely with researchers to develop high-quality code datasets, evaluating AI-generated code, and refining solutions to ensure efficiency, scalability, and reliability. This position offers an exciting opportunity to work on the forefront of AI research and enterprise application development, contributing to the enhancement of AI-driven coding solutions across various industries. The ideal candidate will have a strong background in software engineering, with extensive experience in programming languages such as Python, JavaScript, C/C++, Java, Rust, and Go, and a passion for advancing AI technology in real-world applications.
Qualifications
The ideal candidate will possess several years of professional software engineering experience, with a minimum of three years in building and deploying production-grade systems. Strong expertise in Python, including familiarity with frameworks, tooling, and best practices for scalable software development, is essential. Candidates should have experience in building full-stack applications, designing scalable architectures, and deploying software solutions using modern languages and tools. A deep understanding of software architecture, debugging, code review, and quality assessment is required. Excellent communication skills are necessary to articulate evaluation rationales clearly and effectively. Preference will be given to applicants from top computer science programs such as Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, or similar institutions, though exceptional experience and skills are valued over pedigree alone.
Responsibilities
Curate and create high-quality code datasets for training and benchmarking large language models, focusing primarily on Python and extending to JavaScript (including ReactJS), C/C++, Java, Rust, and Go. Evaluate and refine AI-generated code to ensure it meets standards for efficiency, scalability, and reliability. Collaborate with cross-functional teams, including researchers and engineers, to develop and enhance AI-driven coding solutions that meet industry benchmarks. Design and implement verification tools and agents in Python to automatically assess code quality, identify error patterns, and verify solutions to complex software engineering tasks. Hypothesize and evaluate various phases of the software engineering cycle, including prototyping, architecture design, API development, deployment, and operational maintenance. Develop automated verification mechanisms to ensure the correctness and robustness of AI-generated code solutions. Contribute to continuous improvement initiatives by providing insights and feedback based on evaluation results.
Benefits
While this is a contractor role with flexible engagement options, candidates will benefit from the opportunity to work remotely with a globally recognized leader in AI research. The position offers a minimum commitment of 10 hours per week, with the potential to extend based on performance and project needs. Though this role does not include medical or paid leave, it provides valuable experience working on cutting-edge AI projects, collaborating with top researchers and engineers, and contributing to innovative solutions that impact various industries. The flexible schedule allows candidates to balance their professional commitments while engaging in meaningful and impactful work at the forefront of AI technology. Equal Opportunity Turing is committed to creating a diverse and inclusive work environment. We are an equal opportunity employer and do not discriminate based on race, ethnicity, gender, age, religion, sexual orientation, disability, or any other protected characteristic. We value the unique perspectives and experiences that each individual brings to our team and strive to foster a culture of respect, collaboration, and innovation. All qualified applicants will be considered for employment without regard to any protected status, and we encourage candidates from all backgrounds to apply.