[Remote] Hospitalist / Internist - Medical AI Evaluation (Remote, Part-Time)

Note: The job is a remote job and is open to candidates in USA. Mindrift connects physicians with project-based opportunities for leading technology companies. In this project, practicing physicians evaluate clinical EHR vignettes and assess benchmark items, clinical reasoning, answer quality, and reasoning traces for a medical AI evaluation program.

Responsibilities

• Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems
• Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality
• Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales
• Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself

Skills

• US-based, actively practicing physicians (MD/DO)
• Medical degree (MD or DO)
• An active, unrestricted US medical license
• Recent direct patient care
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine)
• Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines
• Strong written English (C1+)
• Board certification or completed residency training
• Attending-level
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA

Company Overview