Physician (MD/DO) - Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes and answers to assess the quality of medical AI reasoning. Work is project-based and part-time, done in blind reads with physician adjudication.

What you will do

• Assess clinical vignettes paired with questions, proposed answers and trap answers
• Score reasoning quality, including vignette accuracy, answer correctness and trap quality
• Verify that reasoning chains reach the answer from vignette facts alone
• Correct reasoning traces and write brief rationales
• Take part in three independent blind reads followed by physician adjudication

What they look for

• MD or DO with an active, unrestricted US medical license
• Board certification or completed residency, with recent direct patient care
• Broad multi-system diagnostic and treatment experience
• Strong clinical reasoning and knowledge of evidence-based guidelines
• Written English at C1 level or above