Physician (MD/DO), Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes and reasoning to score and improve medical AI systems, on a part-time project basis.

What you will do

• Evaluate clinical vignettes paired with questions, answers and trap answers
• Score clinical reasoning quality, including accuracy, completeness and answer correctness
• Check reasoning chains and write short rationales
• Work through blind reads followed by physician adjudication

What they look for

• MD or DO with an active unrestricted US medical license
• Board certification or completed residency with recent patient care
• Broad multi-system diagnostic and treatment experience
• Strong clinical reasoning and evidence-based guideline knowledge
• Written English at C1 level or above

Nice to have

• Prior work in medical AI evaluation, clinical content review or medical annotation