Physician (MD/DO), Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes and judge the quality of answers produced by medical AI systems. The work helps improve tools that clinicians may later use themselves.

What you will do

• Review clinical vignettes paired with questions, proposed answers and trap answers
• Score items for accuracy, completeness and whether the vignette reveals the answer
• Check that reasoning chains follow from the vignette facts and correct them
• Write brief rationales for your judgments
• Take part in independent blind reads followed by physician adjudication

What they look for

• MD or DO degree plus an active unrestricted US medical license
• Board certification or completed residency, with recent direct patient care
• Broad diagnostic and treatment experience across body systems
• Strong clinical reasoning, including differential diagnosis and next-step management
• Written English at C1 level or above

Nice to have

• Background in medical annotation or quality assurance