Physician (MD/DO) - Medical AI Evaluation

About the role

Practicing physicians review clinical EHR vignettes to test and improve a medical AI system, scoring reasoning quality and answer accuracy across many body systems.

What you will do

• Evaluate clinical vignettes paired with questions, proposed answers and misleading trap answers
• Score benchmark items for vignette accuracy, completeness, answer correctness and trap quality
• Verify that reasoning chains reach the answer from vignette facts alone and write brief rationales
• Complete three independent blind reads before physician adjudication

What they look for

• MD or DO degree plus an active unrestricted US medical license
• Board certification or completed residency with recent direct patient care
• Broad multi-system diagnostic and treatment experience in internal, family, emergency or hospital medicine
• Strong clinical reasoning in differential diagnosis, next-step management and evidence-based guidelines
• Written English at C1 level or above