Physician (MD/DO) for Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes and reasoning for a medical AI evaluation program, scoring quality and correcting reasoning traces.

What you will do

• Evaluate clinical vignettes paired with questions, proposed answers and trap answers across body systems
• Score benchmark items for vignette accuracy, answer correctness, gradeability and trap quality
• Check reasoning chains against vignette facts and write short rationales
• Work through three independent blind reads before physician adjudication

What they look for

• MD or DO with an active unrestricted US medical license
• Board certification or completed residency with recent direct patient care
• Broad multi-system diagnostic and treatment experience in internal, family, emergency or hospital medicine
• Strong clinical reasoning and knowledge of evidence-based guidelines
• Written English at C1 level or above