Physician (MD/DO), Medical AI Evaluation

About the role

Practising physicians review clinical vignettes and reasoning for a medical AI evaluation effort, scoring quality and writing short rationales. Work is project based and part time.

What you will do

• Assess clinical vignettes paired with questions, proposed answers and trap answers
• Score items on vignette accuracy, completeness, answer correctness and trap quality
• Check whether reasoning reaches the answer from the vignette facts alone
• Correct reasoning traces and write brief rationales
• Take part in blind reads followed by physician adjudication

What they look for

• MD or DO degree plus an active unrestricted US medical licence
• Board certification or completed residency, with recent direct patient care
• Broad diagnostic and treatment experience across body systems
• Strong clinical reasoning, including differential diagnosis and evidence based guidelines
• Written English at C1 level or above
• Based in the United States and open to part time project work

Nice to have

• Experience with medical annotation or quality assurance