Physician (MD/DO) - Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes and judge the quality of answers produced for a medical AI evaluation program. The work is part-time and project-based.

What you will do

• Score items for vignette accuracy, answer correctness, gradeability and trap quality
• Check whether reasoning chains follow from the vignette facts and correct faulty traces
• Write short rationales and take part in blind reads followed by physician adjudication

What they look for

• MD or DO degree and an active unrestricted US medical license
• Board certification or completed residency with recent direct patient care
• Broad multi-system diagnostic and treatment experience in internal, family, emergency or hospital medicine
• Strong clinical reasoning across differential diagnosis, next steps and guidelines
• Written English at C1 level or above

Nice to have

• Experience with medical annotation or quality assurance