Physician (MD/DO) - Medical AI Evaluation

About the role

Practicing physicians review clinical EHR vignettes for a medical AI evaluation programme, scoring reasoning quality and correcting answer chains. The work is project based and part time.

What you will do

• Rate benchmark items for accuracy, completeness, answer correctness and trap quality
• Check whether reasoning reaches the answer from vignette facts alone and fix reasoning traces
• Write short rationales and take part in blind reads followed by physician adjudication

What they look for

• MD or DO with an active unrestricted US medical licence verified by the issuing board
• Board certification or completed residency plus recent direct patient care, attending level preferred
• Broad multi-system diagnostic and treatment experience in internal, family, emergency or hospital medicine
• Solid clinical reasoning across differential diagnosis, next steps and evidence-based guidelines
• Written English at C1 level or above