Physician (MD/DO) Medical AI Evaluation

About the role

Practising physicians review clinical vignettes and reasoning for a medical AI evaluation programme, mostly in general and internal medicine. Work is project based and part time.

What you will do

• Assess clinical vignettes with a question, a proposed answer and a misleading trap answer across diagnosis and treatment
• Rate the quality of clinical reasoning in benchmark items, including accuracy, completeness and whether the answer is given away
• Verify that reasoning chains reach the answer from vignette facts alone and correct faulty traces
• Write brief rationales and take part in blind reads followed by physician adjudication

What they look for

• An MD or DO with an active, unrestricted US medical licence verified by the issuing board
• Board certification or completed residency plus recent direct patient care, ideally at attending level
• Broad diagnostic and treatment experience across internal, family, emergency or hospital medicine
• Strong clinical reasoning in differential diagnosis, next steps and evidence based guidelines
• Written English at C1 level or above