Physician (MD/DO), Medical AI Evaluation

About the role

Practising physicians assess clinical vignettes for a medical AI evaluation programme, mainly in general and internal medicine. Contributors score reasoning quality and help improve the AI systems they may later use themselves.

What you will do

• Score benchmark items for vignette accuracy, completeness, answer correctness and trap quality
• Check whether reasoning chains reach the answer from vignette facts alone and write short rationales
• Work through three independent blind reads before physician adjudication

What they look for

• Board certification or completed residency, with recent direct patient care, attending level preferred
• Broad multi system diagnostic and treatment experience in internal, family, emergency or hospital medicine
• Strong clinical reasoning in differential diagnosis, next step management and evidence based guidelines
• Written English at C1 level or above