Physician (MD/DO) - Medical AI Evaluation

About the role

Practising physicians assess clinical vignettes and reasoning for a medical AI evaluation programme, mainly in general and internal medicine. The work is part-time and project-based.

What you will do

• Review clinical vignettes with a question, a proposed answer and a misleading trap answer across body systems
• Rate the quality of clinical reasoning in benchmark items, including accuracy, completeness and trap quality
• Verify that reasoning chains reach the answer from vignette facts alone and correct reasoning traces
• Write brief rationales and take part in blind reads followed by physician adjudication

What they look for

• Board certification or completed residency, with recent direct patient care, ideally at attending level
• Broad diagnostic and treatment experience across systems, such as internal, family, emergency or hospital medicine
• Solid clinical reasoning in differential diagnosis, next-step management and evidence-based guidelines
• Written English at C1 level or above