Physician (MD/DO) - Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes and reasoning to help improve medical AI systems. Work is project-based and part-time, with tasks done remotely for technology clients.

What you will do

• Assess clinical vignettes that pair a case with a question, a suggested answer and a misleading option
• Rate benchmark items for accuracy, completeness, answer correctness and how easily the answer is revealed
• Verify that reasoning chains follow only from the case facts, fix traces and write brief justifications
• Take part in three separate blind reviews followed by physician adjudication
• Cover diagnosis and treatment tasks across many body systems, including cardiovascular and respiratory

What they look for

• An MD or DO plus a current unrestricted US medical license verified by the issuing board
• Board certification or completed residency, with recent direct patient care, ideally at attending level
• Broad diagnostic and treatment experience across systems, such as internal, family, emergency or hospital medicine
• Solid clinical reasoning in differential diagnosis, next steps and evidence-based guidelines
• Strong written English at C1 level or above