Physician (MD/DO) Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes to test and improve medical AI systems. The work is project based and part time, with tasks submitted during active phases.

What you will do

• Assess EHR case vignettes that include a question, a suggested answer and a misleading option
• Rate items for accuracy, completeness, answer correctness, gradeability and trap quality
• Verify that reasoning chains reach conclusions from case facts alone and correct faulty traces
• Write brief justifications and take part in blind reads followed by physician adjudication
• Cover diagnosis and treatment tasks across many body systems, including heart and lung cases

What they look for

• An MD or DO plus a current unrestricted US medical licence verified by the issuing board
• Board certification or completed residency, with recent direct patient care, ideally at attending level
• Broad diagnostic and treatment experience across internal, family, emergency or hospital medicine
• Solid clinical reasoning in differential diagnosis, next steps and evidence based guidelines
• Written English at C1 level or above