Physician (MD/DO) - Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes to test and improve medical AI systems. Work is project based and part time.

What you will do

• Assess EHR vignettes with a question, an answer and a trap answer
• Rate clinical reasoning quality, including accuracy, completeness and trap design
• Verify that reasoning traces reach the answer from vignette facts alone
• Correct reasoning traces and write brief rationales
• Take part in three blind reads followed by physician adjudication

What they look for

• MD or DO with an active unrestricted US medical licence
• Board certification or completed residency plus recent direct patient care
• Broad diagnostic and treatment experience across body systems
• Strong clinical reasoning and knowledge of evidence based guidelines
• Written English at C1 level or above

Nice to have

• Background in medical annotation or quality assurance