Physician (MD/DO) for Medical AI Evaluation

About the role

Practicing physicians review clinical vignettes to test and improve medical AI systems. Work is project-based and done in blind reads with physician adjudication.

What you will do

• Score the quality of clinical reasoning in benchmark items
• Judge vignette accuracy, completeness and whether it reveals the answer
• Verify that reasoning chains reach the answer from vignette facts alone
• Correct reasoning traces and write brief rationales

What they look for

• MD or DO degree with an active unrestricted US medical license
• Board certification or completed residency, with recent direct patient care
• Broad diagnostic and treatment experience across body systems
• Strong clinical reasoning and familiarity with evidence-based guidelines
• Strong written English at C1 level or above

Nice to have

• Background in medical annotation or quality assurance