Remote job · Healthcare
Physician (MD/DO), Medical AI Evaluation
- Remote (US)
- A platform connecting specialists with AI projects
- Posted 9 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIAbout the role
Practicing physicians review clinical EHR vignettes and judge the quality of medical AI benchmark items. Work is project-based and part-time, aimed at improving clinical AI tools.
What you will do
- Assess EHR vignettes paired with questions, answers and trap answers across body systems
- Score clinical reasoning quality, including vignette accuracy and answer correctness
- Check whether reasoning chains reach answers from vignette facts alone
- Write short rationales and correct reasoning traces
- Take part in blind reads followed by physician adjudication
What they look for
- MD or DO with an active, unrestricted US medical license
- Board certification or completed residency, plus recent direct patient care
- Broad diagnostic and treatment experience across multiple systems
- Strong clinical reasoning, including differential diagnosis and next steps
- Written English at C1 level or above
- US-based and open to part-time, non-permanent project work
Nice to have
- Experience with medical annotation or quality assurance
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote healthcare jobs
- Physician (MD/DO) for Medical AI EvaluationA platform connecting specialists with AI projects · Remote (South Africa)
- Contrast Media Clinical Sales SpecialistA global medical imaging and diagnostics company · Remote, worldwide
- Physician (MD/DO) - Medical AI EvaluationA platform connecting specialists with AI projects · Remote (Singapore)
- Family Nurse Practitioner or Physician AssistantA primary care provider · Remote (US)
- Physician (MD/DO) for Medical AI EvaluationA platform connecting specialists with AI projects · Remote (US)
- Bilingual Medical Patient CoordinatorA US-based diagnostic imaging healthcare practice · Remote (Argentina)
Explore more: remote jobs, the Keywordise Job Market Index, the blog.