Remote job · Healthcare
Physician (MD/DO) Medical AI Evaluation
- Remote (Canada)
- A platform connecting specialists with AI projects
- Posted 9 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIAbout the role
Practicing physicians review clinical vignettes to test and improve medical AI systems. The work is project-based and part-time, aimed at raising the quality of diagnostic and treatment reasoning in these tools.
What you will do
- Assess EHR case vignettes that pair a question with a suggested answer and a misleading trap answer
- Rate benchmark items for accuracy, completeness, answerability and trap quality
- Verify that reasoning chains reach the answer using only the vignette facts, and correct traces
- Write brief rationales and take part in blind reads followed by physician adjudication
What they look for
- MD or DO degree with an active unrestricted US medical license
- Board certification or completed residency, plus recent direct patient care
- Broad diagnostic and treatment experience across multiple systems
- Strong clinical reasoning in differential diagnosis and next-step management
- Written English at C1 level or above
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote healthcare jobs
- Physician (MD/DO) Medical AI EvaluationA project based AI evaluation platform · Remote (US)
- Costa Rican Spanish Voice Recording ContributorA global AI training data provider · Remote (Costa Rica)
- Psychiatric Mental Health Nurse Practitioner (PMHNP)A telehealth mental health care provider · Remote (US)
- Family Nurse Practitioner or Physician AssistantA primary care provider · Remote (US)
- Pediatric Speech-Language Pathologist (Remote)An educational teletherapy service provider · Remote (US)
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with AI projects · Remote (India)
Explore more: remote jobs, the Keywordise Job Market Index, the blog.