Remote job · Healthcare
Physician (MD/DO) - Medical AI Evaluation
In one line: Physician (MD/DO) - Medical AI Evaluation is a remote role in Canada at a platform connecting specialists with AI projects.
- Remote (Canada)
- A platform connecting specialists with AI projects
- Posted 9 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIPrefer your AI assistant? Apply from Claude or ChatGPT
Add Keywordise to your assistant as a connector, sign in, then send it this prompt. It applies for you through Keywordise.
https://keywordise.com/mcpApply to Keywordise job jqbmphefqeAbout the role
Practicing physicians review clinical vignettes and reasoning to help improve medical AI systems. Work is project-based and part-time, done in blind reads with physician adjudication.
At a glance
- PayNot stated in the posting
- Remote scopeRemote, Canada
- Posted9 Oct 2026
- Last checked20 Oct 2026
What you will do
- Assess EHR-based clinical vignettes paired with questions, answers and misleading trap answers
- Rate benchmark items for accuracy, completeness, answer correctness and trap quality
- Verify that reasoning chains reach conclusions from vignette facts alone and correct them
- Write brief rationales and take part in independent blind reads followed by adjudication
What they look for
- MD or DO degree plus an active unrestricted US medical license
- Board certification or completed residency with recent direct patient care
- Broad diagnostic and treatment experience across multiple systems
- Strong clinical reasoning in differential diagnosis and evidence-based management
- Written English at C1 level or above
Nice to have
- Prior work in medical AI evaluation, clinical content review, exam question review or medical annotation and QA
Questions about this job
Is this job fully remote, and from where?
Yes, it is listed as remote, aimed at candidates in Canada.
What does this job pay?
No pay range is stated in the posting.
What experience is needed?
The posting asks for: MD or DO degree plus an active unrestricted US medical license; board certification or completed residency with recent direct patient care; broad diagnostic and treatment experience across multiple systems.
How do I apply with Keywordise AI?
Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote healthcare jobs
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with AI project work · Remote (Argentina)
- Senior Medical Science Liaison, NeurologyA clinical-stage biotech company · Remote, worldwide
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with AI projects · Remote (US)
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with AI projects · Remote (US)
- Psychiatric Mental Health Nurse Practitioner (Telehealth)A telehealth mental health services provider · Remote (US)
- Family Nurse Practitioner or Physician AssistantA primary care provider · Remote (US)
Browse more: Remote healthcare jobs · Remote jobs in Canada · Remote healthcare jobs in Canada
Explore more: remote jobs, the Keywordise Job Market Index, the blog.