Remote job · Healthcare
Physician (MD/DO) - Medical AI Evaluation
In one line: Physician (MD/DO) - Medical AI Evaluation is a remote role in Canada at a platform connecting specialists with AI projects.
- Remote (Canada)
- A platform connecting specialists with AI projects
- Posted 9 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIPrefer your AI assistant? Apply from Claude or ChatGPT
Add Keywordise to your assistant as a connector, sign in, then send it this prompt. It applies for you through Keywordise.
https://keywordise.com/mcpApply to Keywordise job ua4gyldnijAbout the role
Practicing physicians review clinical EHR vignettes and benchmark items to assess the quality of medical AI reasoning and answers.
At a glance
- PayNot stated in the posting
- Remote scopeRemote, Canada
- Posted9 Oct 2026
- Last checked20 Oct 2026
What you will do
- Evaluate clinical vignettes paired with questions, proposed answers and trap answers across body systems
- Score benchmark items for vignette accuracy, answer correctness, gradeability and trap quality
- Check whether reasoning chains reach answers from vignette facts alone and write short rationales
What they look for
- MD or DO with an active unrestricted US medical license verified by the issuing board
- Board certification or completed residency plus recent direct patient care, attending level preferred
- Broad multi-system diagnostic and treatment experience in internal, family, emergency or hospital medicine
- Strong clinical reasoning in differential diagnosis, next-step management and evidence-based guidelines
- Written English at C1 level or above
Questions about this job
Is this a remote job, and where can I work from?
Yes, it is listed as remote, aimed at candidates in Canada.
What does this job pay?
No pay range is stated in the posting.
What experience is needed?
The posting asks for: MD or DO with an active unrestricted US medical license verified by the issuing board; board certification or completed residency plus recent direct patient care, attending level preferred; broad multi-system diagnostic and treatment experience in internal, family, emergency or hospital medicine.
How do I apply with Keywordise AI?
Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote healthcare jobs
- Physician (MD/DO), Medical AI EvaluationA platform connecting specialists with AI projects · Remote (Canada)
- Psychiatric Mental Health Nurse Practitioner (Telehealth)A telehealth mental health services provider · Remote (US)
- Family Medicine PhysicianA primary care provider · Remote (US)
- Psychiatric Mental Health Nurse Practitioner, TelehealthA telehealth mental health services provider · Remote (US)
- Nurse Practitioner or Physician Assistant, Primary CareA national primary care provider · Remote (US)
- Senior Patient Recruitment LeadA global clinical research organisation · Remote (UK)
Browse more: Remote healthcare jobs · Remote jobs in Canada · Remote healthcare jobs in Canada
Explore more: remote jobs, the Keywordise Job Market Index, the blog.