Remote job · Healthcare
Physician (MD/DO) - Medical AI Evaluation
In one line: Physician (MD/DO) - Medical AI Evaluation is a remote role in the United States at a platform for project based AI work.
- Remote (US)
- A platform for project based AI work
- Posted 9 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIPrefer your AI assistant? Apply from Claude or ChatGPT
Add Keywordise to your assistant as a connector, sign in, then send it this prompt. It applies for you through Keywordise.
https://keywordise.com/mcpApply to Keywordise job z4ou77sx76About the role
Practicing physicians review clinical vignettes and judge the reasoning quality of a medical AI benchmark. Work is part time and tied to individual projects.
At a glance
- PayNot stated in the posting
- Remote scopeRemote, United States
- Posted9 Oct 2026
- Last checked20 Oct 2026
What you will do
- Assess clinical vignettes with questions, proposed answers and trap answers
- Score reasoning quality, including vignette accuracy, completeness and answer gradeability
- Check whether reasoning chains follow from vignette facts and correct traces
- Write short rationales for judgments
- Complete three independent blind reads before physician adjudication
What they look for
- MD or DO degree with an active unrestricted US medical license
- Board certification or completed residency plus recent direct patient care
- Broad multi system diagnostic and treatment experience
- Strong clinical reasoning across differential diagnosis and next step management
- Written English at C1 level or above
Nice to have
- Background in medical annotation or quality assurance
Questions about this job
Is this a remote job, and where can I work from?
Yes. The posting lists Physician (MD/DO) - Medical AI Evaluation as a remote role for candidates in the United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
The posting asks for: MD or DO degree with an active unrestricted US medical license; board certification or completed residency plus recent direct patient care; broad multi system diagnostic and treatment experience.
How do I apply with Keywordise AI?
Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote healthcare jobs
- Physician (MD/DO) - Medical AI EvaluationA platform connecting specialists with AI projects · Remote (US)
- Physician (MD/DO) - Medical AI EvaluationA platform for project-based AI work · Remote (US)
- Psychiatric Mental Health Nurse Practitioner (Telehealth)A telehealth mental health services provider · Remote (US)
- Physician (MD/DO) - Medical AI EvaluationA platform connecting specialists with AI projects · Remote (US)
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with project based AI work · Remote (Canada)
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with AI projects · Remote (US)
Browse more: Remote healthcare jobs · Remote jobs in the United States · Remote healthcare jobs in the United States
Explore more: remote jobs, the Keywordise Job Market Index, the blog.