Remote job · Healthcare
Physician (MD/DO) for Medical AI Evaluation
In one line: Physician (MD/DO) for Medical AI Evaluation is a remote role in the United States at a platform connecting specialists with AI projects.
- Remote (US)
- A platform connecting specialists with AI projects
- Posted 9 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIPrefer your AI assistant? Apply from Claude or ChatGPT
Add Keywordise to your assistant as a connector, sign in, then send it this prompt. It applies for you through Keywordise.
https://keywordise.com/mcpApply to Keywordise job iytr5o5pwmAbout the role
Practicing physicians review clinical EHR vignettes to test and improve medical AI systems. The work is project-based and part-time, focused mainly on general and internal medicine.
At a glance
- PayNot stated in the posting
- Remote scopeRemote, United States
- Posted9 Oct 2026
- Last checked20 Oct 2026
What you will do
- Assess vignettes that pair a question with a proposed answer and a misleading trap answer across many body systems
- Rate benchmark items for accuracy, completeness, answer correctness, gradeability and trap quality
- Verify that reasoning traces reach the answer using only vignette facts, and write brief rationales
- Take part in three independent blind reads followed by physician adjudication
What they look for
- Board certification or completed residency, with recent direct patient care, attending level preferred
- Broad diagnostic and treatment experience across systems, such as internal, family, emergency or hospital medicine
- Solid clinical reasoning in differential diagnosis, next-step management and evidence-based guidelines
- Written English at C1 level or above
Questions about this job
Can I do this job remotely, and from which countries?
Yes. The posting lists Physician (MD/DO) for Medical AI Evaluation as a remote role for candidates in the United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
The posting asks for: board certification or completed residency, with recent direct patient care, attending level preferred; broad diagnostic and treatment experience across systems, such as internal, family, emergency or hospital medicine; solid clinical reasoning in differential diagnosis, next-step management and evidence-based guidelines.
How do I apply with Keywordise AI?
Press the Apply with Keywordise AI button and add your CV. Keywordise tailors your CV and cover letter to this posting and sends the application for you, with a free 7-day trial and no card.
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote healthcare jobs
- Physician (MD/DO) for Medical AI EvaluationA platform connecting specialists with AI projects · Remote (US)
- Physician - AI Clinical ReviewerA platform connecting specialists with AI projects · Remote (US)
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with AI projects · Remote (Canada)
- Tier 1 Help Desk Technician (Pacific Time Zone Shift)A dental-focused managed IT services provider · Remote, worldwide
- Physician (MD/DO) Medical AI EvaluationA platform for project-based AI specialist work · Remote (US)
- Family Nurse Practitioner or Physician AssistantA primary care provider · Remote (US)
Browse more: Remote healthcare jobs · Remote jobs in the United States · Remote healthcare jobs in the United States
Explore more: remote jobs, the Keywordise Job Market Index, the blog.