Remote job · Healthcare
Physician (MD/DO) for Medical AI Evaluation
In one line: Physician (MD/DO) for Medical AI Evaluation is a remote role in the United States at a platform connecting specialists with AI projects.
- Remote (US)
- A platform connecting specialists with AI projects
- Posted 9 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIPrefer your AI assistant? Apply from Claude or ChatGPT
Add Keywordise to your assistant as a connector, sign in, then send it this prompt. It applies for you through Keywordise.
https://keywordise.com/mcpApply to Keywordise job myvgexqjgxAbout the role
Practicing physicians review clinical vignettes and benchmark items to assess the quality of medical AI reasoning, working on a part-time project basis.
At a glance
- PayNot stated in the posting
- Remote scopeRemote, United States
- Posted9 Oct 2026
- Last checked20 Oct 2026
What you will do
- Assess clinical vignettes with a question, a proposed answer and a trap answer
- Score reasoning quality, including vignette accuracy and answer correctness
- Verify that reasoning chains reach the answer using only vignette facts
- Correct reasoning traces and write brief rationales
- Complete three independent blind reads before physician adjudication
What they look for
- MD or DO degree with an active unrestricted US medical license
- Board certification or completed residency plus recent direct patient care
- Broad diagnostic and treatment experience across body systems
- Strong clinical reasoning and knowledge of evidence-based guidelines
- Written English at C1 level or above
Nice to have
- Experience with medical AI evaluation, exam question review or clinical annotation and QA
Questions about this job
Is this job fully remote, and from where?
The posting lists it as remote for people in the United States.
What does this job pay?
No pay range is stated in the posting.
What experience is needed?
The posting asks for: MD or DO degree with an active unrestricted US medical license; board certification or completed residency plus recent direct patient care; broad diagnostic and treatment experience across body systems.
How do I apply with Keywordise AI?
Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote healthcare jobs
- Bilingual Medical Patient CoordinatorA US-based diagnostic imaging healthcare practice · Remote (Argentina)
- Pediatric Speech-Language PathologistAn educational teletherapy service provider · Remote (US)
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with AI projects · Remote (US)
- Primary Care Nurse Practitioner or Physician AssistantA primary care provider · Remote (US)
- Physician (MD/DO) Medical AI EvaluationA platform connecting specialists with AI projects · Remote (Poland)
- Clinical Solutions Leader, Ambulatory Surgery CentersA global medical technology manufacturer · Remote, worldwide
Browse more: Remote healthcare jobs · Remote jobs in the United States · Remote healthcare jobs in the United States
Explore more: remote jobs, the Keywordise Job Market Index, the blog.