Physician (MD/DO) - Medical AI Evaluation
- Remote, United States
- Part-time
- Senior
- Posted 5 weeks ago
or apply from Claude / ChatGPT / Muse
Part-time, project-based work for practising US doctors who score clinical vignettes used to test medical AI. Remote.
About the role
The task is to judge whether an AI's clinical reasoning holds up on realistic cases, from diagnosis through next steps. Three blind reads happen before a physician adjudicates.
At a glance
- Pay
- Not stated in the posting
- Remote scope
- Remote, United States
- Seniority
- Senior
- Employment
- Part-time
- Skills
- Clinical reasoning, Differential diagnosis, Evidence-based guidelines, Medical AI evaluation
- Posted
- 12 Oct 2026
- Last checked
- 15 Nov 2026
What you will do
- Score vignettes that pair a patient case with a question, an answer and a trap answer
- Judge how accurate and complete each case is and whether it gives the answer away
- Check that the reasoning chain follows from the case facts, then fix traces and write short rationales
- Cover diagnosis and treatment across body systems, from heart and lungs to skin and muscles
- Work through three independent blind reads before adjudication
What they look for
- MD or DO with an active, unrestricted US licence, checked against the issuing board
- Board certification or finished residency, plus recent hands-on patient care, ideally at attending level
- Wide diagnostic and treatment experience across systems, such as internal, family, emergency or hospital medicine
- Solid clinical reasoning: differentials, next steps and evidence-based guidelines
- Written English at C1 or above
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job b6kzpurl4gQuestions about this job
Is this job fully remote, and from where?
Yes. The posting lists Physician (MD/DO) - Medical AI Evaluation as a remote role for candidates in the United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
It is a senior role. The posting asks for: MD or DO with an active, unrestricted US licence, checked against the issuing board; board certification or finished residency, plus recent hands-on patient care, ideally at attending level; wide diagnostic and treatment experience across systems, such as internal, family, emergency or hospital medicine. Skills it names include Clinical reasoning, Differential diagnosis, Evidence-based guidelines, Medical AI evaluation.
How do I apply with Keywordise AI?
Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.
More remote healthcare jobs
- A platform connecting specialists with AI projectsPhysician Reviewer (MD/DO), Medical AI Evaluation
- Remote, Israel
- A platform connecting specialists with AI projectsPhysician (MD/DO) Medical AI Evaluation
- Remote, Latin America
- A platform connecting specialists with AI projectsPhysician Reviewer (MD/DO), Medical AI Evaluation
- Remote, Poland
- A platform connecting specialists with AI projectsPhysician (MD/DO) for Medical AI Evaluation
- Remote, United States
- A platform for project-based AI workPhysician (MD/DO) - Medical AI Evaluation
- Remote, Middle East and North Africa
- A platform for project-based AI workPhysician (MD/DO)
- Remote, Singapore