A company running AI evaluation projectsHiring

Physician Clinical Case Reviewer for Medical AI

  • Remote, United States
  • Senior
  • Posted 4 weeks ago
In one line

Part-time, project-based work for practising US doctors who score clinical vignettes used to test medical AI. Remote, paid per accepted task.

About the role

Clinical vignette review sits at the centre of this work: judging whether each case is accurate, complete and gradeable, and whether its reasoning holds up. Three blind reads happen before a physician adjudicates.

At a glance

Pay
Not stated in the posting
Remote scope
Remote, United States
Seniority
Senior
Skills
Clinical reasoning, Differential diagnosis, Evidence-based guidelines, Medical AI evaluation, Medical annotation, QA
Posted
19 Oct 2026
Last checked
9 Nov 2026

What you will do

  • Score clinical vignettes for accuracy and completeness, and check whether the case gives the answer away
  • Judge answer correctness and gradeability, plus the quality of the distractor trap answer
  • Trace whether the reasoning chain reaches the answer from the facts alone, and write short rationales
  • Take part in three independent blind reads, then physician adjudication

What they look for

  • MD or DO with an active, unrestricted US medical licence, checked with the issuing board
  • Board certification or completed residency, plus recent direct patient care, attending level preferred
  • Broad diagnostic and treatment experience across systems, in internal, family, emergency or hospital medicine
  • Solid clinical reasoning: differentials, next steps, evidence-based guidelines
  • Written English at C1 or above

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job 75mpgbhxry
How to connect

Questions about this job

Can I do this job remotely, and from which countries?

Yes. The posting lists Physician Clinical Case Reviewer for Medical AI as a remote role for candidates in the United States.

What does this job pay?

No pay range is stated in the posting.

What experience is needed?

It is a senior role. The posting asks for: MD or DO with an active, unrestricted US medical licence, checked with the issuing board; board certification or completed residency, plus recent direct patient care, attending level preferred; broad diagnostic and treatment experience across systems, in internal, family, emergency or hospital medicine. Skills it names include Clinical reasoning, Differential diagnosis, Evidence-based guidelines, Medical AI evaluation.

How do I apply with Keywordise AI?

Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.

More remote healthcare jobs

All remote healthcare jobs
A company running AI evaluation projectsRemote, United States
Apply with Keywordise AI