Remote job · Healthcare

Physician (MD/DO), Medical AI Evaluation

Remote (US)
A platform connecting experts with AI projects
Posted 9 Oct 2026

Apply with Keywordise AI

Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.

Apply with Keywordise AI

About the role

Practising US physicians review clinical vignettes to test and improve medical AI systems. Work is project-based and part-time, with tasks assessed per accepted submission.

What you will do

Assess EHR vignettes with questions, answers and trap answers across body systems
Rate benchmark items for accuracy, completeness, answerability and trap quality
Verify that reasoning chains reach answers from vignette facts alone
Correct reasoning traces and write brief rationales
Take part in three blind reads followed by physician adjudication

What they look for

MD or DO degree with an active, unrestricted US medical licence
Board certification or completed residency plus recent direct patient care
Broad multi-system diagnostic and treatment experience
Strong clinical reasoning and knowledge of evidence-based guidelines
Written English at C1 level or above

Nice to have

Experience with medical AI evaluation
Clinical content or exam question review background
Medical annotation or quality assurance work

How it works

1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
3We apply for youYour application goes to the employer and you follow it in your dashboard.

More remote healthcare jobs

All remote healthcare jobs

Explore more: remote jobs, the Keywordise Job Market Index, the blog.