Lead Technology Product Manager, AI Quality & Evaluation
- Remote, United States
- Lead
- Posted 10 days ago
or apply from Claude / ChatGPT / Muse
Product role focused on building tools and workflows that evaluate and monitor AI features in clinical software; senior level.
About the role
Clinical AI needs ongoing checks, not a single pre-launch test, so clinicians can trust what they see. The job turns expert quality standards into usable product capabilities, tooling and reporting.
At a glance
- Pay
- Not stated in the posting
- Remote scope
- Remote, United States
- Seniority
- Lead
- Skills
- Product management, AI evaluation, Benchmarking, Metrics, Dashboards, Human-in-the-loop review
- Posted
- 19 Oct 2026
- Last checked
- 28 Oct 2026
What you will do
- Turn expert-defined quality standards and evaluation methods into requirements, workflows and roadmap priorities
- Drive discovery and delivery for evaluation tooling, automation, monitoring, evidence capture and reporting
- Work with clinical, data science, engineering, product, legal and compliance teams to run evaluation before and after launch
- Find ways to automate and scale evaluation while keeping expert oversight
- Define requirements for review workflows, issue triage, launch readiness and post-launch monitoring
What they look for
- 5 or more years in product management for healthcare, enterprise SaaS, data or platform products
- Strong discovery and execution skills, from requirements and roadmaps to experiments and metrics
- Able to turn complex clinical, technical or risk concepts into practical product requirements
- Experience working with engineering, data, clinical, compliance or operational stakeholders
- Clear communication about quality, trust, tradeoffs and evidence
Nice to have
- Background in AI-enabled products, healthcare technology, search or retrieval quality, or decision support
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job wttfumah7oQuestions about this job
Is this a remote job, and where can I work from?
Yes, it is listed as remote, aimed at candidates in the United States.
What does this job pay?
No pay range is stated in the posting.
What experience is needed?
It is a lead role. The posting asks for: 5 or more years in product management for healthcare, enterprise SaaS, data or platform products; strong discovery and execution skills, from requirements and roadmaps to experiments and metrics; able to turn complex clinical, technical or risk concepts into practical product requirements. Skills it names include Product management, AI evaluation, Benchmarking, Metrics.
How do I apply with Keywordise AI?
Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.
More remote management jobs
- CChainguardSenior Product Manager
- Remote, United States
- A safety technology companyProduct Manager
- USD 120,000 to 160,000 per year
- Remote, United States
- EEverCommerceEverHealth - Product Manager: RCM (Remote, US)
- Remote, United States
- AAgeroProduct Manager
- USD 79,852 to 107,800 per year
- Remote, United States
- MModashSenior Product Designer/Product Manager
- EUR 65,000 to 85,000 per year
- Remote, Europe
- OOneImagingOperations Manager, Member Services (Knowledge Management)
- Remote, worldwide