Senior AI Product Manager, Evals & Annotations
- Remote, United States
- Lead
- Posted 9 days ago
or apply from Claude / ChatGPT / Muse
Technical product manager owning the evaluation lifecycle for AI systems, from creation to human review and iteration.
Senior AI Product Manager, Evals & Annotations is a lead remote role in United States at Arize AI. Pay: not stated in the posting. Posted 10 Nov 2026. Key requirements: strong product and UX opinions with ability to shape experiences; comfortable working through interaction design and technical tradeoffs; experience with AI evaluation systems or similar technical products.
About the role
We're looking for a product-minded PM with strong technical skills to shape the future of AI evaluations.
At a glance
- Pay
- Not stated in the posting
- Remote scope
- Remote, United States
- Seniority
- Lead
- Posted
- 10 Nov 2026
- Last checked
- 17 Nov 2026
What you will do
- Own the Evals & Annotations product area end-to-end
- Set product strategy and roadmap balancing customer needs and platform investments
- Develop evaluation workflows and partner with Design for intuitive experiences
What they look for
- Strong product and UX opinions with ability to shape experiences
- Comfortable working through interaction design and technical tradeoffs
- Experience with AI evaluation systems or similar technical products
- Ability to independently explore workflows and build prototypes
- Customer-focused with experience gathering feedback and validating product direction
Nice to have
- Experience with AI development tools or platforms
- Familiarity with Dynatrace or similar observability solutions
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job iu4e2jybdfQuestions about this job
Is this a remote job, and where can I work from?
The posting lists it as remote and names United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
It is a lead role. The posting asks for: strong product and UX opinions with ability to shape experiences; comfortable working through interaction design and technical tradeoffs; experience with AI evaluation systems or similar technical products.
How do I apply with Keywordise AI?
Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.
More remote management jobs
- TTTurner TownsendSenior Construction Project Manager, Fire Station Projects
- Remote, United States
IQVIAClinical Project Manager (Early Clinical Development, Home-Based)- Remote, United States
- TTwinStreamGRC Officer
- GBP 40,000 to 55,000 per year
- Remote, worldwide
- SSureifySenior Program Manager, Client Delivery
- Remote, United States
- CMCentene Management Company LLCChief Operating Officer, Illinois Health Practice Alliance
- USD 207,000 to 392,100 per year
- Remote, United States
- CCareSourceProduct Manager, Data Migration
- Remote, worldwide