NetflixHiring

Program Manager, Human Evaluations (Recommendations)

  • Remote, United States
  • Full-time
  • Lead
  • Posted 8 days ago
In one line

Program manager running human evaluation programs that judge how good recommendations are on a streaming homepage; works closely with product and machine learning teams.

About the role

Human evaluation work for recommendation quality: building rubrics and workflows, managing raters and vendors, and keeping delivery on schedule. The role pairs evaluation design with hands-on execution.

At a glance

Pay
Not stated in the posting
Remote scope
Remote, United States
Seniority
Lead
Employment
Full-time
Skills
Human evaluation, Rubrics, Vendor management, Success metrics, Personalization
Posted
21 Oct 2026
Last checked
27 Oct 2026

What you will do

  • Design evaluation frameworks and rubrics for relevance, repetition and diversity
  • Run evaluations end to end, from intake and scoping through delivery
  • Onboard and calibrate raters and manage vendor capacity
  • Translate recommendation strategy into evaluation designs and success metrics
  • Work with product, research, data science, UX and engineering teams

What they look for

  • Experience running human evaluation or data operations programs
  • Able to bring structure to unclear problems and keep projects on track
  • Comfort working with product managers, data scientists and ML engineers
  • Fluency in film and TV content and a feel for which titles fit together
  • Skill at defining milestones and steering cross-functional teams

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job wjhpsnyxsc
How to connect

Questions about this job

Is this a remote job, and where can I work from?

Yes. The posting lists Program Manager, Human Evaluations (Recommendations) as a remote role for candidates in the United States.

What does this job pay?

The posting does not state a salary, so there is no figure to quote.

What experience is needed?

It is a lead role. The posting asks for: experience running human evaluation or data operations programs; able to bring structure to unclear problems and keep projects on track; comfort working with product managers, data scientists and ML engineers. Skills it names include Human evaluation, Rubrics, Vendor management, Success metrics.

How do I apply with Keywordise AI?

Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.

More remote management jobs

All remote management jobs
NetflixRemote, United States
Apply with Keywordise AI