FICOHiring

AI Operations Analyst

  • USD 105,000 to 165,000 per year
  • Remote, United States
  • Mid-level
  • Posted 6 days ago
In one line

Quality review role on a consumer credit product, checking AI chat answers for errors and unsafe content and turning findings into fixes.

About the role

Someone with a QA or support background who can apply a rubric consistently and write clear failure reports. The work sits between product, applied AI and compliance.

At a glance

Pay
USD 105,000 to 165,000 per year
Remote scope
Remote, United States
Seniority
Mid-level
Skills
SQL, Tableau, Agile, Scrum, Data labeling, Rubric design, Python, Jupyter
Posted
29 Oct 2026
Last checked
3 Nov 2026

What you will do

  • Review sampled AI chat logs and credit insight summaries, flagging wrong, unsupported or unsafe replies
  • Maintain the golden regression dataset, adding labeled production misses and keeping labels consistent
  • Publish a weekly quality report on intent coverage, refusal rates, safety flags and top failure modes
  • Escalate risky content to legal, compliance and trust and safety with severity ratings, then follow up
  • Use SQL and dashboards to see what members ask and where quality drifts

What they look for

  • Degree in a related field or equal experience, plus a quality, analytical or operations background reviewing customer conversations
  • Solid SQL and comfort reading and building dashboards in a BI tool such as Tableau
  • Careful judgment and detail, applying a written rubric the same way each time
  • Clear writing for failure descriptions and short summaries aimed at leadership
  • Comfort handling sensitive consumer data in a regulated setting
  • Experience in Agile or Scrum teams

Nice to have

  • Background in consumer finance, credit or banking, with knowledge of FCRA, ECOA and UDAAP, credit reports, conversational AI, data labeling

Benefits

  • Base pay range of $105,000 to $165,000 plus benefits and rewards programs

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job dsarl3u3pk
How to connect

Questions about this job

Can I do this job remotely, and from which countries?

Yes, it is listed as remote, aimed at candidates in the United States.

What does this job pay?

The posting states USD 105,000 to 165,000 per year.

What experience is needed?

It is a mid-level role. The posting asks for: degree in a related field or equal experience, plus a quality, analytical or operations background reviewing customer conversations; solid SQL and comfort reading and building dashboards in a BI tool such as Tableau; careful judgment and detail, applying a written rubric the same way each time. Skills it names include SQL, Tableau, Agile, Scrum.

How do I apply with Keywordise AI?

Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.

More remote business and finance jobs

All remote business and finance jobs
FICORemote, United States
Apply with Keywordise AI