AI Operations Analyst
- USD 105,000 to 165,000 per year
- Remote, United States
- Mid-level
- Posted 6 days ago
or apply from Claude / ChatGPT / Muse
Quality review role on a consumer credit product, checking AI chat answers for errors and unsafe content and turning findings into fixes.
About the role
Someone with a QA or support background who can apply a rubric consistently and write clear failure reports. The work sits between product, applied AI and compliance.
At a glance
- Pay
- USD 105,000 to 165,000 per year
- Remote scope
- Remote, United States
- Seniority
- Mid-level
- Skills
- SQL, Tableau, Agile, Scrum, Data labeling, Rubric design, Python, Jupyter
- Posted
- 29 Oct 2026
- Last checked
- 3 Nov 2026
What you will do
- Review sampled AI chat logs and credit insight summaries, flagging wrong, unsupported or unsafe replies
- Maintain the golden regression dataset, adding labeled production misses and keeping labels consistent
- Publish a weekly quality report on intent coverage, refusal rates, safety flags and top failure modes
- Escalate risky content to legal, compliance and trust and safety with severity ratings, then follow up
- Use SQL and dashboards to see what members ask and where quality drifts
What they look for
- Degree in a related field or equal experience, plus a quality, analytical or operations background reviewing customer conversations
- Solid SQL and comfort reading and building dashboards in a BI tool such as Tableau
- Careful judgment and detail, applying a written rubric the same way each time
- Clear writing for failure descriptions and short summaries aimed at leadership
- Comfort handling sensitive consumer data in a regulated setting
- Experience in Agile or Scrum teams
Nice to have
- Background in consumer finance, credit or banking, with knowledge of FCRA, ECOA and UDAAP, credit reports, conversational AI, data labeling
Benefits
- Base pay range of $105,000 to $165,000 plus benefits and rewards programs
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job dsarl3u3pkQuestions about this job
Can I do this job remotely, and from which countries?
Yes, it is listed as remote, aimed at candidates in the United States.
What does this job pay?
The posting states USD 105,000 to 165,000 per year.
What experience is needed?
It is a mid-level role. The posting asks for: degree in a related field or equal experience, plus a quality, analytical or operations background reviewing customer conversations; solid SQL and comfort reading and building dashboards in a BI tool such as Tableau; careful judgment and detail, applying a written rubric the same way each time. Skills it names include SQL, Tableau, Agile, Scrum.
How do I apply with Keywordise AI?
Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.
More remote business and finance jobs
- MSMotorola Solutions, Inc.Business Analyst, Oracle CPQ
- Remote, United States
- USUSAAQuantitative Risk Analyst I
- Remote, United States
- CCComcast (CC) of Willow GroveAnalyst, Reporting & Analytics
- Remote, United States
- RDRHI DVA Renal Healthcare, IncAnalyst, Business (ROPS)
- Remote, United States
- A sports betting and online gaming companySenior Gaming Analyst
- USD 92,000 to 120,750 per year
- Remote, United States
- CCoinbaseSenior Identity Risk and Scam Analyst
- Remote, United States