FICOHiring

Applied AI Engineer

  • Remote, United States
  • Mid-level
  • Posted 2 weeks ago
In one line

Backend engineering role on a consumer credit insights team, owning prompts, evaluations and guardrails for AI chat features; Python and some Java.

About the role

Quality and safety of AI-powered consumer features are the focus, with evaluation tooling that analysts and QA engineers depend on and model changes shipped through A/B tests.

At a glance

Pay
Not stated in the posting
Remote scope
Remote, United States
Seniority
Mid-level
Skills
Python, Java, Spring Boot, SQL, Amazon Bedrock, AWS, Datadog, Tableau
Posted
29 Oct 2026
Last checked
13 Nov 2026

What you will do

  • Own system prompts, tool descriptions and evaluation prompts for credit insights and the chat assistant
  • Grow the evaluation framework, turning production failures into test cases and running regression suites
  • Design and monitor guardrails for PII redaction, prompt injection and financial advice compliance
  • Lead model upgrades by comparing quality, cost and latency, then shipping through A/B tests
  • Build tools for conversation analysts and QA, such as transcript viewers, labeling workflows and dashboards

What they look for

  • Degree in computer science or engineering with professional software engineering experience
  • Production experience with LLM applications: prompt design, tool calling, structured outputs and streaming
  • Experience building LLM evaluations, including test sets, regression suites and LLM-as-judge methods
  • Working knowledge of Amazon Bedrock or similar, plus AWS S3, Lambda and DynamoDB

Nice to have

  • Guardrail tooling, LLM security testing, RAG evaluation or fairness and bias work

Benefits

  • Inclusive culture built on owning the work, serving customers and earning respect

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job pqchra4sjy
How to connect

Questions about this job

Is this a remote job, and where can I work from?

Yes. The posting lists Applied AI Engineer as a remote role for candidates in the United States.

What does this job pay?

The posting does not state a salary, so there is no figure to quote.

What experience is needed?

It is a mid-level role. The posting asks for: degree in computer science or engineering with professional software engineering experience; production experience with LLM applications: prompt design, tool calling, structured outputs and streaming; experience building LLM evaluations, including test sets, regression suites and LLM-as-judge methods. Skills it names include Python, Java, Spring Boot, SQL.

How do I apply with Keywordise AI?

Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.

More remote IT and software jobs

All remote IT and software jobs
FICORemote, United States
Apply with Keywordise AI