Applied AI Engineer
- Remote, United States
- Mid-level
- Posted 2 weeks ago
or apply from Claude / ChatGPT / Muse
Backend engineering role on a consumer credit insights team, owning prompts, evaluations and guardrails for AI chat features; Python and some Java.
About the role
Quality and safety of AI-powered consumer features are the focus, with evaluation tooling that analysts and QA engineers depend on and model changes shipped through A/B tests.
At a glance
- Pay
- Not stated in the posting
- Remote scope
- Remote, United States
- Seniority
- Mid-level
- Skills
- Python, Java, Spring Boot, SQL, Amazon Bedrock, AWS, Datadog, Tableau
- Posted
- 29 Oct 2026
- Last checked
- 13 Nov 2026
What you will do
- Own system prompts, tool descriptions and evaluation prompts for credit insights and the chat assistant
- Grow the evaluation framework, turning production failures into test cases and running regression suites
- Design and monitor guardrails for PII redaction, prompt injection and financial advice compliance
- Lead model upgrades by comparing quality, cost and latency, then shipping through A/B tests
- Build tools for conversation analysts and QA, such as transcript viewers, labeling workflows and dashboards
What they look for
- Degree in computer science or engineering with professional software engineering experience
- Production experience with LLM applications: prompt design, tool calling, structured outputs and streaming
- Experience building LLM evaluations, including test sets, regression suites and LLM-as-judge methods
- Working knowledge of Amazon Bedrock or similar, plus AWS S3, Lambda and DynamoDB
Nice to have
- Guardrail tooling, LLM security testing, RAG evaluation or fairness and bias work
Benefits
- Inclusive culture built on owning the work, serving customers and earning respect
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job pqchra4sjyQuestions about this job
Is this a remote job, and where can I work from?
Yes. The posting lists Applied AI Engineer as a remote role for candidates in the United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
It is a mid-level role. The posting asks for: degree in computer science or engineering with professional software engineering experience; production experience with LLM applications: prompt design, tool calling, structured outputs and streaming; experience building LLM evaluations, including test sets, regression suites and LLM-as-judge methods. Skills it names include Python, Java, Spring Boot, SQL.
How do I apply with Keywordise AI?
Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.
More remote IT and software jobs
BinanceJava Backend Engineer, Global Travel Rule- Remote, worldwide
- HHuzzleData Engineer
- Remote, Germany
- A global network infrastructure and technology providerSoftware Developer
- USD 110,000 to 130,000 per year
- Remote, United States
- A software company for distributors and enterprisesAI Product Developer
- CAD 80,000 to 100,000 per year
- Remote, Canada
OPENDataJobsData Scientist, Python and AWS- Remote, United States
SliceSoftware Developer, DevEx (Stateful Systems)- Remote, Canada