An AI product companyHiring

Expert RAG Engineer

  • Remote, United States
  • Senior
  • Posted 11 days ago
In one line

Senior hands-on role owning retrieval-augmented generation pipelines for AI products, working with open-source LLMs across cloud, on-prem and air-gapped setups.

About the role

End-to-end ownership of RAG architecture, from document ingestion to cited answers, with authority over retrieval quality, latency and cost. The role sets standards for the AI department and guides other AI developers.

At a glance

Pay
Not stated in the posting
Remote scope
Remote, United States
Seniority
Senior
Skills
Python, RAG, Ollama, Qdrant, Apache Kafka, Kubernetes
Posted
5 Nov 2026
Last checked
14 Nov 2026

What you will do

  • Design and own full RAG architectures, from ingestion through grounded, cited answers
  • Build hybrid search, cross-encoder reranking, query rewriting and metadata filtering
  • Define chunking and indexing for XML/XSD, Office files, PDFs and scanned documents
  • Benchmark and fine-tune embedding models, and run vector databases at scale
  • Build retrieval and generation evaluation (recall@k, MRR, nDCG, faithfulness) into CI/CD
  • Cut hallucinations using grounding, citations, guardrails and confidence handling

What they look for

  • Hands-on serving and optimizing open-source LLMs with quantization and GPU/CUDA troubleshooting
  • Ability to turn client and product needs into retrieval plans with clear quality, latency and cost targets

Nice to have

  • Familiarity with GraphRAG, agentic retrieval or long-context versus retrieval trade-offs

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job 2yuso4twsl
How to connect

Questions about this job

Is this a remote job, and where can I work from?

Yes. The posting lists Expert RAG Engineer as a remote role for candidates in the United States.

What does this job pay?

The posting does not state a salary, so there is no figure to quote.

What experience is needed?

It is a senior role. The posting asks for: hands-on serving and optimizing open-source LLMs with quantization and GPU/CUDA troubleshooting; ability to turn client and product needs into retrieval plans with clear quality, latency and cost targets. Skills it names include Python, RAG, Ollama, Qdrant.

How do I apply with Keywordise AI?

Press the Apply with Keywordise AI button and add your CV. Keywordise tailors your CV and cover letter to this posting and sends the application for you, with a free 7-day trial and no card.

More remote engineering jobs

All remote engineering jobs
An AI product companyRemote, United States
Apply with Keywordise AI