A diversified trading firmHiring

AI Inference Platform Engineer

  • Chicago, IL
  • Senior
  • Posted 6 weeks ago
In one line

Platform engineering role serving large language, vision and embedding models on GPUs across a trading firm, from first evaluation to production.

About the role

Serving AI models reliably at firm scale is the problem: runtimes, distributed systems and GPU capacity have to line up so teams can trust the output. Success means latency, throughput, utilisation and cost all keep improving as new models land.

At a glance

Pay
Not stated in the posting
Location
Chicago, IL
Seniority
Senior
Skills
LLM inference, NVIDIA GPUs, KV cache, Distributed systems, Observability
Posted
29 Sep 2026
Last checked
16 Nov 2026

What you will do

  • Tune LLM inference on current NVIDIA GPU generations and the runtimes that drive them
  • Build profiling and observability that trace bottlenecks from single GPU kernels up to multi-node serving
  • Design KV cache and distributed inference setups: caching, routing, memory tiering, prefill and decode
  • Run day-0 onboarding of new models, choosing runtime, precision, sharding, batching and cache policy

What they look for

  • Hands-on experience serving LLMs on NVIDIA GPUs
  • Familiarity with Hopper, Blackwell and successor architectures, HBM, Tensor Cores and NVLink or NVSwitch
  • A grasp of the compute and memory limits that shape inference performance

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job vteaph6fwj
How to connect

Questions about this job

Where is this job based?

The posting lists AI Inference Platform Engineer as a role based in Chicago, IL, United States.

What does this job pay?

The posting does not state a salary, so there is no figure to quote.

What experience is needed?

It is a senior role. The posting asks for: hands-on experience serving LLMs on NVIDIA GPUs; familiarity with Hopper, Blackwell and successor architectures, HBM, Tensor Cores and NVLink or NVSwitch; a grasp of the compute and memory limits that shape inference performance. Skills it names include LLM inference, NVIDIA GPUs, KV cache, Distributed systems.

How do I apply with Keywordise AI?

Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.

More IT and software jobs in Chicago, IL

All IT and software jobs in Chicago, IL
A diversified trading firmChicago, IL
Apply with Keywordise AI