AI Inference Platform Engineer
- Chicago, IL
- Senior
- Posted 6 weeks ago
or apply from Claude / ChatGPT / Muse
Platform engineering role serving large language, vision and embedding models on GPUs across a trading firm, from first evaluation to production.
About the role
Serving AI models reliably at firm scale is the problem: runtimes, distributed systems and GPU capacity have to line up so teams can trust the output. Success means latency, throughput, utilisation and cost all keep improving as new models land.
At a glance
- Pay
- Not stated in the posting
- Location
- Chicago, IL
- Seniority
- Senior
- Skills
- LLM inference, NVIDIA GPUs, KV cache, Distributed systems, Observability
- Posted
- 29 Sep 2026
- Last checked
- 16 Nov 2026
What you will do
- Tune LLM inference on current NVIDIA GPU generations and the runtimes that drive them
- Build profiling and observability that trace bottlenecks from single GPU kernels up to multi-node serving
- Design KV cache and distributed inference setups: caching, routing, memory tiering, prefill and decode
- Run day-0 onboarding of new models, choosing runtime, precision, sharding, batching and cache policy
What they look for
- Hands-on experience serving LLMs on NVIDIA GPUs
- Familiarity with Hopper, Blackwell and successor architectures, HBM, Tensor Cores and NVLink or NVSwitch
- A grasp of the compute and memory limits that shape inference performance
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job vteaph6fwjQuestions about this job
Where is this job based?
The posting lists AI Inference Platform Engineer as a role based in Chicago, IL, United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
It is a senior role. The posting asks for: hands-on experience serving LLMs on NVIDIA GPUs; familiarity with Hopper, Blackwell and successor architectures, HBM, Tensor Cores and NVLink or NVSwitch; a grasp of the compute and memory limits that shape inference performance. Skills it names include LLM inference, NVIDIA GPUs, KV cache, Distributed systems.
How do I apply with Keywordise AI?
Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.
More IT and software jobs in Chicago, IL
- RRobinhoodRegistration and Onboarding Specialist
- Chicago, IL
- An enterprise cloud software providerPlatform Engineer Sr. - AWS / Airflow
- Chicago, IL
- A national security services providerSecurity Shift Supervisor - Loop
- Chicago, IL
- OOptimalSenior Software Engineer
- USD 200,000 to 250,000 per year
- Chicago, IL
- TTempusSenior Technical Product Manager, Data Platform
- Chicago, IL
- CCroweForward Deployed AI Architect
- Chicago, IL