Senior Software Engineer, ML Serving Platform
- San Francisco, CA
- Senior
- Posted 4 days ago
or apply from Claude / ChatGPT / Muse
Engineering role focused on building infrastructure that serves millions of machine learning predictions per second for search and logistics.
About the role
The team works on request routing and inference capabilities, aiming to help product teams deploy models independently while meeting strict latency and cost targets.
At a glance
- Pay
- Not stated in the posting
- Location
- San Francisco, CA
- Seniority
- Senior
- Skills
- Python, Go, Kubernetes, Distributed Systems
- Posted
- 12 Nov 2026
- Last checked
- 16 Nov 2026
What you will do
- Lead projects from initial problem definition through design, implementation, and rollout.
- Improve inference performance using production traces, load tests, and CPU/GPU profiling.
- Own production reliability through observability, on-call duties, and incident response.
- Evaluate and integrate open source tools to advance model serving capabilities.
What they look for
- Six or more years of experience designing and operating production distributed systems.
- Hands-on experience serving large neural models online with accountability for latency.
- Understanding of inference tradeoffs involving batching, caching, and resource utilization.
- Experience operating services on Kubernetes or comparable infrastructure.
Nice to have
- Experience with Triton Inference Server, PyTorch, or multi-GPU inference techniques.
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job yjdakio7zgQuestions about this job
Where is this job based?
The posting lists Senior Software Engineer, ML Serving Platform as a role based in San Francisco, CA, United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
It is a senior role. The posting asks for: six or more years of experience designing and operating production distributed systems; hands-on experience serving large neural models online with accountability for latency; understanding of inference tradeoffs involving batching, caching, and resource utilization. Skills it names include Python, Go, Kubernetes, Distributed Systems.
How do I apply with Keywordise AI?
Press the Apply with Keywordise AI button and add your CV. Keywordise tailors your CV and cover letter to this posting and sends the application for you, with a free 7-day trial and no card.
More IT and software jobs in San Francisco, CA
- WWorkatoSenior Software Engineer
- San Francisco, CA
- WWaymoSummer Intern, Software Engineer
- San Francisco, CA
- LSLila SciencesCo-op, Software, Applied AI Platform Engineer
- San Francisco, CA
LogicMonitorAI Operations & Workforce Transformation Director- San Francisco, CA
- OOktaSenior Software Engineer, Core Infrastructure
- San Francisco, CA
- A global on-demand logistics and delivery platformMachine Learning Intern (PhD)
- San Francisco, CA