A large food delivery platform operating multiple brands globallyHiring

Senior Software Engineer, ML Serving Platform

  • San Francisco, CA
  • Senior
  • Posted 4 days ago
In one line

Engineering role focused on building infrastructure that serves millions of machine learning predictions per second for search and logistics.

About the role

The team works on request routing and inference capabilities, aiming to help product teams deploy models independently while meeting strict latency and cost targets.

At a glance

Pay
Not stated in the posting
Location
San Francisco, CA
Seniority
Senior
Skills
Python, Go, Kubernetes, Distributed Systems
Posted
12 Nov 2026
Last checked
16 Nov 2026

What you will do

  • Lead projects from initial problem definition through design, implementation, and rollout.
  • Improve inference performance using production traces, load tests, and CPU/GPU profiling.
  • Own production reliability through observability, on-call duties, and incident response.
  • Evaluate and integrate open source tools to advance model serving capabilities.

What they look for

  • Six or more years of experience designing and operating production distributed systems.
  • Hands-on experience serving large neural models online with accountability for latency.
  • Understanding of inference tradeoffs involving batching, caching, and resource utilization.
  • Experience operating services on Kubernetes or comparable infrastructure.

Nice to have

  • Experience with Triton Inference Server, PyTorch, or multi-GPU inference techniques.

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job yjdakio7zg
How to connect

Questions about this job

Where is this job based?

The posting lists Senior Software Engineer, ML Serving Platform as a role based in San Francisco, CA, United States.

What does this job pay?

The posting does not state a salary, so there is no figure to quote.

What experience is needed?

It is a senior role. The posting asks for: six or more years of experience designing and operating production distributed systems; hands-on experience serving large neural models online with accountability for latency; understanding of inference tradeoffs involving batching, caching, and resource utilization. Skills it names include Python, Go, Kubernetes, Distributed Systems.

How do I apply with Keywordise AI?

Press the Apply with Keywordise AI button and add your CV. Keywordise tailors your CV and cover letter to this posting and sends the application for you, with a free 7-day trial and no card.

More IT and software jobs in San Francisco, CA

All IT and software jobs in San Francisco, CA
A large food delivery platform operating multiple brands globallySan Francisco, CA
Apply with Keywordise AI