An AI safety and systems companyHiring

Staff + Sr. Software Engineer, Cloud Inference

  • San Francisco, CA
  • Senior
  • Posted 7 weeks ago
In one line

Senior backend role scaling LLM inference across major cloud providers, focusing on reliability, cost efficiency, and cross-platform abstraction.

About the role

The work centers on managing the complexity of serving large language models across different cloud environments. Engineers in this role drive revenue streams by optimizing compute usage and ensuring stable delivery to millions of users.

At a glance

Pay
Not stated in the posting
Location
San Francisco, CA
Work authorisation
The posting states that visa sponsorship is available.
Seniority
Senior
Skills
Distributed Systems, AWS, GCP, Azure, Kubernetes, CI/CD
Posted
28 Sep 2026
Last checked
14 Nov 2026

What you will do

  • Design and own backend services for serving models across multiple cloud providers.
  • Work with internal and external partners to stand up serving stacks on new platforms.
  • Build CI/CD automation for deploying model versions without regressions.
  • Create abstractions to manage cost-effective inference across providers.
  • Analyze observability data to fix performance bottlenecks and cost issues.

What they look for

  • Significant experience with high-performance distributed systems.
  • Experience building or operating services on AWS, GCP, or Azure.

Nice to have

  • Curiosity about LLM serving, though prior ML experience is not required.

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job jjs3mxc2vd
How to connect

Questions about this job

Where is this job based?

The posting lists Staff + Sr. Software Engineer, Cloud Inference as a role based in San Francisco, CA, United States.

Does this job sponsor a work visa?

The posting states that visa sponsorship is available.

What does this job pay?

The posting does not state a salary, so there is no figure to quote.

What experience is needed?

It is a senior role. The posting asks for: significant experience with high-performance distributed systems; experience building or operating services on AWS, GCP, or Azure. Skills it names include Distributed Systems, AWS, GCP, Azure.

How do I apply with Keywordise AI?

Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.

More IT and software jobs in San Francisco, CA

All IT and software jobs in San Francisco, CA
An AI safety and systems companySan Francisco, CA
Apply with Keywordise AI