Member of Technical Staff, AI Inference
- USD 200,000 to 300,000 per year
- San Francisco, CA
- Mid-level
- Posted 5 weeks ago
or apply from Claude / ChatGPT / Muse
Member of Technical Staff, AI Inference is a mid-level role in San Francisco, CA at an AI inference optimisation startup.
About the role
A small team that has raised early funding and works on squeezing more useful output from every watt. Success means new open models run well on day one and production serving stays cheap and reliable.
At a glance
- Pay
- USD 200,000 to 300,000 per year
- Location
- San Francisco, CA
- Seniority
- Mid-level
- Skills
- CUDA, HIP, Triton, Python, TPU, AWS Trainium
- Visa
- Sponsorship offered
- Posted
- 12 Oct 2026
- Last checked
- 15 Nov 2026
What you will do
- Get new open-source models running well on launch day, tuned for latency and throughput
- Improve the serving stack: batching, KV cache, speculative decoding and quantization
- Write and tune kernels in CUDA, HIP and Triton across NVIDIA, AMD, TPU, Trainium and D-Matrix
- Build and run multi-vendor clusters, watching reliability, observability and cost per token
What they look for
- One to six years of software engineering close to hardware, especially GPU kernels
- Hands-on work with CUDA, HIP or Triton and with inference serving optimisation
- Clear first-principles thinking, resourcefulness and comfort talking with customers
- Based in the US, able to transfer an existing visa such as H-1B or OPT
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job jazchwkeorQuestions about this job
Where is this job based?
The posting lists Member of Technical Staff, AI Inference as a role based in San Francisco, CA, United States.
What does this job pay?
The posting states USD 200,000 to 300,000 per year.
What experience is needed?
It is a mid-level role. The posting asks for: one to six years of software engineering close to hardware, especially GPU kernels; hands-on work with CUDA, HIP or Triton and with inference serving optimisation; clear first-principles thinking, resourcefulness and comfort talking with customers. Skills it names include CUDA, HIP, Triton, Python.
How do I apply with Keywordise AI?
Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.
More IT and software jobs in San Francisco, CA
- WWorkatoSenior Software Engineer
- San Francisco, CA
- WWaymoSummer Intern, Software Engineer
- San Francisco, CA
- LSLila SciencesCo-op, Software, Applied AI Platform Engineer
- San Francisco, CA
LogicMonitorAI Operations & Workforce Transformation Director- San Francisco, CA
- OOktaSenior Software Engineer, Core Infrastructure
- San Francisco, CA
- A global on-demand logistics and delivery platformMachine Learning Intern (PhD)
- San Francisco, CA