Senior Software Engineer, Data Pipelines
- San Francisco, CA
- Senior
- Posted 11 days ago
or apply from Claude / ChatGPT / Muse
Senior backend role on a data pipeline team, building systems that ingest telemetry from over 25 million devices, with Kubernetes and streaming frameworks.
About the role
High-throughput ingestion, processing and storage work that turns raw device telemetry into reliable data products. The team solves distributed systems problems at petabyte scale alongside engineers across the organisation.
At a glance
- Pay
- Not stated in the posting
- Location
- San Francisco, CA
- Seniority
- Senior
- Skills
- Scala, Java, Kafka, Spark, Flink, Kubernetes, Grafana
- Posted
- 5 Nov 2026
- Last checked
- 15 Nov 2026
What you will do
- Build and run pipelines that ingest petabyte-scale telemetry from 25 million devices
- Engineer resilient distributed systems inside Kubernetes
- Turn complex data requirements into dependable solutions with product and engineering peers
- Set observability standards with ELK and Grafana to catch issues early
- Speed up development with AI-assisted engineering tools and strict security checks
What they look for
- Bachelor's plus 5 years, master's plus 3, PhD, or equivalent work experience
- Debugging or operating distributed systems or backend services at high volume
- Production programming in Scala, C++ or Java
- Data pipelines using Kafka, Spark or Flink for streaming or batch
- Deploying and maintaining containerised workloads on Kubernetes
Nice to have
- SQL, distributed data stores or cloud-native services in production
- Network telemetry, networking protocols or fleet management
- Terraform, Ansible, Elasticsearch or Grafana for automation and monitoring
- Open-source contributions or personal systems projects
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job fk4akbfamuQuestions about this job
Where is this job based?
The posting lists Senior Software Engineer, Data Pipelines as a role based in San Francisco, CA, United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
It is a senior role. The posting asks for: bachelor's plus 5 years, master's plus 3, PhD, or equivalent work experience; debugging or operating distributed systems or backend services at high volume; production programming in Scala, C++ or Java. Skills it names include Scala, Java, Kafka, Spark.
How do I apply with Keywordise AI?
Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.
More IT and software jobs in San Francisco, CA
- WWorkatoSenior Software Engineer
- San Francisco, CA
- WWaymoSummer Intern, Software Engineer
- San Francisco, CA
- LSLila SciencesCo-op, Software, Applied AI Platform Engineer
- San Francisco, CA
LogicMonitorAI Operations & Workforce Transformation Director- San Francisco, CA
- OOktaSenior Software Engineer, Core Infrastructure
- San Francisco, CA
- A global on-demand logistics and delivery platformMachine Learning Intern (PhD)
- San Francisco, CA