Software Development Engineer in Test, Agentic Automation
- Remote, Canada
- Mid-level
- Posted 2 days ago
or apply from Claude / ChatGPT / Muse
Test engineering role on a cloud security platform team, building automation for large distributed systems and helping work out how to test AI agents. Remote in Canada.
About the role
The team handles huge volumes of security event traffic and needs reliable automation behind it. Part of the job is defining how AI agents get evaluated and trusted before they reach production.
At a glance
- Pay
- Not stated in the posting
- Remote scope
- Remote, Canada
- Seniority
- Mid-level
- Skills
- Java, Node.js, Python, Go, MongoDB, Kafka, AWS, Terraform
- Posted
- 2 Nov 2026
- Last checked
- 3 Nov 2026
What you will do
- Build and look after automated test suites and frameworks for cloud systems that run across many machines
- Extend the agentic test generation and analysis tooling that sits inside the main testing frameworks
- Create AI-driven workflows and agent skill files that take manual test chores out of the picture
- Keep eval suites, golden datasets and scoring pipelines running for the AI agents, covering correctness, tool use, safety, latency and cost
What they look for
- A computer science degree or the equivalent practical background
- Hands-on SDET experience with functional, integration and performance automation
- Comfort with languages such as Java, Python, Go or Node.js and with CI/CD tooling like Jenkins or GitLab
- Ability to review designs for testability and spot unreliable AI output such as hallucinated assertions or judge bias
Nice to have
- Familiarity with LLM APIs, agent frameworks and eval tooling
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job jc5yg4llvzQuestions about this job
Is this a remote job, and where can I work from?
Yes. The posting lists Software Development Engineer in Test, Agentic Automation as a remote role for candidates in Canada.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
It is a mid-level role. The posting asks for: a computer science degree or the equivalent practical background; hands-on SDET experience with functional, integration and performance automation; comfort with languages such as Java, Python, Go or Node.js and with CI/CD tooling like Jenkins or GitLab. Skills it names include Java, Node.js, Python, Go.
How do I apply with Keywordise AI?
Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.
More remote IT and software jobs
- A regulated prediction market exchangeStaff Backend Engineer
- Remote, United States
- A technology consultancyJunior Backend Go Developer
- Remote, Spain
- MMarigoldSenior Software Engineer
- Remote, Australia
- CCoinbaseSoftware Engineer, Crypto Data Foundations
- USD 152,405 to 179,300 per year
- Remote, United States
- VVVeta VirtualFull Stack Software Engineer
- Remote, worldwide
- A company building data-rich productsFull Stack Developer
- USD 3,200 to 3,700 per month
- Remote, United States