A company building agentic AI solutionsHiring

Senior Software Developer in Test (AI Portfolio)

  • CAD 114,750 to 155,250 per year
  • Remote, Canada
  • Senior
  • Posted 5 days ago
In one line

Test automation role focused on AI products, writing UI and API test suites and checking model accuracy and output consistency.

About the role

Agentic AI solutions need testing that covers model accuracy, edge cases and performance, and this job shapes how that testing is done across the product.

At a glance

Pay
CAD 114,750 to 155,250 per year
Remote scope
Remote, Canada
Seniority
Senior
Skills
Rest-Assured, Cypress, Selenium, Pytest, SQL, Java, Python
Posted
24 Oct 2026
Last checked
28 Oct 2026

What you will do

  • Design, write and maintain automated UI and API test suites
  • Plan and run exploratory, functional, integration, performance and regression tests
  • Use generative AI tools to speed up test automation and coverage

What they look for

  • 5 or more years in QA and test automation within an Agile environment
  • Track record testing AI or ML products, including prompt evaluation or bias detection
  • Hands-on with Git, Jira and test case tools such as Xray or Zephyr
  • Proficiency in SQL or another database query language
  • Programming skills in Java, JavaScript, TypeScript, C or Python

Nice to have

  • Interest in using AI-driven solutions to improve efficiency

Benefits

  • Base salary range of $114,750 to $155,250 CAD, set by role, level and location

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job rsjmhwbi7e
How to connect

Questions about this job

Is this job fully remote, and from where?

Yes, it is listed as remote, aimed at candidates in Canada.

What does this job pay?

The posting states CAD 114,750 to 155,250 per year.

What experience is needed?

It is a senior role. The posting asks for: 5 or more years in QA and test automation within an Agile environment; track record testing AI or ML products, including prompt evaluation or bias detection; hands-on with Git, Jira and test case tools such as Xray or Zephyr. Skills it names include Rest-Assured, Cypress, Selenium, Pytest.

How do I apply with Keywordise AI?

Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.

More remote IT and software jobs

All remote IT and software jobs
A company building agentic AI solutionsRemote, Canada
Apply with Keywordise AI