Remote job · IT and software

Senior Software Development Test Engineer (SDET), AI and Automation

Remote (US)
A fast-growing cybersecurity software company
Posted 8 Oct 2026

Apply with Keywordise AI

Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.

Apply with Keywordise AI

About the role

An embedded quality engineering partner for an AI team, defining test strategy and building automated coverage as AI-powered capabilities are developed. The role covers both deterministic software and non-deterministic AI and ML systems.

What you will do

Define test strategy, acceptance criteria and automation requirements with engineers and product managers
Design and maintain automated test frameworks for AI applications, backend services and APIs
Create testing approaches for deterministic behavior and non-deterministic AI and ML outputs
Set measurable evaluation criteria, tolerances and quality thresholds for model and LLM features

What they look for

Experience testing both traditional deterministic systems and non-deterministic AI or ML systems
Ability to build automation frameworks and integrate testing into CI/CD workflows
Skill in designing probabilistic and deterministic validation strategies
Experience validating AI behavior across different models, prompts and inputs

How it works

1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
3We apply for youYour application goes to the employer and you follow it in your dashboard.

More remote IT and software jobs

All remote IT and software jobs

Explore more: remote jobs, the Keywordise Job Market Index, the blog.