Remote job · IT and software
Senior Software Development Engineer in Test, AI & Automation
In one line: Senior Software Development Engineer in Test, AI & Automation is a remote role in the United States at a fast-growing cybersecurity software company.
- Remote (US)
- A fast-growing cybersecurity software company
- Posted 8 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIPrefer your AI assistant? Apply from Claude or ChatGPT
Add Keywordise to your assistant as a connector, sign in, then send it this prompt. It applies for you through Keywordise.
https://keywordise.com/mcpApply to Keywordise job 2ro4qorw7rAbout the role
You will act as an embedded quality engineering partner to an AI team, shaping test strategy and automated coverage for AI-powered products in security-sensitive environments. The role blends traditional deterministic testing with validation of non-deterministic AI and ML behaviour.
At a glance
- PayNot stated in the posting
- Remote scopeRemote, United States
- Posted8 Oct 2026
- Last checked18 Oct 2026
What you will do
- Work with AI engineers, software engineers and product managers from design onward to set test strategy and acceptance criteria
- Build and maintain automation frameworks covering AI applications, backend services and APIs
- Create validation approaches for both predictable software behaviour and variable AI/ML outputs
- Set measurable evaluation criteria, tolerances and quality thresholds for model and LLM features
- Add regression, integration, API and end-to-end automated coverage as features are built
- Develop harnesses and evaluation workflows for prompts, models, agents and tool-calling pipelines
What they look for
- Experience testing conventional deterministic systems as well as non-deterministic AI or ML systems
- Ability to design automation frameworks and integrate testing into CI/CD pipelines
- Skill in defining measurable quality, reliability and safety standards for AI-driven functionality
- Comfort working closely with engineering and product teams throughout the development cycle
Questions about this job
Is this job fully remote, and from where?
Yes, it is listed as remote, aimed at candidates in the United States.
What does this job pay?
The posting does not state a salary, so there is no figure to quote.
What experience is needed?
The posting asks for: experience testing conventional deterministic systems as well as non-deterministic AI or ML systems; ability to design automation frameworks and integrate testing into CI/CD pipelines; skill in defining measurable quality, reliability and safety standards for AI-driven functionality.
How do I apply with Keywordise AI?
Select Apply with Keywordise AI, sign up and upload your CV. Keywordise writes a CV and a cover letter for this job from your real experience and applies for you. The 7-day free trial needs no card.
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote IT and software jobs
- Senior Fullstack Software Engineer ConsultantA large insurance and financial services company · Remote (US)
- Senior Product EngineerA software company in network mapping · Remote (US)
- Field Application Specialist, Chromatography and TFFA bioprocessing technology company · Remote (US)
- Solutions ArchitectA fintech SaaS company in payments and data · Remote, worldwide
- Senior Software Engineer, Security PlatformA fintech company offering installment payments · Remote (Brazil)
- Senior Cloud Operations Engineer (Night shift)A global enterprise software and cloud services company · Remote (UK)
Browse more: Remote IT and software jobs · Remote jobs in the United States · Remote IT and software jobs in the United States
Explore more: remote jobs, the Keywordise Job Market Index, the blog.