Remote job · IT and software
Software Engineer, AI Code Evaluation
- Remote (Australia)
- A boutique IT services and engineering talent consultancy
- Posted 13 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIAbout the role
Engineers assess and grade code produced by advanced AI models on realistic software tasks, and craft programming challenges with verified answers to sharpen model reasoning and output quality.
What you will do
- Judge AI-written code for correctness, maintainability, quality and sound design
- Write demanding coding problems plus verified solutions and thorough test cases
- Examine model reasoning around architecture, debugging, algorithms and system design
- Spot logic errors, weak architecture, edge cases and inefficient implementations
- Give clear technical feedback and explanations that help models improve
- Apply consistent evaluation standards so assessments stay accurate and reliable
What they look for
- Three or more years of professional software engineering or data science experience
- At least one year at a top technology, finance or research organisation
- Bachelor's degree in computer science, software engineering, data science or similar from a US, Canadian, Australian, New Zealand or UK univ
- Solid programming and software engineering fundamentals
- Able to judge code correctness, find bugs and assess design choices
- Strong analytical skills, complex problem solving and clear written English
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote IT and software jobs
- Open Source Code Licensing ContributorA software licensing marketplace · Remote (Peru)
- Client Success SpecialistA remote-first e-commerce payments agency · Remote, the Middle East and North Africa
- Senior S/4 Transition Data ArchitectA large aerospace and defense company · Remote (US)
- Associate, Strategic PartnershipsA precision medicine analytics company · Remote (US)
- Contractor Engineering Content DeveloperA large education and test preparation provider · Remote (US)
- Senior/Staff Software EngineerA venture-backed fintech AI software company · Remote (US)
Explore more: remote jobs, the Keywordise Job Market Index, the blog.