Remote job · IT and software
Software Engineer - AI Code Evaluation
- Remote (Canada)
- A boutique IT professional services consultancy
- Posted 13 Oct 2026
Apply with Keywordise AI
Upload your CV and Keywordise tailors your CV and cover letter to this job and applies for you. 7-day free trial, no card.
Apply with Keywordise AIAbout the role
Engineers assess and train next generation AI models by judging generated code and designing challenging programming problems with verified solutions.
What you will do
- Assess AI generated code for correctness, quality, maintainability and sound design
- Write challenging coding problems with verified reference solutions and thorough test cases
- Review model reasoning on architecture, debugging, algorithms and system design
- Find logic errors, inefficient code, edge cases and architectural weaknesses
- Give detailed technical feedback and explanations to improve model performance
- Apply consistent evaluation criteria for accurate and reliable assessments
What they look for
- At least three years of professional experience in data science or software engineering
- At least one year at a leading technology, finance or research company
- Strong programming and software engineering fundamentals
- Ability to judge code correctness, find bugs and assess design decisions
- Strong analytical thinking and clear written English for technical feedback
How it works
- 1Upload your CVSign up with Google or your email and add your CV. It takes about a minute.
- 2We tailor your applicationKeywordise writes a CV and a cover letter for this job from your real experience.
- 3We apply for youYour application goes to the employer and you follow it in your dashboard.
More remote IT and software jobs
- Senior Business Operations EngineerA life sciences supply chain compliance company · Remote, worldwide
- Analytics EngineerA sports analytics and betting startup · Remote (US)
- B2B Technical SalesA startup accelerator for founders · Remote (Austria)
- Lead CSV/CSA SpecialistA life sciences IT services provider · Remote (US)
- Senior Support EngineerA global CRM software company · Remote (UK)
- Junior Data Quality AnalystAn IT services firm serving government clients · Remote (US)
Explore more: remote jobs, the Keywordise Job Market Index, the blog.