Get your free practice interview for this role
Mercor screens applicants online, often with an AI interview. micro1 offers a free, 18-minute AI practice interview with feedback, and we picked the one closest to this role: Internal Auditor. It covers:
Here’s your practice interview
Allow your microphone when it asks, find a quiet spot, and give yourself about 20 minutes. We’ve also emailed you the link and the free ebook.
Step 2: when you feel ready, apply.
The practice interview is free and run by micro1. Land Remote Jobs is an independent job board, not part of micro1, Mercor or Turing. Practising helps you prepare; it can’t guarantee the result of your real interview. Want more tips? Read our guide to acing the remote job interview.
Apply for this role
You apply on Mercor's own site. It’s free, and you can apply even if you skip the practice.
Who this role suits
Working engineers who want flexible, project-based remote work that uses their coding and review skills. A strong portfolio or GitHub helps.
Full job description
Evaluate the quality, correctness, and reproducibility of software-engineering benchmark tasks used to train and evaluate a frontier AI lab's models. You'll assess repository-level tasks, reference patches, test harnesses, and grading integrity — and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years professional software engineering • Real open-source contribution or maintainer experience (merged PRs, committer / maintainer roles) • Strong ability to audit reference patches, test runners, and Docker isolation, and to detect answer leakage / reward hacking • Fluency across common ecosystems (Python and at least one of Java / Go / TypeScript / C++)
Preferred Qualifications • Familiarity with SWE-Bench (Verified) or similar repository benchmarks • Maintainer history on major Python OSS (Django, Flask, scikit-learn, sympy, pytest, etc.) • Prior code-review or task-grading experience
Last checked open on Oct 28, 2026. Job description provided by Mercor.
Something not working? Tell us
If the practice interview or the apply link doesn’t open, or the job looks closed, let us know and we’ll fix it.
Thanks, we got it. We’ll check this job’s links and reply by email if you left one.