Land a Remote Job
Mercor · Remote job

ML Challenge Task Auditor

STEP 1 · PRACTICE FIRSTTake a free AI practice interview for this kind of roleGet my practice interview ↓
STEP 2 · APPLYApply on Mercor when you’re readyApply on Mercor →

You apply directly on Mercor's site. Applying is free. Posted Aug 28, 2026.

Get alerts for new jobs onTelegram
STEP 1 · PRACTICE BEFORE YOUR REAL INTERVIEW

Get your free practice interview for this role

Mercor screens applicants online, often with an AI interview. micro1 offers a free, 18-minute AI practice interview with feedback, and we picked the one closest to this role: Internal Auditor. It covers:

Risk AssessmentCompliance KnowledgeAnalytical Thinking

Here’s your practice interview

Allow your microphone when it asks, find a quiet spot, and give yourself about 20 minutes. We’ve also emailed you the link and the free ebook.

Step 2: when you feel ready, apply.

Apply on Mercor →

The practice interview is free and run by micro1. Land Remote Jobs is an independent job board, not part of micro1, Mercor or Turing. Practising helps you prepare; it can’t guarantee the result of your real interview. Want more tips? Read our guide to acing the remote job interview.

STEP 2 · APPLY

Apply for this role

You apply on Mercor's own site. It’s free, and you can apply even if you skip the practice.

Apply on Mercor →

Who this role suits

Analysts and data scientists who want flexible remote work in statistics, modelling and evaluation.

Full job description

Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology — and provide clear, rubric-based written feedback.

Basic Qualifications • 3+ years hands-on applied/experimental ML (experiment design, model selection, hyperparameter tuning, evaluation methodology) • Strong grasp of data-quality rigor: leakage detection, metric gaming, and train/test/CV hygiene • Proficiency with standard ML frameworks (PyTorch, TensorFlow, scikit-learn, XGBoost) • Ability to critique ML claims against evidence and reproduce results

Preferred Qualifications • Competition / benchmark experience (e.g., Kaggle) • Graduate research or publication record in applied ML • Prior task-grading or peer-review experience

Note: this role evaluates applied/experimental ML rigor — it is not an LLM-application-building or MLOps role.

Last checked open on Oct 28, 2026. Job description provided by Mercor.

Something not working? Tell us

If the practice interview or the apply link doesn’t open, or the job looks closed, let us know and we’ll fix it.

← Browse all remote jobs