ML Challenge Task Auditor
Quick facts
- Pay
- $70–90 / hour
- Type
- Contract
- Location
- Remote — United States
- Skills
- PyTorch, TensorFlow
- Platform
- Mercor — 291 open jobs
- Typical pay at Mercor
- $42–180/hour · median $85 (135 jobs on our site)
- Apply
- Free to apply — never pay to get AI training work
Pay: $70 – $90/hour
Commitment: Hourly, ~40 h/week
Open to: USA
Field: Data Analysis
Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology — and provide clear, rubric-based written feedback.
Basic Qualifications
- 3+ years hands-on applied/experimental ML (experiment design, model selection, hyperparameter tuning, evaluation methodology)
- Strong grasp of data-quality rigor: leakage detection, metric gaming, and train/test/CV hygiene
- Proficiency with standard ML frameworks (PyTorch, TensorFlow, scikit-learn, XGBoost)
- Ability to critique ML claims against evidence and reproduce results
Preferred Qualifications
- Competition / benchmark experience (e.g., Kaggle)
- Graduate research or publication record in applied ML
- Prior task-grading or peer-review experience
Note: this role evaluates applied/experimental ML rigor — it is not an LLM-application-building or MLOps role.
About Mercor
Mercor is an AI-driven hiring marketplace that places professionals on contracts with leading AI labs. You apply once, complete a short AI interview, and are then matched to open projects.