AI Developer Trace Task Auditor
Quick facts
- Pay
- $70–90 / hour
- Type
- Contract
- Location
- Remote — United States
- Platform
- Mercor — 291 open jobs
- Typical pay at Mercor
- $42–180/hour · median $85 (135 jobs on our site)
- Apply
- Free to apply — never pay to get AI training work
Pay: $70 – $90/hour
Commitment: Hourly, ~40 h/week
Open to: USA
Field: Software Engineering
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.
Basic Qualifications
- 3+ years professional software development
- Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
- Strong code-reading and debugging skills across full-stack or backend systems
- Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications
- Experience with Kiro or Amazon CodeCatalyst
- Prior work evaluating or grading AI-generated code
- Contributions to developer tooling
About Mercor
Mercor is an AI-driven hiring marketplace that places professionals on contracts with leading AI labs. You apply once, complete a short AI interview, and are then matched to open projects.