Domain Contributor - Evaluation Specialist
Quick facts
- Type
- Part-time
- Location
- Remote
- Hours
- 15+ hours / week
- Platform
- Micro1 — 247 open jobs
- Typical pay at Micro1
- $20–120/hour · median $90 (22 jobs on our site)
- Apply
- Free to apply — never pay to get AI training work
pay
Required Skills
Domain depth
Source verification
Reasoning clarity
Evaluation expertise
About micro1
micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.
Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-quality training data. Our research spans high-value, specialized domains (legal, medical, finance, coding, etc.), where expert-level data is the hardest to produce and most valuable for advanced model performance. Our pipeline performance system ensures both quality and velocity.
Role Title: Domain Contributor - Evaluation Specialist
Role Type: Contractor (~15 hrs/week)
Location: Remote
micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.
Scope of Work
Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
Apply detailed task guidelines and evaluation rubrics consistently to each submission.
Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.
Preferred Qualifications
Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
Advanced research skills with a track record of verifying complex claims against authoritative sources.
Exceptional written and verbal communication skills to articulate findings and feedback.
Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
Background in adversarial or “stomp the model” task design is advantageous.
Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
By clicking any of the "Continue" buttons below, you acknowledge and agree to our Terms and Privacy Policy for candidates.
Continue
or
Continue with Google
Continue with LinkedIn
Have any questions? See FAQs
Refer and Earn
$100
micro1 recruits engineers and domain experts for AI labs using its AI interviewer. Once vetted, contractors work on human-data projects such as writing and checking model outputs or building coding evaluations.