AI Product Evaluator
Quick facts
- Type
- Part-time
- Location
- India, Japan or United Kingdom, Remote
- Platform
- Micro1 — 261 open jobs
- Typical pay at Micro1
- $25–150/hour · median $90 (27 jobs on our site)
- Apply
- Free to apply — never pay to get AI training work
pay
Required Skills
AI Models
AI Agents
Following Instructions
Attention to Detail
About micro1
micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.
Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-quality training data. Our research spans high-value, specialized domains (legal, medical, finance, coding, etc.), where expert-level data is the hardest to produce and most valuable for advanced model performance. Our pipeline performance system ensures both quality and velocity.
Role Title: AI Product Evaluator
Role Type: Contractor
Location: India, Japan or United Kingdom, Remote
micro1 is engaging expert AI Product Evaluators to contribute directly to a customer's high-impact AI project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. This operationally intensive engagement involves handling AI model and agent evaluations, often within strict timeframes and usage limit resets. The project benefits greatly from contributions of multiple specialists, each bringing a meticulous approach to instruction-following and quality assurance.
Scope of Work
Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
Execute a series of operational tasks designed to test model accuracy, reasoning, and responsiveness.
Document findings, observations, and any anomalies in structured written reports.
Reset usage limits and repeat evaluations as required by project protocols.
Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
Maintain a high standard of attention to detail and rigor across all evaluation tasks.
Preferred Qualifications
Experience with AI products, AI models, or AI agent evaluation and testing.
Demonstrated ability to follow complex instructions with precision and consistency.
Exceptional attention to detail and operational thoroughness.
Someone who already uses
AI in daily life.
Comfort working with repetitive or high-volume operational tasks within strict timeframes.
Prior participation in digital product, software QA, or AI research projects is a plus.
Detail-oriented, great at following instructions and documenting each step.
Email
By clicking any of the "Continue" buttons below, you acknowledge and agree to our Terms and Privacy Policy for candidates.
Continue
or
Continue with Google
Continue with LinkedIn
Have any questions? See FAQs
Refer and Earn
$100
About Micro1
micro1 recruits engineers and domain experts for AI labs using its AI interviewer. Once vetted, contractors work on human-data projects such as writing and checking model outputs or building coding evaluations.