Evaluation Specialist/Recent Grad

Pay: $20 - $60/hour

Required Skills
Research & source triangulation
Attention to detail
Written precision
Self-direction & reliability
Analytical thinking
About micro1
micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.

Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-quality training data. Our research spans high-value, specialized domains (legal, medical, finance, coding, etc.), where expert-level data is the hardest to produce and most valuable for advanced model performance. Our pipeline performance system ensures both quality and velocity.

Role Title: Evaluation Specialist/Recent Grad

Role Type: Contractor

Location: Remote

micro1 is engaging Evaluation Specialists/Recent Grads to contribute to a high-impact project for a customer at the frontier of artificial intelligence. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

Develop original, challenging question-and-answer pairs that test the limits of advanced AI models across diverse subjects.
Conduct in-depth research, applying rigorous source triangulation to ensure each answer is accurate, comprehensive, and well-documented.
Create multi-step questions that require synthesis and analytical reasoning — not just single-source lookups.
Test your questions against AI models, analyze outcomes, and iterate to increase or adjust difficulty as needed.
Document your research process, providing clear citations and logical explanations for each answer.
Refine content based on reviewer input and maintain alignment with project guidelines and quality standards.

Preferred Qualifications

Proven ability to conduct thorough, independent research and critically evaluate information from multiple sources.
Exceptional attention to detail and written precision in English (fluency required, but it does not need to be your first language).
Talent for crafting nuanced and well-structured questions that probe deep understanding.
Strong self-direction, reliability, and accountability in remote, independent project work.
Interest in cutting-edge AI and a passion for testing the boundaries of current model capabilities.
Prior experience in AI training, evaluation, or content creation is a plus, but not required.
Open to recent graduates, advanced-degree holders, and individuals from any academic or professional background with demonstrated research and writing expertise.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

Email

By clicking any of the "Continue" buttons below, you acknowledge and agree to our Terms and Privacy Policy for candidates.

Continue
or
Continue with Google
Continue with LinkedIn

Have any questions? See FAQs