YPAI hires in most countries worldwide. Find all AI training jobs open in your country →
YPAI logo

Model Evaluator

YPAI YPAI ContractRemote $20–28/hr
Posted Sep 23, 2026 · ✓ Still open — checked 1 hour ago

Quick facts

Pay
$20–$28/hr
Type
Contract
Location
Remote
Platform
YPAI — 402 open jobs
Typical pay at YPAI
$16–44/hour · median $25 (229 jobs on our site)
Payout
PayPal, Wise, Bank transfer (every two weeks after approved work)
Apply
Free to apply — never pay to get AI training work

Rate and compare AI answers and explain why, as paid work from home. It suits careful readers who can say why an answer is wrong, not only that it is.

What the work is for

Your ratings and written reasons help train AI models and test their answers.

The work

  • Rate and compare AI answers against the project's criteria.
  • Write a short, concrete reason for each rating. It matters as much as the rating itself.
  • Check the facts in an answer. Rewrite weak answers where the task asks for it.
  • Flag unsafe, false or policy-breaking output explicitly.

What to expect

  • Each project has its own rating criteria and instructions for judging answers.
  • You work in YPAI's own review console, where each project's rating criteria are set up.

You need

  • Strong reading comprehension in the language you evaluate.
  • The ability to explain why, not only what.
  • 18 years or older.

Good to know

  • You will read unsafe or offensive output at times. Judging it is part of the work.
  • Work depends on the projects running in the language you evaluate. There can be gaps between projects.

Pay

$20–$28/hr. Rate shown is for the United States. This role is open in 12 countries, with local rates; pick your country on YPAI.

YPAI pays every two weeks for approved work via PayPal, Wise or bank transfer. Work is by invitation after your profile is reviewed.