AI Instructor – Rubric writing

Teach live online classes on writing the rubrics and criteria that other people grade AI responses with, from a first draft to criteria that two graders apply the same way. You teach in English from a ready class kit, remotely, and you are paid for each class you teach.

What the work is for

YPAI Learn trains people for AI training work in live classes. Your classes take learners from a loose idea of what a good answer looks like to a rubric of clear, checkable criteria, and teach them to check whether different graders reach the same score with it.

The work

• Teach the live class “Write a rubric with checkable criteria for one AI task”, 90 minutes, from the class kit.
• Teach the live class “Test a rubric on sample responses and fix the criteria graders disagree on”, 90 minutes, from the class kit.
• Show live how to turn a goal such as “the answer should be helpful” into separate criteria a grader checks one at a time, each with a pass example and a fail example.
• Walk learners through weighting criteria, marking the must-haves, and writing criteria for one specific prompt instead of general ones.
• Help learners whose criteria overlap, depend on taste or bundle two checks into one line, and show them how to split or reword each one.

What to expect

• Learners from around the world join these live online classes, which are held in English. The application asks about any other teaching languages.
• A class kit comes with each class: a plan by the minute, slides, speaker notes, a demo of drafting a rubric and a recording of the demo to fall back on.
• You teach remotely from your own computer with a reliable connection, a camera and a microphone, and share a document on screen as the rubric takes shape.
• Passing the instructor test for a class comes before your first time teaching it.
• Before a teaching assignment starts, you sign an instructor agreement. It covers pay, confidentiality and how class material may be used.
• Each invitation states the class times and the price learners pay, and you see both before you accept.

What you bring

• A rubric or grading guideline you wrote for real work, or one rebuilt on a made-up task, that you can show and explain.
• Experience teaching, writing training material, running workshops or reviewing guidelines written by others.
• Patience with learners who write criteria that sound right but cannot be checked.

You need

• Hands-on experience writing rubrics, grading criteria or guidelines that others used to evaluate AI output.
• Precise written English and an editor's eye for wording that two readers could take in different ways.
• Fluent spoken English, the language the classes are taught in.
• 18 years or older.

Good to know

• If you need your employer's approval for outside work under your contract, have it before you accept any assignment.
• Teaching volume depends on how much demand there is for the classes. Each invitation states the time commitment it expects.
• You pay nothing to apply and do not need to buy or complete a YPAI Learn course.

Pay

$26–$99/hr. Rate shown is for the United States. This role is open in 4 countries, with local rates; pick your country on YPAI.

YPAI pays every two weeks for approved work via PayPal, Wise or bank transfer. Work is by invitation after your profile is reviewed.