Model Evaluator

Model Evaluator

Applications open

Rate and compare AI answers and explain why, as paid work from home. It suits careful readers who can say why an answer is wrong, not only that it is.

Remote, United States · Freelance

What the work is for

Your ratings and written reasons help train AI models and test their answers.

The work

• Rate and compare AI answers against the project's criteria.
• Write a short, concrete reason for each rating. It matters as much as the rating itself.
• Check the facts in an answer. Rewrite weak answers where the task asks for it.
• Flag unsafe, false or policy-breaking output explicitly.

What to expect

• Each project has its own rating criteria and instructions for judging answers.
• You work in YPAI's own review console, where each project's rating criteria are set up.

You need

• Strong reading comprehension in the language you evaluate.
• The ability to explain why, not only what.
• 18 years or older.

Good to know

• You will read unsafe or offensive output at times. Judging it is part of the work.
• Work depends on the projects running in the language you evaluate. There can be gaps between projects.

Our team reviews applications for this role and contacts selected applicants by email.

Apply

Takes a couple of minutes. No CV needed.

Payment

Via PayPal, Wise, or bank transfer

When you are paid

Paid every two weeks after approved work.

Fees to you

Never, at any stage. If someone asks, it is not us

Who hires you

YPAI, a registered Norwegian company that collects and annotates data for AI

Website

Full name

Email

Phone (optional)

CountrySelect...United States──────────AfghanistanÅland IslandsAlbaniaAlgeriaAmerican SamoaAndorraAngolaA

State (optional)Select...AlabamaAlaskaArizonaArkansasCaliforniaColoradoConnecticutDelawareDistrict of ColumbiaFloridaGeorgiaHawaiiIdahoIllinoisIndianaIowaKansasKentuckyLouisianaMaineMarylandMassachusettsMichiganMinnesotaMississippiMissouriMontanaNebraskaNevadaNew HampshireNew JerseyNew MexicoNew YorkNorth CarolinaNorth DakotaOhioOklahomaOregonPennsylvaniaRhode IslandSouth CarolinaSouth DakotaTennesseeTexasUtahVermontVirginiaWashingtonWest VirginiaWisconsinWyoming Add a CVoptional PDF, Word or a photo, max 5 MB. Skip it if you do not have one. Send application

You see the confirmation here.

Application received

Thank you for applying for Model Evaluator. Our team will review your application and contact you by email if you are selected.

• We have emailed you a receipt.
• Your YPAI Freelance profile is set up too. Use the link in the email to complete, edit or delete it.
• Your YPAI Freelance profile is set up too. Sign in with this email address to complete, edit or delete it.
• This application is saved on your YPAI Freelance profile.

Your application, and any CV you uploaded, are deleted no later than 2 years after you applied.

YPAIlinkedin.com/company/ypai-ai Follow YPAI on LinkedIn

Typical project pay

USD 20-28 per hour

Each project invitation states the work, your pay, what the pay covers and what the work must meet. You see it before you accept.

Where

Remote, United States

Contract

Freelance

Status

Applications open

Apply now

Takes a couple of minutes. No CV needed.