AI training contract
AI Agent Evaluator
Generalist · USD 25-45 an hour. · 50 openings here, 100 across all 2 versions
AI Agent Evaluator is contract work for micro1, reviewing and correcting what AI models produce in generalist. The output of the job is expert judgement written down: a model gives an answer, someone who knows the subject decides whether it is right and explains why.
What it requires. No credential is stated on this listing beyond experience in the field.
What it pays. USD 25 to USD 45 an hour, as published by micro1. Rates in this category track how rare the credential is rather than how hard the work is.
Where. This listing names no country of its own. Check on micro1's page before you count on being eligible.
micro1 lists 50 openings on this posting, and 100 across the 2 postings of this role listed below.
Skills named: ChatGPT, Muse, AI agents, Attention to Detail, Following Instructions, Screen Recording.
Applications are made on micro1, not here. WFA Digital is independent of micro1 and may receive a referral fee if you are hired, at no cost to you.
Full listing, as published by micro1
Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Monday, October 12 Onboarding: Today (Fri), Saturday, or Sunday, so you’re ready to start Monday October 10th You’ll need: An active personal popular AI account (Free, Go, or Plus; not Pro), an active personal and a smartphone that can screen record Your tasks: Run everyday errands with two AI agents, approve key steps, screen record, and score the results About the role AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you. You’ll test two AI agents side by side, using your own accounts on your phone, and tell us what worked, what didn’t, and how it felt. What you’ll do Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms Approve or stop the agent at key steps Screen record every attempt Score each run on completion, quality, control issues, satisfaction, and time Share clear written feedback on the agent experience Who we’re looking for US-based , with a Bachelor’s degree Someone who already uses AI in daily life 2-3 years of experience, preferably in engineering, business management, or office/operations Detail-oriented, great at following instructions and documenting each step Clear written communication Generalists welcome, domain experts preferred No coding or AI background needed Why you’ll like it Get paid to use the AI tools you already use Work entirely from your phone, on your schedule Have a direct say in how next-generation AI agents get built and improved How the selection process works Apply Complete the screening questions Interview : 15-30 minutes max Profile review: if everything looks good, we present you to the client Onboarding: our Talent Ops team will contact you to get you started
The same role, listed 2 times by micro1
micro1 publishes this role once per version, usually one per language, and each version is its own posting with its own openings and its own application page.
- AI Agent Evaluator, 50 openings, the posting this page describes
- Everyday AI Agent Tester, 50 openings, apply on micro1
Who can apply. The language named in a title is a skill requirement, not a nationality requirement: the listing asks for fluency, not a passport. Nationality is not part of micro1's rule at all. What its rule names is where you live, and that list is under "Where" above.
All AI training roles we track · Every micro1 opportunity with filters
Rate, openings and requirements checked 2026-10-19 against micro1's own public postings.