Remote AI training jobs, paid weekly in USD
Hiring now: 305 roles, including STEM, Finance, Legal, Medical, Software, AI safety, Arabic and Languages (68 languages). Paid in USD, weekly. Apply once, get verified, get matched.
Hiring for an AI lab or data vendor? See our vetted talent bench
Data & AI operations
AI Agent Evaluator, Real-World Task Testing (Remote)
Posted 2 weeks ago · Rolling applications
$20 – $40 / hour · Hourly contract · Remote · Flexible, part-time (10–40 hrs/week)
At a glance
-
$20 – $40 / hourPaid weekly in USD
-
Hourly contractIndependent contractor · Specialist
-
RemoteWork from anywhere with a stable connection.
-
Flexible, part-time (10–40 hrs/week)Choose your own hours.
-
Ongoing, project-based Starts when a matching project opens · Rolling applications
Role overview
Put AI agents through realistic multi-step jobs and judge whether they actually finish them. Your scenarios, ratings and notes show developers where an agent clicks wrong, skips a step or reports success it did not earn.
Key responsibilities
- Write realistic task scenarios for agents that browse, use apps or handle email and calendars
- Watch agent runs and record whether each step and the final result are correct
- Rate outcomes against a rubric and explain every failure in plain language
- Research claims and check data the agent used or produced
Ideal qualifications
- Strong analytical and logical-reasoning skills
- Clear written English and careful attention to detail
- Comfort with everyday web apps, spreadsheets and productivity tools
- Able to follow detailed guidelines and work independently
Compensation and contract terms
- $20 – $40 / hour. Paid weekly in USD. Typical rate $20–$40 per hour, confirmed after a short paid assessment.
- Hourly contract. You are engaged as an independent contractor.
- Remote. Flexible, part-time (10–40 hrs/week), on your own schedule.
- Paid weekly in USD for approved work.
- Projects can be extended, shortened or ended early depending on project needs and quality.
Application process
- ApplyCreate a free profile and upload your CV.
- InterviewAbout 20 minutes. You need a laptop or desktop with a camera and microphone.
- ID and credential checkWe verify your identity and the qualifications the role needs.
- Matched to projectsOnce verified, you are invited to paid projects that fit your skills.
Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.
Browse by field
Browse by language, country or type
Questions
What is the difference between "Hiring now" and "Talent pool"?
Hiring now roles have live work today. Talent pool roles are for client projects we expect to open. Apply now, get verified in advance, and we invite you first when a matching project starts.
How much does it cost to apply?
Nothing. Vettedlance never charges candidates. Assessments for hiring roles are paid.
How and when am I paid?
In US dollars, per task, per page or per hour depending on the project, on a fixed schedule. Your rate is agreed before you start.