Evaluation Rubric Writer
Paid in USD
Data & AI operations
New opportunity
Talent pool ContributorContractRemote
RLHF Preference Rater (Generalist)
Compare pairs of AI responses, choose the better one and explain why. Flexible, remote work with clear guidelines and quality checks.
At a glance
-
Paid in USDPer task or per hour, in USD. Rates are shown before you start each project.
-
Remote, any timezoneWork from anywhere with a stable connection.
-
Flexible, part-timeChoose your own hours.
-
Ongoing, project-based Starts when a matching project opens · Rolling applications
-
Contract · ContributorMultiple openings
About the work
Preference data teaches models what people find helpful, honest and safe. Careful, well-reasoned choices matter more than volume.
What you will do
- Read a prompt and two or more model responses
- Choose the better response against written guidelines
- Write a short, specific reason for each choice
- Hit quality targets checked by reviewers
What we are looking for
- Professional written English
- Good general knowledge and sound judgement
- Ability to follow detailed guidelines
- A computer and a stable internet connection
Nice to have
- A degree in any subject
- Prior AI training or annotation work
Hiring process
- Step 1Profile and CV review
- Step 2AI interview (about 20 minutes)
- Step 3Identity and credential check
- Step 4Short paid trial task
Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.
Related roles
AI Red-Teamer (Generalist)
Paid in USD
Data & AI operations
New opportunity
Multilingual Search Relevance Rater
Paid in USD
Data & AI operations
New opportunity
Speech Transcription QA Reviewer
Paid in USD
Data & AI operations
New opportunity
Dialect Audio Transcriber (Urdu, Punjabi, Saraiki)
Paid in USD
Data & AI operations
New opportunity
Subtitle & Caption Specialist
Paid in USD
Data & AI operations
New opportunity