Evaluation Rubric Writer

At a glance

• Rate agreed per projectPaid weekly in USD
• Hourly or per-task contractIndependent contractor · Specialist
• RemoteWork from anywhere with a stable connection.
• Flexible, part-timeChoose your own hours.
• Ongoing, project-based Starts when a matching project opens · Rolling applications

Role overview

Write clear scoring rubrics that let reviewers grade AI responses consistently, whatever the subject.

Key responsibilities

• Turn a task description into specific, testable scoring criteria
• Write worked examples of good, borderline and failing answers
• Pilot rubrics with reviewers and fix points of disagreement
• Keep rubrics versioned and documented

Ideal qualifications

• Excellent written English and structured thinking
• Experience writing marking schemes, style guides or test specifications
• Ability to explain judgement calls in plain words
• Attention to detail

Nice to have

• Teaching, examining or assessment design background
• Prior AI evaluation work

More about the opportunity

An evaluation is only as good as its rubric. Vague criteria give noisy scores, and noisy scores tell a model builder nothing.

Compensation and contract terms

• Hourly or per task, in USD. Your rate is agreed per project.
• Hourly or per-task contract. You are engaged as an independent contractor.
• Remote. Flexible, part-time, on your own schedule.
• Paid weekly in USD for approved work.
• Projects can be extended, shortened or ended early depending on project needs and quality.

Application process

1. ApplyCreate a free profile and upload your CV.
2. InterviewAbout 20 minutes. You need a laptop or desktop with a camera and microphone.
3. ID and credential checkWe verify your identity and the qualifications the role needs.
4. Matched to projectsOnce verified, you are invited to paid projects that fit your skills.

Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.