Hiring for an AI lab or data vendor? See our vetted talent bench

Talent pool

PhD Benchmark Question Writer

Rate agreed per project

Hourly or per-task contractRemoteFlexible, part-timePaid weekly in USD

At a glance

  • Rate agreed per projectPaid weekly in USD
  • Hourly or per-task contractIndependent contractor · Expert
  • RemoteWork from anywhere with a stable connection.
  • Flexible, part-timeChoose your own hours.
  • Ongoing, project-based Starts when a matching project opens · Rolling applications

Role overview

Write original, hard questions in your field that current AI models cannot answer, with fully worked solutions.

Key responsibilities

  • Write graduate-level questions with a single, verifiable answer
  • Provide full reasoning and sources for each answer
  • Test questions against models and revise ones that are too easy
  • Review questions written by other experts

Ideal qualifications

  • PhD, or doctoral candidate, in any academic field
  • Ability to write clear, unambiguous questions
  • Professional written English
  • Honesty about the limits of your own expertise

Nice to have

  • Published research or teaching at university level
  • Expertise in a field underrepresented in current benchmarks

More about the opportunity

As models pass older tests, labs need new questions that only specialists can write and check. Original, unpublished questions are the only reliable measure.

Compensation and contract terms

  • Hourly or per task, in USD. Your rate is agreed per project.
  • Hourly or per-task contract. You are engaged as an independent contractor.
  • Remote. Flexible, part-time, on your own schedule.
  • Paid weekly in USD for approved work.
  • Projects can be extended, shortened or ended early depending on project needs and quality.

Application process

  1. ApplyCreate a free profile and upload your CV.
  2. InterviewAbout 20 minutes. You need a laptop or desktop with a camera and microphone.
  3. ID and credential checkWe verify your identity and the qualifications the role needs.
  4. Matched to projectsOnce verified, you are invited to paid projects that fit your skills.

Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.

Related roles

Video and Sensor Data Annotator for Robotics

Hiring now

Paid in USD

Data & AI operations

Contributor · Open now

Dialect Audio Transcriber (Urdu, Punjabi, Saraiki)

Hiring now

Paid in USD

Data & AI operations

Transcription · Open now

Annotation Team Lead

Hiring now

Paid in USD

Data & AI operations

Senior review · Open now

RL Environment Task Author

Hiring now

$70 – $100 / hour

Data & AI operations

Expert · Open now

GenAI Evaluator, Generalist (US and Canada)

Hiring now

$30 – $50 / hour

Data & AI operations

Contributor · Open now

Evaluation QA Lead (Agentic and RAG Evaluation)

Hiring now

$60 – $90 / hour

Data & AI operations

Senior review · Open now

All data & ai operations roles