Talent pool ContributorContractRemote

Multilingual Search Relevance Rater

Judge how well search results and AI answers match what a user in your language was actually looking for.

At a glance

  • Paid in USDPer task or per hour, in USD. Rates are shown before you start each project.
  • Remote, any timezoneWork from anywhere with a stable connection.
  • Flexible, part-timeChoose your own hours.
  • Ongoing, project-based Starts when a matching project opens · Rolling applications
  • Contract · ContributorMultiple openings

About the work

Search and retrieval quality drops sharply outside English. Local raters know which sources are trusted and what a query really means.

What you will do

  • Rate results for relevance, freshness and trustworthiness
  • Judge the intent behind short or ambiguous queries
  • Flag spam, low-quality or harmful results
  • Follow detailed rating guidelines

What we are looking for

  • Native fluency in at least one language other than English
  • Professional written English
  • Good awareness of local news, culture and websites
  • A computer and a stable internet connection

Nice to have

  • Prior search or ads rating work
  • Library or research background

Hiring process

  1. Step 1Profile and CV review
  2. Step 2AI interview (about 20 minutes)
  3. Step 3Identity and credential check
  4. Step 4Short paid trial task

Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.

Related roles

Evaluation Rubric Writer

Paid in USD

Data & AI operations

New opportunity

RLHF Preference Rater (Generalist)

Paid in USD

Data & AI operations

New opportunity

AI Red-Teamer (Generalist)

Paid in USD

Data & AI operations

New opportunity

Speech Transcription QA Reviewer

Paid in USD

Data & AI operations

New opportunity

Dialect Audio Transcriber (Urdu, Punjabi, Saraiki)

Paid in USD

Data & AI operations

New opportunity

Subtitle & Caption Specialist

Paid in USD

Data & AI operations

New opportunity

All data & ai operations roles