Urdu Linguist for AI Evaluation (MS/MPhil/PhD)

At a glance

• Rate agreed per projectPaid weekly in USD
• Hourly or per-task contractIndependent contractor · Expert
• RemoteWork from anywhere with a stable connection.
• Flexible, part-timeChoose your own hours.
• Ongoing, project-based Starts when a matching project opens · Rolling applications
• Urdu · اردوNastaliq (Perso-Arabic)

Role overview

Use your Urdu expertise to judge, rank and correct AI model outputs, and to write the rubrics that decide what a good answer looks like.

Key responsibilities

• Score AI answers, translations and transcriptions in Urdu against a rubric
• Rank pairs of model responses and explain your preference (RLHF data)
• Write challenging prompts and reference answers that expose model weaknesses
• Help design guidelines and review the work of other raters

Ideal qualifications

• MS/MPhil or PhD (completed or in progress) in Urdu, linguistics, literature or a related field, or equivalent published expertise
• Native-level Urdu and professional written English
• Comfort explaining fine-grained judgements in writing

Nice to have

• Teaching or research experience
• Prior annotation or AI evaluation work

More about the opportunity

Historical Urdu is written by hand-trained scribes in Nastaliq, where letters stack diagonally and diacritics decide meaning. It is the script frontier models misread most often in our benchmark.

Compensation and contract terms

• Hourly or per task, in USD. Rate set per project.
• Hourly or per-task contract. You are engaged as an independent contractor.
• Remote. Flexible, part-time, on your own schedule.
• Paid weekly in USD for approved work.
• Projects can be extended, shortened or ended early depending on project needs and quality.

Application process

1. ApplyCreate a free profile and upload your CV.
2. InterviewAbout 20 minutes. You need a laptop or desktop with a camera and microphone.
3. ID and credential checkWe verify your identity and the qualifications the role needs.
4. Matched to projectsOnce verified, you are invited to paid projects that fit your skills.

Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.