Kalasha Linguist for AI Evaluation (MS/MPhil/PhD)

At a glance

• Rate agreed per projectPaid weekly in USD
• Hourly or per-task contractIndependent contractor · Expert
• RemoteWork from anywhere with a stable connection.
• Flexible, part-timeChoose your own hours.
• Ongoing, project-based Starts when a matching project opens · Rolling applications
• KalashaKalasha alphabet (Latin-based) and Perso-Arabic

Role overview

Use your Kalasha expertise to judge, rank and correct AI model outputs, and to write the rubrics that decide what a good answer looks like.

Key responsibilities

• Score AI answers, translations and transcriptions in Kalasha against a rubric
• Rank pairs of model responses and explain your preference (RLHF data)
• Write challenging prompts and reference answers that expose model weaknesses
• Help design guidelines and review the work of other raters

Ideal qualifications

• MS/MPhil or PhD (completed or in progress) in Kalasha, linguistics, literature or a related field, or equivalent published expertise
• Native-level Kalasha and professional written English
• Comfort explaining fine-grained judgements in writing

Nice to have

• Teaching or research experience
• Prior annotation or AI evaluation work

More about the opportunity

Kalasha is spoken by a small community and documented mainly through linguistic fieldwork, which makes native experts essential.

Compensation and contract terms

• Hourly or per task, in USD. Rate set per project.
• Hourly or per-task contract. You are engaged as an independent contractor.
• Remote. Flexible, part-time, on your own schedule.
• Paid weekly in USD for approved work.
• Projects can be extended, shortened or ended early depending on project needs and quality.

Application process

1. ApplyCreate a free profile and upload your CV.
2. InterviewAbout 20 minutes. You need a laptop or desktop with a camera and microphone.
3. ID and credential checkWe verify your identity and the qualifications the role needs.
4. Matched to projectsOnce verified, you are invited to paid projects that fit your skills.

Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.