Shina Linguist for AI Evaluation (MPhil/PhD)

At a glance

• Paid in USDHourly or per task, in USD. Rate set per project.
• Remote, any timezoneWork from anywhere with a stable connection.
• Flexible, part-timeChoose your own hours.
• Ongoing, project-based Starts when a matching project opens · Rolling applications
• Contract · ExpertMultiple openings
• Shina · شیناPerso-Arabic

What you will do

• Score AI answers, translations and transcriptions in Shina against a rubric
• Rank pairs of model responses and explain your preference (RLHF data)
• Write challenging prompts and reference answers that expose model weaknesses
• Help design guidelines and review the work of other raters

What we are looking for

• MPhil or PhD (completed or in progress) in Shina, linguistics, literature or a related field, or equivalent published expertise
• Native-level Shina and professional written English
• Comfort explaining fine-grained judgements in writing

Nice to have

• Teaching or research experience
• Prior annotation or AI evaluation work

Hiring process

1. Step 1Profile and CV review
2. Step 2AI interview (about 20 minutes)
3. Step 3Identity and credential check
4. Step 4Short paid trial task

Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.