Hourly contract·Remote·Flexible, part-time (10–40 hrs/week)·Paid weekly in USD
At a glance
$80 – $120 / hourPaid weekly in USD
Hourly contractIndependent contractor · Expert
RemoteWork from anywhere with a stable connection.
Flexible, part-time (10–40 hrs/week)Choose your own hours.
Ongoing, project-based
Starts when a matching project opens
· Rolling applications
Role overview
Senior engineers review and grade long-horizon, multi-step coding work by AI agents in real repositories.
Key responsibilities
Review agent trajectories on multi-file, long-horizon coding tasks and score each step.
Write reference solutions and tests in Python or C++.
Judge code quality, correctness, security and maintainability against a rubric.
Explain the root cause when an agent's fix fails.
Ideal qualifications
5+ years of professional software engineering.
Expert in Python or C++.
Comfortable reading unfamiliar codebases and writing tests.
Fluent written English.
Nice to have
Open-source maintainer or contributor record.
Systems, performance or security engineering.
Code review lead experience.
More about the opportunity
Work is part-time and asynchronous. A paid coding assessment comes before any project work.
Compensation and contract terms
$80 – $120 / hour. Paid in USD, weekly. Rate set after a short paid assessment.
Hourly contract. You are engaged as an independent contractor.
Remote. Flexible, part-time (10–40 hrs/week), on your own schedule.
Paid weekly in USD for approved work.
Projects can be extended, shortened or ended early depending on project needs and quality.
Application process
ApplyCreate a free profile and upload your CV.
InterviewAbout 20 minutes. You need a laptop or desktop with a camera and microphone.
ID and credential checkWe verify your identity and the qualifications the role needs.
Matched to projectsOnce verified, you are invited to paid projects that fit your skills.
Vetting for this role: Profile and CV review, AI interview in English, proctored (about 20 minutes), Identity check: government ID and liveness, Employment or portfolio verification, Short paid coding assessment and Expert Score.
Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.
Related roles
Now vetting Software engineers
Hiring now
Paid in USD
Engineering & software
Expert · Open now
Programming Language QA Lead for AI Training (Python, Java, Go)
Hiring now
$70 / hour
Engineering & software
Senior review · Open now
Data Scientist & Data Analyst, AI Model Evaluation
Hiring now
$50 – $60 / hour
Engineering & software
Senior review · Open now
Developer Tool Workflow Recorder (Code Editors, IDEs, API Clients)
Hiring now
$20 / hour
Engineering & software
Specialist · Open now
JavaScript & TypeScript Engineer, AI Code Review (React, Node)
Hiring now
$60 – $90 / hour
Engineering & software
Senior review · Open now
Machine Learning Engineer, AI Evaluation & Benchmarks