Hiring for an AI lab or data vendor? See our vetted talent bench

Hiring now

Senior Software Engineer, Agentic Coding Evaluation (Python, C++)

$80 – $120 / hour

Hourly contractRemoteFlexible, part-time (10–40 hrs/week)Paid weekly in USD

At a glance

  • $80 – $120 / hourPaid weekly in USD
  • Hourly contractIndependent contractor · Expert
  • RemoteWork from anywhere with a stable connection.
  • Flexible, part-time (10–40 hrs/week)Choose your own hours.
  • Ongoing, project-based Starts when a matching project opens · Rolling applications

Role overview

Senior engineers review and grade long-horizon, multi-step coding work by AI agents in real repositories.

Key responsibilities

  • Review agent trajectories on multi-file, long-horizon coding tasks and score each step.
  • Write reference solutions and tests in Python or C++.
  • Judge code quality, correctness, security and maintainability against a rubric.
  • Explain the root cause when an agent's fix fails.

Ideal qualifications

  • 5+ years of professional software engineering.
  • Expert in Python or C++.
  • Comfortable reading unfamiliar codebases and writing tests.
  • Fluent written English.

Nice to have

  • Open-source maintainer or contributor record.
  • Systems, performance or security engineering.
  • Code review lead experience.

More about the opportunity

Work is part-time and asynchronous. A paid coding assessment comes before any project work.

Compensation and contract terms

  • $80 – $120 / hour. Paid in USD, weekly. Rate set after a short paid assessment.
  • Hourly contract. You are engaged as an independent contractor.
  • Remote. Flexible, part-time (10–40 hrs/week), on your own schedule.
  • Paid weekly in USD for approved work.
  • Projects can be extended, shortened or ended early depending on project needs and quality.

Application process

  1. ApplyCreate a free profile and upload your CV.
  2. InterviewAbout 20 minutes. You need a laptop or desktop with a camera and microphone.
  3. ID and credential checkWe verify your identity and the qualifications the role needs.
  4. Matched to projectsOnce verified, you are invited to paid projects that fit your skills.

Vetting for this role: Profile and CV review, AI interview in English, proctored (about 20 minutes), Identity check: government ID and liveness, Employment or portfolio verification, Short paid coding assessment and Expert Score.

Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.

Related roles

Now vetting
Software engineers

Hiring now

Paid in USD

Engineering & software

Expert · Open now

Programming Language QA Lead for AI Training (Python, Java, Go)

Hiring now

$70 / hour

Engineering & software

Senior review · Open now

Data Scientist & Data Analyst, AI Model Evaluation

Hiring now

$50 – $60 / hour

Engineering & software

Senior review · Open now

Developer Tool Workflow Recorder (Code Editors, IDEs, API Clients)

Hiring now

$20 / hour

Engineering & software

Specialist · Open now

JavaScript & TypeScript Engineer, AI Code Review (React, Node)

Hiring now

$60 – $90 / hour

Engineering & software

Senior review · Open now

Machine Learning Engineer, AI Evaluation & Benchmarks

Hiring now

$60 – $120 / hour

Engineering & software

Senior review · Open now

All engineering & software roles