Senior Software Engineer, Agentic Coding Evaluation (Python, C++)

At a glance

• $80 – $120 / hourPaid in USD, weekly. Rate set after a short paid assessment.
• Remote, any timezoneWork from anywhere with a stable connection.
• Hourly contract · paid weekly in USD · remoteChoose your own hours.
• Ongoing, project-based Starts when a matching project opens · Rolling applications
• Contract · ExpertMultiple openings · Client: AI labs and data vendors

What you will do

• Review agent trajectories on multi-file, long-horizon coding tasks and score each step.
• Write reference solutions and tests in Python or C++.
• Judge code quality, correctness, security and maintainability against a rubric.
• Explain the root cause when an agent's fix fails.

What we are looking for

• 5+ years of professional software engineering.
• Expert in Python or C++.
• Comfortable reading unfamiliar codebases and writing tests.
• Fluent written English.

Nice to have

• Open-source maintainer or contributor record.
• Systems, performance or security engineering.
• Code review lead experience.

Hiring process

1. Step 1Profile and CV review
2. Step 2AI interview in English, proctored (about 20 minutes)
3. Step 3Identity check: government ID and liveness
4. Step 4Employment or portfolio verification
5. Step 5Short paid coding assessment and Expert Score

Free to apply. Vettedlance never charges candidates, and will never ask you to pay for training, tests or equipment.