العربية Join the community
← Back to all jobs
Mercor

AI Developer Trace Task Auditor

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions…

Description as posted by Mercor:

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.

Basic Qualifications

  • 3+ years professional software development
  • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
  • Strong code-reading and debugging skills across full-stack or backend systems
  • Ability to evaluate multi-step coding trajectories for correctness and best practice

Preferred Qualifications

  • Experience with Kiro or Amazon CodeCatalyst
  • Prior work evaluating or grading AI-generated code
  • Contributions to developer tooling

About Mercor

Mercor connects experienced professionals with AI labs that need people to evaluate, write and correct model output, in fields from medicine and law to software and languages.

How applying works: You apply with your CV, then take a short AI-led interview whenever it suits you.

All Mercor jobs →