Description as posted by Mercor:
Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness — and provide clear, rubric-based written feedback.
Basic Qualifications
- 3+ years hands-on experience building multi-service AWS serverless applications (Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, Step Functions)
- Strong experience with infrastructure-as-code (AWS CDK, CloudFormation, or SAM)
- Demonstrated ability to assess event-driven architecture correctness, IAM/permission boundaries, and failure/retry semantics
- Familiarity with local emulation/testing fidelity (e.g., LocalStack) versus real AWS behavior
Preferred Qualifications
- AWS certifications (Solutions Architect / Developer)
- Experience with observability and cost-optimization for serverless workloads
- Prior code-review or task-grading experience
About Mercor
Mercor connects experienced professionals with AI labs that need people to evaluate, write and correct model output, in fields from medicine and law to software and languages.
How applying works: You apply with your CV, then take a short AI-led interview whenever it suits you.
All Mercor jobs →