AI Developer Trace Task Auditor
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Developer Trace Task Auditor
Type: Contract
Compensation: $70–$90/hour
Location: Remote
Role Responsibilities
- Evaluate the quality and correctness of AI-assisted software-development traces to enhance model training and evaluation.
- Assess end-to-end coding sessions produced with AI-assisted developer tools for correctness, workflow soundness, and reasoning.
- Provide clear, rubric-based written feedback to improve AI model outputs .
- Review complex coding trajectories for alignment with best practices and correctness.
- Collaborate with AI research teams to ensure consistency and relevance in training data.
- Work independently and asynchronously to meet deadlines while enhancing AI model performance .
Qualifications
Must-Have
- 3+ years professional software development.
- Hands-on experience with AI-assisted coding tools and agentic/spec-driven workflows ( Cursor , GitHub Copilot , Claude Code , or similar).
- Strong code-reading and debugging skills across full-stack or backend systems.
- Ability to evaluate multi-step coding trajectories for correctness and best practice.
Preferred
- Experience with Kiro or Amazon CodeCatalyst .
- Prior work evaluating or grading AI-generated code .
- Contributions to developer tooling .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
-
AI Code Auditor – Real-World Engineering Tasks
7 hours ago
San Francisco, CA, United States Planet Pharma Full-timePlanet Pharma is seeking an AI Trainer – Coding in San Francisco, CA, to design and evaluate realistic software engineering tasks for AI agents. You will craft scenarios from your practice, including bug fixes, specs, and PR reviews, then run them through frontier AI agents and judge outputs against a professional standard.The role is on-site in San...
-
AI Developer Trace Task Auditor
2 weeks ago
San Francisco, CA, San Francisco County, CA; California, United States Mercor Full-timeJob Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ,
-
AI Software Developer
2 days ago
San Diego, CA, United States Booz Allen Hamilton Full-timeJob Number: R0246508 AI Software Developer The Opportunity: Are you looking to bring strong hands-on technical skills , including sof tware and integration, to cybersecurity and mission challenges affecting Navy efforts in the San Diego region? Our team is a skilled group that partners deeply with clients and mission stakeholders: we clarify the problem,...
-
San Diego, CA, United States Booz Allen Hamilton Full-timeJob Number: R0246508 AI Software Developer The Opportunity: Are you looking to bring strong hands-on technical skills , including sof tware and integration, to cybersecurity and mission challenges affecting Navy efforts in the San Diego region? Our team is a skilled group that partners deeply with clients and mission stakeholders: we clarify the problem,...
-
AI Developer
3 days ago
San Francisco, CA, United States Mercor Full-timeJob DescriptionJob DescriptionAbout the jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter
-
San Diego, CA, United States Booz Allen Hamilton Full-timeJob Number: R0246505 AI Software Developer, Senior The Opportunity: Are you looking to bring strong hands-on technical skills , including sof tware and integration, to cybersecurity and mission challenges affecting Navy efforts in the San Diego region? Our team is a skilled group that partners deeply with clients and mission stakeholders: we clarify the...
-
Agent Operations Engineer
2 days ago
San Francisco, CA, United States Mercor Full-timeMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack
-
Middle Backend Developer
2 days ago
San Jose, CA, United States Bear Claw Full-timeBear Claw is an AI-powered recruiting and applicant tracking platform built to help recruiters work smarter and place top talent faster. Our platform brings the entire recruiting workflow into one system — from candidate and job management to team collaboration, sourcing, and outreach. At the center is Cora, our conversational AI assistant, which uses...
-
AI Support Engineer
3 days ago
San Francisco, CA, United States Cognition (Software Development Applications) Full-timeWe are an applied AI lab building end-to-end software agents. We're the makers of Devin, the first AI software engineer. Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub,...
-
Middle Backend Developer
2 days ago
San Diego, CA, United States Bear Claw Full-timeBear Claw is an AI-powered recruiting and applicant tracking platform built to help recruiters work smarter and place top talent faster. Our platform brings the entire recruiting workflow into one system — from candidate and job management to team collaboration, sourcing, and outreach. At the center is Cora, our conversational AI assistant, which uses...