About this role
Job title: Senior Software Engineers
About the Role Join Mercor in helping advance the next generation of AI models by participating in a cutting-edge AI evaluation project. This is not a software development role; you will leverage your software engineering expertise to evaluate AI-generated solutions and help improve the capabilities of state-of-the-art coding models. The project runs for approximately one week with an expected commitment of at least 10 hours. Candidates must be located in the US or Canada due to the need for real-time collaboration with the project team.
What You'll Do
- Become familiar with assigned open-source codebases and their engineering practices
- Review code changes, technical discussions, and related software artifacts
- Evaluate AI-generated code for correctness, quality, maintainability, and engineering best practices
- Provide structured evaluations with clear technical reasoning
- Collaborate with fellow technical reviewers to ensure high-quality and consistent evaluations
What We're Looking For
- 3+ years of professional software engineering experience (or equivalent open-source experience)
- Technical Expertise: JavaScript / TypeScript: Node.js, React, TypeScript, modern web application development; Go: Backend services, distributed systems, REST/gRPC APIs, cloud-native development; Python: Backend development, open-source libraries, DevOps/infrastructure automation, testing frameworks
- Software Engineering Experience working with large production codebases; Ability to quickly understand unfamiliar repositories and software architectures; Experience reviewing code for readability, maintainability, and software design; Strong engineering judgment and a solid understanding of software engineering best practices
- GitHub & Open Source: Strong understanding of Git and GitHub workflows; Experience navigating open-source repositories and collaborating through GitHub; Familiarity with open-source development workflows is highly preferred; Familiarity with SWE-Bench or SWE-Bench Pro is a plus
- Communication: Strong English communication skills
Compensation & Benefits
- Contract and Payment Terms: You will be engaged as an independent contractor. This is a fully remote role that can be completed on your own schedule. Projects can be extended, shortened, or concluded early depending on needs and performance. Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are weekly based on services rendered.
- Visa: We are unable to support H1-B or STEM OPT candidates at this time.
- About Mercor: Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.
- Salary: $50 - $75 per hour; USD; remote contract
- Referral program: Earn up to $480 by referring others