About this role
This role is for one of our clients
Pay: 150–200/hour
Role Type: Contractor
Location: Remote
We are seeking a motivated and detail-oriented Junior Software Engineer to contribute to the evaluation and improvement of advanced artificial intelligence systems. This opportunity is ideal for early-career software engineers with strong programming fundamentals, analytical thinking, and practical experience developing and reviewing software applications.
In this role, you will evaluate AI-generated code for correctness, quality, efficiency, and design. You will create challenging programming problems, develop reference solutions and test cases, and assess AI models' ability to solve real-world software engineering challenges. You will also review technical reasoning related to debugging, architecture, and system design, providing structured feedback to improve the reliability and performance of AI-generated solutions.
The ideal candidate has professional software engineering experience, a solid understanding of programming principles, and the ability to explain technical decisions clearly. Prior experience in artificial intelligence is not required.
Requirements
Key Responsibilities
-
AI-Generated Code Evaluation: Review AI-generated code for functional correctness, readability, maintainability, efficiency, and adherence to software engineering best practices.
-
Coding Problem Development: Design challenging programming problems that assess algorithmic thinking, debugging skills, implementation quality, and practical engineering judgment.
-
Reference Solution Creation: Develop accurate, well-structured reference solutions that demonstrate effective approaches to solving software engineering problems.
-
Test Case Development: Create comprehensive test cases to validate functionality, identify edge cases, and detect incomplete or incorrect implementations.
-
Technical Reasoning Assessment: Evaluate AI-generated explanations and decisions involving software architecture, system design, debugging, and implementation strategies.
-
Code Quality Analysis: Identify bugs, inefficient algorithms, poor design choices, security concerns, and violations of established coding standards.
-
Technical Feedback: Provide detailed, actionable feedback explaining errors, weaknesses, and opportunities to improve code quality and model performance.
-
Documentation: Clearly document problem requirements, expected behavior, solution approaches, testing procedures, and technical evaluation findings.
-
Quality Assurance: Ensure that coding tasks, reference solutions, and evaluation criteria are accurate, consistent, and reproducible.
-
Required Qualifications
-
At least one year of professional experience as a software engineer at a well-established technology company.
-
At least part of the relevant professional experience should have been gained within the past three years.
-
Strong understanding of programming fundamentals, data structures, algorithms, and object-oriented programming.
-
Practical experience writing, debugging, testing, and reviewing code.
-
Familiarity with software development practices, including version control, code reviews, testing, and debugging.
-
Ability to assess code for correctness, performance, readability, and maintainability.
-
Foundational understanding of software architecture and system design principles.
-
Strong analytical and problem-solving skills.
-
Excellent written communication skills, with the ability to explain technical decisions and complex engineering concepts clearly.
-
Ability to work independently and deliver accurate, high-quality technical assessments.
-
Must-Have Skills
-
Software Engineering Fundamentals
-
Programming and Coding
-
Data Structures and Algorithms
-
Code Review and Quality Assessment
-
Debugging and Troubleshooting
-
Automated Testing and Test Case Development
-
Problem-Solving and Logical Reasoning
-
Technical Documentation and Written Communication
-
Good-to-Have Skills
-
Python, Java, C++, JavaScript, TypeScript, Go, or similar programming languages
-
Object-Oriented Programming and Design Patterns
-
API Development and Backend Engineering
-
Software Architecture and System Design
-
Performance Optimization and Profiling
-
Git and Version Control
-
Unit Testing and Integration Testing
-
CI/CD and Software Development Workflows
-
AI-Generated Code Evaluation
-
Familiarity with AI coding assistants and model benchmarking
-
Preferred Qualifications
-
Professional software engineering experience at a recognized technology company.
-
Experience developing and maintaining production-quality applications, services, or APIs.
-
Familiarity with reviewing complex codebases and identifying implementation weaknesses.
-
Experience designing coding exercises, technical assessments, or automated evaluation tests.
-
Candidates based in English-speaking countries are preferred.
-
Ability to communicate technical findings in clear, structured, and concise English.