Talent Apply
Log in
All jobs
A

Principal AI/ML Engineer - AI Safety & Evaluation

A10
San Jose, California
On-siteUSD 225,000 - 245,000 / year

About this role

Principal AI/ML Engineer - AI Safety & Evaluation

About the Team We’re building a future where AI systems are not only powerful but safe, aligned, and robust against misuse. Our team focuses on advancing practical safety techniques for large language models (LLMs) and multimodal systems—ensuring these models remain aligned with human intent and resist attempts to produce harmful, toxic, or policy-violating content.

We operate at the intersection of model development and real-world deployment, with a mission to build systems that can proactively detect and prevent jailbreaks, toxic behaviors, and other forms of misuse. Our work blends applied research, systems engineering, and evaluation design to ensure safety is built into our models at every layer.

About the Role

We’re looking for a Principal Engineer to lead the technical strategy and architecture for protecting foundation models against misuse—such as jailbreaks, prompt injection, toxic outputs, and custom policy violations. In this role, you’ll apply your expertise in scalable systems design, applied machine learning, and model-level defenses to build core infrastructure that ensures AI systems behave safely and responsibly in production. You’ll set technical direction and drive architectural decisions across a broad surface area of AI safety systems—designing safety interventions, integrating evaluation workflows, and developing models and tooling that detect and prevent harmful or non-compliant behavior. This role is ideal for someone who wants to work at the intersection of model behavior, product safety, and system engineering.

What You’ll Do

  • Architect and lead the development of model-level defenses against jailbreaks, prompt injection, and custom policy violations

  • Define and drive evaluation strategies, including adversarial testing and stress-testing pipelines, to identify safety weaknesses before deployment

  • Set technical direction for scalable mitigation techniques such as safety-focused fine-tuning, prompt shielding, and post-processing methods to reduce harmful or non-compliant outputs

  • Collaborate with red teamers and researchers to convert emerging threats into measurable evaluations and system-level safeguards

  • Scale and improve human-in-the-loop pipelines for detecting toxic, biased, or non-compliant outputs

  • Stay up to date with LLM safety research, jailbreak tactics, and adversarial trends, and apply insights to real-world defenses

  • What We’re Looking For

  • 7+ years of experience in applied machine learning, AI infrastructure, or safety-critical systems, with 3+ years in a senior or staff-level technical leadership role

  • Deep understanding of transformer-based architectures and experience building

Your next opportunity starts here

Prepare, apply, track, interview and get hired — all from one platform, with AI in your corner.

Download app

Or sponsor Premium for someone who's job hunting →