About this role
About the Role The AI Quality Assurance Expert is responsible for ensuring the accuracy, reliability, safety, compliance, and operational performance of AI solutions across MANN+HUMMEL, supporting reliable business decision-making and trusted deployment of AI-enabled solutions. What You'll Do
- Ensure accuracy, reliability, performance, and compliance of AI models and systems across development, testing, deployment, operational use, and feature enhancement
- Develop and execute test plans and validation frameworks for AI products, ML solutions, LLM applications, and agentic systems
- Design and operate automated tests integrated into MLOps and LLM delivery pipelines
- Define acceptance criteria and quality gates for AI systems, including functional quality, robustness, consistency, explainability, and operational readiness
- Design and maintain telemetry, observability, and monitoring for AI behavior, including drift detection, anomaly detection, output degradation, and compliance incident tracking
- Maintain traceable validation evidence, documentation, and audit ready records for test execution, deviations, decisions, and approvals
- Collaborate with cross-functional stakeholders to align quality requirements, test scope, release readiness, and ongoing improvement actions What We're Looking For
- Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, Information Technology, Artificial Intelligence, or a related field
- Professional Experience: 5-10 years of relevant experience in software testing, quality assurance, test automation, or validation of digital products; experience validating ML or LLM-based solutions strongly preferred
- Expertise: Clear and effective communication with cross-functional teams, including senior business stakeholders and Product Owners; strong planning, prioritization, and documentation skills; high attention to detail and quality orientation
- AI-specific skills: Deep understanding of ML lifecycle, LLM architectures, agentic systems, and model validation concepts; familiarity with AI/datastack and MLOps tooling; understanding AI risks such as hallucination, drift, bias, prompt injection, and unreliable automation behavior
- Technical Skills: Working proficiency in Python; ability to review, understand, and assess Python-based test, validation, and evaluation code; proficiency with test and automation frameworks; experience with version control, defect tracking, and structured test documentation
- Language: Very good English skills; German is a plus
- Personality: Cross-team stakeholder collaboration; ability to balance speed, risk, and quality in a dynamic technology environment; quality oriented with continuous improvement mindset Nice to Have
- German language skills (German is a plus) Compensation & Benefits
- 35 hours per week with flexitime or trust-based working hours plus 30 days of vacation
- Hybrid working option (4 days in Ludwigsburg, 1 day mobile; for children under 12, 3 days in Ludwigsburg, 2 days mobile)
- Talent management process supports professional development
- Company restaurant
- Private daycare center nearby
- Modern company pension plan to supplement statutory pension
- Additional private health insurance (e.g., supplementary dental insurance)
- Discounts in corporate benefits portal (vacations, fashion, insurance, etc.)
- Mobility offers: subsidy for the Deutschlandticket, JobRad leasing, and e-charging stations in the free parking garage with company charging rates