AI Engineer – AI Ops (Monitoring AI Systems in Production)

AI Engineer – AI Ops (Monitoring AI Systems in Production)

Role purpose

An AI Engineer in AI Ops & Governance is responsible for operating, monitoring, and maintaining AI models and agent-based systems once they are live in production. The role ensures AI systems remain reliable, performant, compliant, and aligned with business expectations over time, closing the “last‑mile” gap between model development and sustainable production use

Key Responsibilities

• Production Monitoring & Health

• Monitor AI models and agents in production for performance, latency, errors, and availability.

• Track statistical health indicators such as model drift, data distribution changes, and output stability.

• Observe business KPIs linked to AI behaviour (e.g. accuracy impact, false‑positive cost, efficiency).

• Incident Management & Recovery

• Detect and triage production incidents related to AI behaviour or degradation.

• Execute rollbacks, throttling, or model disabling where thresholds are breached.

• Support root‑cause analysis and post‑incident reviews to prevent recurrence.

• Model & Agent Lifecycle Operations

• Support deployment, versioning, and relea