About this role
IT engineer Data & Analytics DevOps
Job Description
Job Description
▪ Design, build, and operate a stable, scalable, and secure data platform infrastructure on Azure, including Databricks, CI/CD systems, and Power BI integration.
▪ Take ownership of platform infrastructure, deployment automation, and reliability engineering by reducing manual operations through automation and engineering solutions.
▪ Enable and continuously improve the reliable execution of data pipelines by implementing observability, monitoring, and automated recovery mechanisms.
▪ Build and evolve Infrastructure-as-Code-based platform provisioning and configuration management.
▪ Collaborate with software engineers, ML engineers, and architects to ensure platform capabilities align with development and architectural standards.
Main Tasks
Platform Engineering & Infrastructure
▪ Design, build, and operate Azure-based platform infrastructure using Infrastructure-as-Code (Terraform).
▪ Automate provisioning, configuration, and scaling of platform components (AKS, Key Vault, Monitor, Storage).
▪ Automate and manage Databricks workspace configuration, access control, and cluster policies.
▪ Define and enforce platform standards for cluster usage, performance, and cost optimization.
CI/CD & Automation
▪ Design and implement CI/CD pipelines for Scala-based data applications.
▪ Automate build, packaging, and deployment processes (e.g., SBT, github enterprise).
▪ Enforce DevSecOps practices, including secure pipeline design and infrastructure governance.
Reliability Engineering & Observability
▪ Implement observability for data pipelines and platform components (logging, metrics, alerting), using grafana.
▪ Diagnose failures and implement long-term reliability improvements, including root cause analysis and post-incident remediation.
▪ Define and implement reliability engineering practices, including SLIs/SLOs, incident response, and automated recovery mechanisms.
▪ Monitor Spark workloads using logs, metrics, and performance diagnostics.
Data Platform Enablement
▪ Enable reliable runtime execution of production data pipelines and ensure SLA adherence.
▪ Collaborate with engineers to resolve performance bottlenecks and deployment issues.
▪ Support environment transitions, and platform lifecycle processes.
Power BI Platform Integration
▪ Engineer and automate Power BI service configuration, workspace management, and monitoring.
▪ Design and operate enterprise gateway infrastructure for hybrid data integration scenarios.
▪ Troubleshoot and continuously improve reliability of dataset refresh and hybrid integration pipelines.
Governance & Security
▪ Implement and enforce platform governance standards (RBAC, tagging, audit logging).
▪ Design secure secrets and credential management using Azure Key Vault, managed identities, and federated identity credentials.
▪ Automate compliance checks and support platform audits across Azure, Databricks, and Power BI environments.
Platform Optimization
▪ Optimize resource utilization, scalability, and cost-efficiency across platform components.
▪ Provide transparency into platform usage, cost drivers, and optimization opportunities.
Qualifications
-
Degree in Computer Science, Engineering, Information Systems, or a related field.
-
Minimum 5 years of experience in platform engineering, DevOps, or SRE roles, with a strong focus on automation and infrastructure engineering.
-
Strong hands-on experience with cloud platforms (Azure preferred), Infrastructure-as-Code (Terraform/Bicep), and CI/CD pipelines.
-
Experience designing and operating production-grade data platforms and pipeline ecosystems (Scala / Spark environments).
-
Strong understanding of distributed systems, reliability engineering, and observability practices.
-
Experience with Databricks platform operations and Spark workload optimization.
-
Experience integrating build and deployment pipelines (e.g., SBT, github enterprise).
-
Experience with Power BI service administration and enterprise gateway architectures is a plus.
-
Strong focus on automation-first approaches with minimal reliance on manual operations.
-
Ability to work across global teams and collaborate with engineers, architects, and business stakeholders.
Experience
-
Manual system or platform administration without automation or Infrastructure-as-Code
-
Ticket-based operations or L2/L3 support roles
-
BI/reporting-focused roles or Power BI-only administration
-
Additional Information
The well-being of our employees is important to us. That's why we offer exciting career prospects and support you in achieving a good work-life balance with additional benefits such as:
-
Training opportunities
-
Mobile and flexible working models
-
Sabbaticals
-
and much more...