About this role
About the Role Senior ETL & Cloud Engineer responsible for Solventum’s data movement and cloud foundations—designing resilient pipelines, enforcing data contracts and observability, and engineering secure, scalable AWS infrastructure. You will partner with product, analytics, and security to deliver trustworthy, timely, and compliant data for clinical operations and analytics. What You'll Do
- Design and own end-to-end ELT/ETL pipelines using Python/PySpark on AWS and other clouds; implement dbt models; define staging, marts, and semantic layers with automated tests to ensure trusted curated datasets.
- Establish data quality, observability (logs/metrics/alerts), SLAs/SLOs, and cost/performance optimization; author runbooks and drive incident response.
- Build and manage multi-account AWS foundations: VPCs, IAM least-privilege policies, private endpoints, and encryption with KMS; implement Infrastructure as Code with Terraform (or CloudFormation/AWS CDK); enable CI/CD with policy guardrails.
- Engineer compute patterns across EKS/ECS and serverless (Lambda/EventBridge/SQS/SNS); support blue/green or canary deployments; implement observability with CloudWatch/CloudTrail/OpenSearch/Prometheus; publish dashboards and alerts; participate in on-call rotations.
- Design resilience (multi-AZ/Region) with tested backup/DR and runbooks; optimize cost via tagging, rightsizing, and storage tiering.
- Drive architecture decisions aligned to reference designs and retention policies; curate reusable patterns; partner with product/analysts/InfoSec to translate requirements into robust data flows and clearly documented data contracts. What We're Looking For
- Bachelor’s degree in CS/IS/Engineering or High School Diploma/GED with 9+ years of professional data engineering/ETL experience.
- 6+ years designing, building, and operating production ETL/ELT pipelines using Python (preferably PySpark) and SQL.
- 4+ years with AWS (S3, Glue, Redshift) or Snowflake + dbt for ELT, orchestrated by Airflow.
- 3+ years hands-on AWS across compute/networking/storage/security (EC2/EKS/ECS/Lambda, VPC, S3, RDS/Aurora, IAM, API Gateway).
- 3+ years with Infrastructure as Code (Terraform preferred; CloudFormation/AWS CDK acceptable) and CI/CD for apps and infra; practical observability experience. Nice to Have
- Spark & SQL performance tuning (partitioning/file sizing, broadcast, Z-order/clustering, warehouse sizing).
- Data modeling (dimensional, Data Vault), contract-first design, curated datasets with clear SLOs.
- Streaming/CDC (Kinesis/Kafka) and schema-evolution strategies.
- Security-by-design (secrets management, access controls, encryption, retention/lifecycle).
- Healthcare standards (HL7 v2.x, FHIR); AWS/dbt/Snowflake certifications.