Lead Data Architecture Engineer (Cloud)

About the Role Lead Data Architecture Engineer (Cloud) at Sngular focused on designing and implementing cloud-based data solutions. The project is currently built on AWS, with strong interest in candidates having Microsoft Azure or Google Cloud Platform (GCP) experience. You will lead architecture for data lake layers and drive governance across environments. What You'll Do

• Design and build the Gold layer of the Data Lake following the Medallion Architecture on AWS.
• Design the architecture for the Silver and Gold layers, including partitioning, versioning, incremental processing, and large-scale data storage strategies.
• Build and maintain data transformation pipelines using AWS Glue and PySpark.
• Orchestrate data workflows using AWS Step Functions, implementing state machines focused on reliability and traceability.
• Implement Data DevOps practices, including Infrastructure as Code (IaC) with Terraform or the AWS SDK, as well as CI/CD pipelines and schema versioning.
• Define and enforce data quality, data lineage, and metadata management standards.
• Ensure backward compatibility with existing ingestion contracts in the Bronze/RAW layer.
• Provide technical leadership to the team and foster knowledge sharing and mentoring. What We're Looking For
• Strong expertise in data architecture, technical leadership, and the ability to adapt to different technology environments.
• Proficiency in Python (Advanced).
• Experience with AWS (Advanced) or Microsoft Azure or GCP (Advanced).
• Spark (Advanced).
• Experience with AWS Glue, PySpark, and AWS Step Functions.
• Knowledge of Infrastructure as Code (Terraform or AWS SDK) and CI/CD pipelines, as well as schema versioning.
• Understanding of data quality, data lineage, and metadata management.
• Ability to ensure backward compatibility with Bronze/RAW ingestion contracts. Nice to Have
• Experience with Microsoft Azure or Google Cloud Platform (GCP).
• Prior experience with Medallion Architecture, data lake design, and data ingestion contracts.
• Familiarity with Terraform or other IaC tools. Compensation & Benefits
• Life Insurance
• Major Medical Insurance
• Minor Medical Insurance
• Free unlimited access to UDEMY
• Access to continuous training
• Inspire us with your talent!