Platform Engineer

Job title: Platform Engineer

About the Role

The Platform Engineer will support design, deployment, and operations of Scotiabank's Azure and Databricks-based Data & AI platforms. Working under senior engineers and platform leads, you will build, tune, and troubleshoot infrastructure, DevOps, monitoring, and automation to enable data-driven decisions and AI initiatives. You will collaborate with cross-functional teams to deliver platform enhancements and new projects in line with the Data & AI strategy.

What You'll Do

• Guidance and Collaboration: Work with senior engineers and platform leads to understand goals, deliver tasks, support team objectives, contribute to platform improvements, and provide regular progress updates.
• Technical Execution: Design, deploy, and maintain Azure and Databricks components; configure Azure networking and security (VNets, NSGs, route tables, private endpoints, RBAC); implement Databricks resources including clusters, SQL warehouses, and Unity Catalog objects.
• Quality Assurance: Ensure high-quality delivery by following coding standards, Terraform best practices, and platform validation procedures; participate in code reviews, automated testing, and CI/CD validation steps.
• Process Improvements: Develop reusable Terraform modules; standardize configurations; build IaC modules for Azure native resources and Databricks; create SOPs, technical documentation, and onboarding guides.
• Monitoring and Troubleshooting: Diagnose platform issues; analyze logs/metrics; maintain observability using Azure Monitor and Log Analytics; monitor Databricks jobs, clusters, and infrastructure health.
• Platform Reliability Support: Troubleshoot issues and contribute to meeting platform SLOs; support incident response efforts under senior engineers’ guidance.
• Incident Management Support: Assist during incidents by gathering diagnostic data, executing remediation steps, and communicating updates to internal teams as directed by senior or on-call leads.
• Observability Tooling: Develop monitoring dashboards and alert rules for Databricks and Azure resources; contribute to log ingestion pipelines and basic automation scripts.

What We're Looking For

• Experience with Azure and Databricks platform components and deployments.
• Familiarity with Azure networking/security configurations (VNets, NSGs, route tables, private endpoints) and RBAC.
• Experience implementing Databricks resources including clusters, SQL warehouses, and Unity Catalog.
• Knowledge of coding standards, Terraform best practices, and CI/CD validation; participate in code reviews and automated testing.
• Ability to develop reusable Terraform modules and IaC for Azure native resources and Databricks.
• Experience creating SOPs, technical documentation, and onboarding guides.
• Familiarity with observability using Azure Monitor and Log Analytics; monitoring Databricks jobs, clusters, and infrastructure health.
• Troubleshooting and incident response under guidance of senior engineers.
• Strong collaboration skills with IAM, Network, Cloud Ops, Security, and client partners.