Cloud Data Engineer

Position: Cloud Data Engineer

Location: Toronto, ON

Job ID#: RQ11486

Duration: 6 Months

Role Overview

We are seeking an experienced Cloud Data Engineer to design, build, optimize, and support enterprise-scale cloud data solutions. The successful candidate will play a key role in developing end-to-end data pipelines, implementing modern DataOps practices, and enabling scalable cloud-based data platforms that support business and operational objectives.

This position requires expertise in cloud data engineering, data migration, ETL/ELT development, automation, data warehousing, and large-scale data transformation initiatives.

Key Responsibilities

• Design and develop data pipelines from source systems through to end-user consumption.

• Optimize and maintain high-performance data pipelines.

• Develop and manage cloud-based data platforms, data storage, and data exchange solutions.

• Build, orchestrate, deploy, and automate data workflows and pipelines.

• Develop integrations across multiple platforms using various programming languages and scripting techniques.

• Apply DataOps principles, best practices, and Agile delivery methodologies.

• Implement Continuous Integration and Continuous Deployment (CI/CD) processes and automation.

• Support data provisioning, data exchange, and data security initiatives.

• Design and implement large-scale data migration and transformation solutions across cloud environments.

• Develop fact/dimension models, enterprise data warehouses, data lakes, and data lakehouse architectures.

• Manage cloud data services including storage repositories, data lakes, lakehouses, key vaults, virtual machines, and related infrastructure.

• Support structured, semi-structured, and unstructured data ingestion, provisioning, and data exchange processes.

• Monitor, troubleshoot, tune, and optimize DataOps solutions.

• Collaborate with technical and business stakeholders to deliver scalable data solutions.

• Mandatory Skills & Experience (8+ Years)

• Design, build, automate, and optimize complex ETL/ELT processes using Databricks, Delta Live Tables (DLT), or equivalent technologies.

• Development of unified data platforms using Databricks and Unity Catalog or equivalent.

• Strong experience with relational databases including Oracle, MySQL, and SQL Server.

• Expertise in relational and dimensional data modeling.

• Advanced SQL development and query optimization.

• Experience with data replication and database administration.

• Advanced SQL skills including PL/SQL and T-SQL.

• Experience working with Big Data processing frameworks such as PySpark.

• Proficiency in Azure Data Factory pipeline development.

• Experience building custom Databricks pipelines integrated with CI/CD processes and Azure DevOps Git Integration.

• Experience with data migration and integration across platforms including:

• Oracle to Azure Data Lake

• Oracle to Databricks

• Oracle to Microsoft Fabric

• Desired Skills & Experience

• Data lake and lakehouse architecture design utilizing Medallion Architecture.

• Advanced experience with Oracle databases, Azure SQL Server, and Azure Data Factory.

• Experience with cloud platforms including Azure, AWS, and Google Cloud Platform (GCP).

• Strong PL/SQL development skills for ETL solutions.

• Experience troubleshooting, performance tuning, failover, recovery, and production support.

• Experience with Python, Unix Shell Scripting, and Scala.

• Additional Information

• Hybrid work arrangement.

• Candidates should be available during standard business hours.

• Strong analytical, problem-solving, communication, and stakeholder management skills are required.

• Proven ability to work independently as well as within collaborative project teams.

• Experience delivering enterprise data warehouse, data lake, and cloud modernization initiatives is highly desirable.

• About Symbiotic Digital.

• Symbiotic Digital provides the IT Experts you need that solve problems and get things done. See what the top 2% in their field can do for you. (Symbiotic Digital is a division of Symbiotic Group Inc.)

We serve customers in two ways, we provide:

• Digital Experts: IT Consulting expertise. Bright Minds That Produce Proven Results

• Recruitment: Find The Right People You Need

• Serving IT & Business leaders, Symbiotic Digital provides a business system that enable us to provide the Expert Technical staff needed to solve challenging business and IT problems. IT leaders in the most reputable organizations in Canada have relied on Symbiotic Digital to help them staff difficult assignments with proven Experts uniquely evaluated by our proven QMS- Quality Management System Staff Development Model. We are a 100% Indigenous owned company.

• Learn more online at https://www.symbioticgroup.com/home-sd/.

• View All Jobs online at: https://www.symbioticgroup.com/view-jobs/