About this role
This role is for one of Weekday’s clients Salary range: Rs 1000000 - Rs 2000000 (ie INR 10 - 20 LPA)
Min Experience: 7+ years Location: Bengaluru, Karnataka, India JobType: full-time
Requirements
-
7-8 years of experience in Data Engineering, with strong hands-on expertise in Python, SQL, and ETL/ELT processes.
-
Experience with Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake Storage (ADLS).
-
Strong understanding of data warehousing, data modelling, database architecture, and data management concepts.
-
Experience designing, developing, and optimizing scalable data pipelines for processing large datasets.
-
Hands-on experience in data ingestion, transformation, integration, and workflow orchestration.
-
Experience with PySpark and distributed data processing. Knowledge of cloud platforms such as Azure, AWS, or GCP.
-
Understanding of data quality, validation, monitoring, and performance optimization.
-
Experience in troubleshooting data pipeline issues and ensuring data reliability.
-
Knowledge of data security, governance, and best practices.
-
Strong analytical, problem-solving, and communication skills.
-
Ability to work with cross-functional teams and translate business requirements into effective data engineering solutions.
Must-have skills
Python, ETL
Good-to-have skills
AWS, GCP