About this role

Lead Bigdata Engineer

Job Description Skill Set Spark, PySpark Total Experience 7.00 to 15.00 Years No of Openings 1 Job Post Date 14/08/2026 Job Expiry Date 31/10/2026 Domain IT

Location

BENGALURU [India] Job Reference No 4101838

Job Summary

Job Title Data Engineer Location TechM Blr ECITY Years of Experience 7 10 Years

We are seeking a skilled Data Engineer with 7 10 years of experience to join our dynamic team at TechM Blr ECITY. The ideal candidate will have a strong background in data engineering, with a particular emphasis on Python programming. You will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data driven decision making processes.

Responsibilities

Design, develop, and maintain robust data pipelines to ingest, process, and store large volumes of data from various sources.
Collaborate with data scientists and analysts to understand data requirements and ensure data availability and quality.
Implement data models and data warehousing solutions to support analytics and reporting.
Optimize data storage and retrieval processes for performance and efficiency.
Monitor and troubleshoot data pipeline performance and resolve issues as they arise.
Ensure data security and compliance with relevant regulations.
Document data engineering processes and maintain clear communication with stakeholders.
Stay updated with industry trends and best practices in data engineering and analytics.
Mandatory Skills
Proficiency in Python programming is a must.
Strong experience with data modeling, ETL processes, and data warehousing.
Hands on experience with SQL and NoSQL databases.
Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
Experience with cloud platforms (AWS, Azure, or Google Cloud) for data storage and processing.
Knowledge of data governance and data quality best practices.
Preferred Skills
Experience with data visualization tools (e.g., Tableau, Power BI).
Familiarity with machine learning concepts and frameworks.
Understanding of containerization technologies (e.g., Docker, Kubernetes).
Experience with version control systems (e.g., Git).
Strong analytical and problem solving skills.

Qualifications

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
7 10 years of relevant experience in data engineering or a related role.
Proven track record of successfully delivering data engineering projects.
Excellent communication and collaboration skills.
If you are a passionate Data Engineer looking to make an impact in a fast paced