About this role
Lead Bigdata Engineer - Chennai/ Bangalore Location
A Bachelor’s or Higher Degree is the minimum entry required for the position
Job Description
- Skill Set : Spark,pyspark
- Total
Experience
- 7.00 to 15.00 Years
- No of Openings : 1
- Job Post Date : 05/08/2026
- Job Expiry Date : 30/11/2026
- Domain : IT
- Location : BENGALURU [India]
- Job Reference No : 4100021
- Recommend to friend
Job Summary
Job Title: Data Engineer Location: TechM Blr ECITY Years of
Experience
- 7 10 Years
Job Summary
We are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team at TechM. The ideal candidate will have 7 10 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.
Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
- Implement data models and architectures that support analytics and reporting needs.
- Optimize data storage and retrieval processes for performance and scalability.
- Ensure data quality and integrity through rigorous testing and validation processes.
- Monitor and troubleshoot data pipeline performance, implementing improvements as necessary.
- Document data engineering processes, architectures, and best practices for future reference.
- Stay updated with industry trends and emerging technologies in data engineering and analytics.
Mandatory Skills:
- Strong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.
- Extensive experience with SQL and relational databases (e.g., PostgreSQL, MySQL).
- Hands on experience with data warehousing solutions (e.g., Snowflake, Redshift).
- Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
- Strong understanding of data modeling concepts and best practices.
- Excellent problem solving skills and attention to detail.
Preferred Skills:
- Experience with data visualization tools (e.g., Tableau, Power BI).
- Knowledge of machine learning concepts and frameworks.
- Familiarity with containerization technologies (e.g., Docker, Kubernetes).
- Experience with version control systems (e.g., Git).
- Strong communication skills and ability to work collaboratively in a team environment.
Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.