About this role
Experience: 4–6 years of experience in data engineering or software development. Technical Expertise:
- Strong hands-on experience with Apache Spark / PySpark.
- Proficiency in Python programming (data manipulation, error handling, packaging).
- Solid understanding of distributed computing concepts (RDDs, DataFrames, partitions, shuffles).
- Proficient in SQL and data modeling for both structured and semi-structured data.
- Understanding of version control (Git), CI/CD, and Agile methodologies.
- Strong debugging, performance tuning, and analytical skills.