Log in
All jobs
NS

Senior Data Engineer

NorthBay Solutions
Islamabad, Capital, Pakistan
Hybrid

About this role

Senior Data Engineer

Job Summary

We are seeking a highly skilled Senior Data Engineer with 5–8 years of experience in designing, developing, and optimizing large-scale data platforms and ETL/ELT pipelines. The ideal candidate will have strong hands-on expertise in PySpark, AWS Glue, Amazon EMR, Amazon Redshift, and SQL-based data warehousing, along with proven experience in performance tuning and data optimization.

The candidate will work closely with a UAE-based customer and must be comfortable collaborating with distributed teams while adhering to UAE working hours and holiday schedules.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using PySpark, AWS Glue, and Amazon EMR.

  • Build and optimize data ingestion, transformation, and processing frameworks for structured and semi-structured data.

  • Develop and maintain enterprise data warehouse solutions using Amazon Redshift.

  • Write complex SQL queries, stored procedures, and data transformations to support analytics and reporting requirements.

  • Implement ETL/ELT processes to move data efficiently across multiple systems and platforms.

  • Perform performance tuning and optimization of Spark jobs, ETL pipelines, SQL queries, and Redshift workloads.

  • Ensure data quality, integrity, security, and governance across data platforms.

  • Troubleshoot production issues and perform root cause analysis for data-related incidents.

  • Collaborate with business stakeholders, analysts, architects, and engineering teams to understand data requirements.

  • Participate in code reviews, technical design discussions, and best-practice implementation.

  • Monitor data pipelines and proactively identify opportunities for performance improvements and automation.

  • Create and maintain technical documentation, data models, and operational procedures.

  • Required Skills & Experience

  • Must-Have Skills

  • 5–8 years of experience in Data Engineering and Data Warehousing.

  • Strong hands-on experience with PySpark.

  • Extensive experience with AWS Glue.

  • Experience building and managing workloads on Amazon EMR.

  • Strong expertise in Amazon Redshift.

  • Excellent SQL development and query optimization skills.

  • Strong understanding of Data Warehousing concepts, dimensional modeling, and ETL/ELT processes.

  • Experience in performance tuning of Spark jobs, SQL queries, ETL pipelines, and data warehouse workloads.

  • Experience handling large-scale datasets and distributed data processing.

  • Strong debugging, troubleshooting, and analytical skills.

  • Preferred Skills

  • Experience with additional AWS services such as S3, IAM, CloudWatch, Lambda, and Step Functions.

  • Knowledge of CI/CD pipelines and DevOps practices for data platforms.

  • Experience with workflow orchestration tools.

  • Familiarity with data governance, security, and compliance practices.

  • Exposure to Agile/Scrum development methodologies.

Qualifications

  • Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field.

  • Relevant AWS certifications will be considered an advantage.

  • Soft Skills

  • Strong communication and stakeholder management skills.

  • Ability to work independently in a remote environment.

  • Excellent problem-solving and analytical thinking abilities.

  • Ability to collaborate effectively with cross-functional and geographically distributed teams.

  • Strong ownership mindset and commitment to delivering high-quality solutions.

  • Share

  • Apply

  • Apply for this position

  • Required*

  • First Name*

  • Last Name*

  • Email Address*

  • Phone*

  • Address

  • Resume*

  • We've received your resume. Click here to update it.

  • Attach resume

  • or

  • Paste resume

  • Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or

  • Paste resume

  • Paste your resume here or

  • Attach resume file

  • What is your hands-on experience with PySpark for building large-scale data processing pipelines?

  • -- No answer --Less than 2 Years3 Years5+ Years

  • Do you have hands-on experience with AWS Data Engineering services such as AWS Glue, Amazon EMR, Amazon Redshift, and Amazon S3?

  • -- No answer --Basic knowledge onlyExperience with 1–2 of these servicesExperience with 3 of these servicesExpert level Experience

  • How would you rate your expertise in SQL development and query optimization?

  • -- No answer --BeginnerIntermediateExpert

  • What type of Data Engineering solutions have you primarily worked on?

  • -- No answer --ETL PipelinesData WarehousingBig Data / Distributed ProcessingExperience in all of the above

  • Are you comfortable following UAE public holidays?

  • -- No answer --YesNo

  • What is your current monthly gross salary (PKR)?

  • What is your expected monthly gross salary (PKR)?

  • What is your notice period?

  • -- No answer --Immediate Joiner15 Days30 Days45 Days60 DaysMore than 60 Days

  • Human Check*

  • Submit Application

Your next opportunity starts here

Prepare, apply, track, interview and get hired — all from one platform, with AI in your corner.

Download app

Or sponsor Premium for someone who's job hunting →