About this role
RQ10941 - 2 x Sr. Software Developer
Responsibilities
- Design, develop, test, implement, and troubleshoot:
- o data pipelines using Python and AWS services (Glue, StepFunctions, Lambda)
- o complex data transformation procedures
- o data models for the efficient storing of data in relational databases as well as in unstructured data repositories
- o re-useable classes and modules as to enhance the maintainability and ability to deliver solutions quickly.
-
- Review existing code base and assist other more junior team members ensuring a consistent level of quality.
-
- Assess new business requirements and propose adequate technical solutions (using on-prem and on-cloud resources)
MUST HAVES:
- Data engineering (pandas, pyspark)
- Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data
- Experience using AWS Services such as Glue, StepFunctions, Lambda, S3
- Extract/Transform/Load data using tools such as Informatica IDMC
Nice-to-have:
- Data processing automation
- Linux experience
- Experience with cloud data warehousing and analytics (AWS Redshift or equivalent)
- Public sector experience