Senior PySpark Developer

Project description

You will join a Regulatory Reporting Platform within a large US investment bank. The platform is responsible for collecting, processing, and transforming large volumes of data from multiple internal systems to produce regulatory reports for 240 jurisdictions worldwide. In total, the platform supports around 10,000 reports across a wide range of regulatory, compliance, financial, and risk reporting areas. This is a large-scale, business-critical data platform operating in a highly regulated environment, where data accuracy, quality, traceability, and timely delivery are essential. The team works on building and enhancing data pipelines, implementing reporting logic, ensuring data validation and reconciliation, and supporting the generation of complex regulatory outputs. The project is delivered by a global distributed team with colleagues located in Ukraine, Poland, and the US, offering close collaboration with engineers, analysts, and business stakeholders across multiple regions.

Responsibilities

• Design, develop, and maintain solutions for a large-scale Regulatory Reporting Platform
• Build and enhance data processing pipelines using Java and Apache Spark
• Implement scalable logic for data ingestion, transformation, aggregation, and enrichment from multiple internal data sources
• Develop and optimize batch processing jobs to support the generation of regulatory reports across multiple jurisdictions
• Ensure high standards of data quality, validation, reconciliation, and consistency throughout the reporting lifecycle
• Translate business and regulatory requirements into robust technical solutions
• Collaborate with business analysts, QA engineers, and cross-functional teams to deliver reporting functionality
• Investigate and resolve data and application issues in development, test, and production environments
• Improve application performance, scalability, and reliability for high-volume data processing workloads
• Contribute to the design and implementation of reusable components and engineering best practices
• Participate in code reviews, testing, and release activities to ensure high-quality deliverables
• Work closely with distributed teams across Ukraine, Poland, and the US in an agile delivery model
• Support continuous improvement of the platform, including monitoring, troubleshooting, and operational stability

Skills

• Must have

• 6+ years of commercial experience with Python

• 2+ years of PySpark experience

• Experience in designing and developing scalable, high-performance backend applications

• Good knowledge of SQL and working with large datasets from multiple data sources

• Strong problem-solving skills and ability to work effectively in a global distributed team

• Nice to have

• Experience in financial services, investment banking, or regulatory reporting projects

• Familiarity with data quality, reconciliation, and control frameworks

• Experience working with large-scale enterprise data platforms

• Knowledge of cloud environments and modern data platform architectures

• Understanding of CI/CD practices and automated deployment pipelines

• Experience working in Agile / Scrum teams within a distributed global setup

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Luxoft Benefits*

• ●Relocation options **
• ●Experience in an international environment
• ●Cross-cultural experience
• ●Feedback culture
• ●Regular appraisals
• ●Annual holiday - 20 or 26 days. The duration of the leave depends on the overall seniority
• ●Occasional leave - 1 or 2 days/ depending on the circumstances
• ●Child care leave - 2 days or 16 hours per year
• ●Absence due to force majeure - 2 days or 16 hours per year
• ●Maternity Leave - 20 weeks
• ●Parental Leave - 41 weeks
• ●Paternity Leave - 14 days
• ●Expert-led tech courses covering basic to advanced topics
• ●Internal instructor-led soft skills courses
• ●Comprehensive in-house self-learning resources for both soft and hard skills
• ●Access to external self-learning libraries like ProQuest eBook and Udemy for Business
• ●Cloud Programs: MS Cloud Academy, AWS Partner Academy, Google Cloud Academy
• ●Custom Learning Programs: upskilling, reskilling, technical mentorship
• ●Leadership Programs for Managers
• ●Multisport card
• ●Possibility to order Multisport card at the corporate rate for family members
• ●Luxoft Program: wellbeing seminars, contests, relaxation sessions, yoga sessions, etc.
• ●One Team Program: Buddy for each New Joiner; seminars, meeting and workplace space to support integration with local community and culture; “Hire me” workshops for partners
• ●Preferential banking offer
• ●Preferential car leasing offer
• ●Cafeteria program discounts for shops, cinema tickets, holiday offers
• ●Luxoft Social Benefit Fund: sport and recreation benefits, the possibility to receive financial support
• ●Private Healthcare Insurance with unlimited access to specialists
• ●Full dental support
• ●Travel Insurance
• ●Possibility to add private healthcare coverage for family members at the corporate rate
• ●Life insurance at the corporate rate for employees and family members, including payment of the basic package for the employee by the employer
• ●Reimbursement for corrective glasses
• ●Many fun social activities organized by the Luxoft team offline in your city
• ●Online entertainment events for whole company and local team events
• ●A workplace where you’re treated with respect within a multicultural team
• ●Rotation between projects and accounts
• ●New career opportunities

*The acquisition of rights to the above benefits depends on the form of cooperation. Benefits apply to those employed under a contract of employment.

Please note that relocation is not available for all open positions. At Luxoft Poland it is possible to work remotely only from the territory of Poland.

*Options offered by the Polish government.

Warsaw, Poland

Req. VR-125322

Python

BCM Industry

20/10/2026

Req. VR-125322

Apply for Senior PySpark Developer in Warsaw

*Indicates a required field

First name

Last name

Email

Your country

Your City

Phone

Specialization

Attach your resume (max file size 1MB; allowed extensions: doc, txt, pdf, docx)

Upload resume

Number of years of experience in the specialization you are applying for

What are your monthly gross salary expectations?

Read Explanatory Notes

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.

Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.

We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.

With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust