Project description

The Surveillance Enhancement Program (SEP) is a multi-year initiative aimed at developing and improving the surveillance platform to identify potential market misconduct, manipulation, and abuse. Our client fulfilled its commitment to the Financial Conduct Authority (FCA) by meeting Market Abuse Regulation (MAR) requirements for critical data sources in September 2017.

Subsequent projects have been launched to further enhance, expand, and complement the existing automated surveillance platform. This project will focus on alert enhancements, strategic data sourcing from FM order and trade lakes, and user interface and workflow improvements to comply with regulatory obligations such as Market Abuse Regulation and Dodd-Frank.

Additionally, the scope includes enhancements related to Control Room and Suitability Monitoring data, interfaces, and scenarios.

Responsibilities

Develop software applications based on business requirements

Maintain software applications and make enhancements according to project specifications

Participate in requirement analysis, design, development, testing, and implementation activities

Propose new techniques and technologies for software development.

Perform unit testing and user acceptance testing to evaluate application functionality

Ensure to complete the assigned development tasks within the deadlines

Work in compliance with coding standards and best practices

Provide assistance to Junior Developers when needed.

Perform code reviews and recommend improvements.

Review business requirements and recommend changes to develop reliable applications.

Develop coding documentation and other technical specifications for assigned projects.

Act as primary contact for development queries and concerns.

Analyze and resolve development issues accurately.

Skills

Must have

10+ years of experience in data intensive Pyspark development ,Window Functions , Performance Optimization ,Spark Architecture,Salting ,Column Pruning

Must have experience in leading a Development Team

Proven experience as a Core Python developer

Good understanding of Gen AI

Experience developing Classes, OOPS, exception handling, parallel processing

Strong knowledge of DB connectivity, data loading , transformation, calculation

Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations

Lambda Functions, Decorators

Vector operations on Pandas dataframes /series

Application of apply map, apply, map functions

Concurrency and error handling data pipeline batch of size [1-10 gb]

Ability to understand business requirements and translate them into technical requirements

Ability to design architecture of data pipeline for concurrent data processing

Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services

Debugging application

Nice to have

Knowledge of web backend technology

Django, Python, PostgreSQL.

Apache Airflow

Other

Languages

English: C1 Advanced

Seniority

Lead

Related jobs

View all vacancies

Senior Embedded Maintenance and Troubleshooting Engineer

Automated Testing Python

Sweden

Gothenburg

Python Developer with AWS/DevOps

Python

India

Bengaluru

Python Developer with AWS/DevOps

Python

India

Bengaluru

Luxoft Benefits*

Global Relocation

●Relocation options **
●Experience in an international environment
●Cross-cultural experience

Recognition and Evaluation

●Feedback culture
●Regular appraisals

Time Off***

●Annual holiday - 20 or 26 days. The duration of the leave depends on the overall seniority
●Occasional leave - 1 or 2 days/ depending on the circumstances
●Child care leave - 2 days or 16 hours per year
●Absence due to force majeure - 2 days or 16 hours per year
●Maternity Leave - 20 weeks
●Parental Leave - 41 weeks
●Paternity Leave - 14 days

Luxoft Training Center

●Expert-led tech courses covering basic to advanced topics
●Internal instructor-led soft skills courses
●Comprehensive in-house self-learning resources for both soft and hard skills
●Access to external self-learning libraries like ProQuest eBook and Udemy for Business
●Cloud Programs: MS Cloud Academy, AWS Partner Academy, Google Cloud Academy
●Custom Learning Programs: upskilling, reskilling, technical mentorship
●Leadership Programs for Managers

Well-being and Work-life Balance

●Multisport card
●Possibility to order Multisport card at the corporate rate for family members
●LuxGood Program: wellbeing seminars, contests, relaxation sessions, yoga sessions, etc.
●One Team Program: Buddy for each New Joiner; seminars, meeting and workplace space to support integration with local community and culture; “Hire me” workshops for partners
●Preferential banking offer
●Preferential car leasing offer
●Cafeteria program discounts for shops, cinema tickets, holiday offers
●Luxoft Social Benefit Fund: sport and recreation benefits, the possibility to receive financial support

Health Care

●Private Healthcare Insurance with unlimited access to specialists
●Full dental support
●Travel Insurance
●Possibility to add private healthcare coverage for family members at the corporate rate
●Life insurance at the corporate rate for employees and family members, including payment of the basic package for the employee by the employer
●Reimbursement for corrective glasses

Company Events and Friendly Environment

●Many fun social activities organized by the Luxoft team offline in your city
●Online entertainment events for whole company and local team events
●A workplace where you’re treated with respect within a multicultural team

Internal Mobility

●Rotation between projects and accounts
●New career opportunities

Self-Learning Library

CSR Projects

*The acquisition of rights to the above benefits depends on the form of cooperation. Benefits apply to those employed under a contract of employment.

**Please note that relocation is not available for all open positions. At Luxoft Poland it is possible to work remotely only from the territory of Poland.

***Options offered by the Polish government.

Warsaw, Poland

Req. VR-125805

Python

BCM Industry

28/10/2026

Req. VR-125805

Apply for Lead Pyspark Developer in Warsaw

*Indicates a required field

First name

Last name

Your country

Your City

Phone

Specialization

Attach your resume (max file size 1MB; allowed extensions: doc, txt, pdf, docx) Upload resume

Number of years of experience in the specialization you are applying for

What are your monthly gross salary expectations?

Read Explanatory Notes

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.

Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.

We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.

With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.

Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.

Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.

By clicking the Agree and Send button, you consent that Luxoft Holding Inc. can process your provided personal data for the purpose of processing your application to establish a potential employment, internship or relocation with Luxoft Holding Inc., a relevant affiliate of the Luxoft Group or Luxoft Group’s clients, as applicable. You consent to the retention of your personal data, with the purpose of contacting you for potential future employment opportunities. If you refer a friend, we will process your provided personal data of you and your referral to award you with a bonus for such recommendation. You can withdraw your consent at any time with effect for the future. Before you consent, please click on „Read these Explanatory Notes“ and view our Privacy Notice (e.g. for your data subject rights).

Note: Our system automatically converts each CV into our standardized format, enabling our HR teams to process applications more efficiently.

I consent that Luxoft Holding Inc. and the affiliates of the Luxoft Group can process my personal data for the purpose of sending me regular emails with information about Luxoft as an employer including job vacancies and (ii) marketing communications with information about recruitment-related events, organized webinars, conferences, as well as the Logeek Magazine and other similar publications. I can withdraw my consent at any time with effect for the future. These communications are personalised to my interests in accordance with our Privacy Notice.

Related Jobs

All jobs