Senior Databricks Data Engineer

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Krakow, Poland

specialization icon

Other Consulting

lob icon

BCM Industry

date icon

16/03/2026

Req. VR-121533

Apply
Project description

We are seeking a Senior Data Engineer with strong hands-on expertise in Databricks, PySpark, and cloud-based data platforms to support the development, migration, and optimization of our enterprise data platform within the investment domain.
This role will focus on building and maintaining scalable data pipelines and lakehouse data models that support investment analytics, portfolio management, risk analysis, and trading data workflows.
The successful candidate will work closely with data engineers, quantitative analysts, and investment stakeholders to deliver high-quality, reliable, and performant data solutions. Experience with financial datasets such as market data, portfolio holdings, transactions, pricing data, and risk metrics is highly valuable.

Responsibilities
bullet icon

Key Responsibilities:

bullet icon

Develop and maintain scalable data pipelines and transformation workflows using Databricks, PySpark, and SQL.

bullet icon

Support the migration of datasets, pipelines, and transformation logic from Palantir Foundry to Databricks Delta Lake.

bullet icon

Work with investment and financial datasets, including market data, portfolio positions, transactions, pricing data, and risk metrics.

bullet icon

Build and maintain ETL/ELT pipelines that enable data availability for investment analytics, reporting, and portfolio management systems.

bullet icon

Implement data validation, reconciliation, and quality frameworks to ensure financial data accuracy and consistency.

bullet icon

Optimize Spark jobs, cluster configurations, and storage formats to improve performance and cost efficiency.

bullet icon

Maintain data lineage, documentation, and governance practices to meet financial industry standards.

bullet icon

Support monitoring, troubleshooting, and performance tuning of production data pipelines.

Skills

Must have

bullet icon

Mandatory Skills:

bullet icon

Advanced Databricks Experience. Deep knowledge of Databricks architecture, Delta Lake, job orchestration, cluster management, and performance tuning.

bullet icon

Experience working with investment data, such as market data, portfolio holdings, transactions, pricing data, risk metrics, and financial instruments

bullet icon

Expert-Level PySpark & Python Skills. Strong ability to design, optimize, and refactor distributed data processing workflows.

bullet icon

Advanced SQL & Data Modelling Expertise. Experience in dimensional modeling, lakehouse architecture patterns, and query optimization.

bullet icon

Cloud Platform Experience (Azure preferred). Hands-on experience deploying and managing data platforms in cloud environments, including storage, security, and networking considerations.

Nice to have

bullet icon

Strong Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.

bullet icon

Proven Migration Experience from Palantir / to Databricks. Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.

bullet icon

Familiarity with Dynatrace or Datadog for system observability and monitoring.

bullet icon

Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

Luxoft Benefits*
  • Relocation options **
  • Experience in an international environment
  • Cross-cultural experience
  • Feedback culture
  • Regular appraisals
  • Annual holiday - 20 or 26 days. The duration of the leave depends on the overall seniority
  • Occasional leave - 1 or 2 days/ depending on the circumstances
  • Child care leave - 2 days or 16 hours per year
  • Absence due to force majeure - 2 days or 16 hours per year
  • Maternity Leave - 20 weeks
  • Parental Leave - 41 weeks
  • Paternity Leave - 14 days
  • Expert-led tech courses covering basic to advanced topics
  • Internal instructor-led soft skills courses
  • Comprehensive in-house self-learning resources for both soft and hard skills
  • Access to external self-learning libraries like ProQuest eBook and Udemy for Business
  • Cloud Programs: MS Cloud Academy, AWS Partner Academy, Google Cloud Academy
  • Custom Learning Programs: upskilling, reskilling, technical mentorship
  • Leadership Programs for Managers
  • Multisport card
  • Possibility to order Multisport card at the corporate rate for family members
  • LuxGood Program: wellbeing seminars, contests, relaxation sessions, yoga sessions, etc.
  • One Team Program: Buddy for each New Joiner; seminars, meeting and workplace space to support integration with local community and culture; “Hire me” workshops for partners
  • Preferential banking offer
  • Preferential car leasing offer
  • Cafeteria program discounts for shops, cinema tickets, holiday offers
  • Luxoft Social Benefit Fund: sport and recreation benefits, the possibility to receive financial support
  • Private Healthcare Insurance with unlimited access to specialists
  • Full dental support
  • Travel Insurance
  • Possibility to add private healthcare coverage for family members at the corporate rate
  • Life insurance at the corporate rate for employees and family members, including payment of the basic package for the employee by the employer
  • Reimbursement for corrective glasses
  • Many fun social activities organized by the Luxoft team offline in your city
  • Online entertainment events for whole company and local team events
  • A workplace where you’re treated with respect within a multicultural team
  • Rotation between projects and accounts
  • New career opportunities

Self-Learning Library

CSR Projects

*The acquisition of rights to the above benefits depends on the form of cooperation. Benefits apply to those employed under a contract of employment.

**Please note that relocation is not available for all open positions. At Luxoft Poland it is possible to work remotely only from the territory of Poland.

***Options offered by the Polish government.

Krakow, Poland

Req. VR-121533

Other Consulting

BCM Industry

16/03/2026

Req. VR-121533

Apply for Senior Databricks Data Engineer in Krakow

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.