Senior Databricks Data Engineer

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Sofia, Bulgaria

specialization icon

Other Consulting

lob icon

BCM Industry

date icon

16/03/2026

Req. VR-121533

Apply
Project description

We are seeking a Senior Data Engineer with strong hands-on expertise in Databricks, PySpark, and cloud-based data platforms to support the development, migration, and optimization of our enterprise data platform within the investment domain.
This role will focus on building and maintaining scalable data pipelines and lakehouse data models that support investment analytics, portfolio management, risk analysis, and trading data workflows.
The successful candidate will work closely with data engineers, quantitative analysts, and investment stakeholders to deliver high-quality, reliable, and performant data solutions. Experience with financial datasets such as market data, portfolio holdings, transactions, pricing data, and risk metrics is highly valuable.

Responsibilities
bullet icon

Key Responsibilities:

bullet icon

Develop and maintain scalable data pipelines and transformation workflows using Databricks, PySpark, and SQL.

bullet icon

Support the migration of datasets, pipelines, and transformation logic from Palantir Foundry to Databricks Delta Lake.

bullet icon

Work with investment and financial datasets, including market data, portfolio positions, transactions, pricing data, and risk metrics.

bullet icon

Build and maintain ETL/ELT pipelines that enable data availability for investment analytics, reporting, and portfolio management systems.

bullet icon

Implement data validation, reconciliation, and quality frameworks to ensure financial data accuracy and consistency.

bullet icon

Optimize Spark jobs, cluster configurations, and storage formats to improve performance and cost efficiency.

bullet icon

Maintain data lineage, documentation, and governance practices to meet financial industry standards.

bullet icon

Support monitoring, troubleshooting, and performance tuning of production data pipelines.

Skills

Must have

bullet icon

Mandatory Skills:

bullet icon

Advanced Databricks Experience. Deep knowledge of Databricks architecture, Delta Lake, job orchestration, cluster management, and performance tuning.

bullet icon

Experience working with investment data, such as market data, portfolio holdings, transactions, pricing data, risk metrics, and financial instruments

bullet icon

Expert-Level PySpark & Python Skills. Strong ability to design, optimize, and refactor distributed data processing workflows.

bullet icon

Advanced SQL & Data Modelling Expertise. Experience in dimensional modeling, lakehouse architecture patterns, and query optimization.

bullet icon

Cloud Platform Experience (Azure preferred). Hands-on experience deploying and managing data platforms in cloud environments, including storage, security, and networking considerations.

Nice to have

bullet icon

Strong Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.

bullet icon

Proven Migration Experience from Palantir / to Databricks. Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.

bullet icon

Familiarity with Dynatrace or Datadog for system observability and monitoring.

bullet icon

Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

Sofia, Bulgaria

Req. VR-121533

Other Consulting

BCM Industry

16/03/2026

Req. VR-121533

Apply for Senior Databricks Data Engineer in Sofia

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.