Skip to content

Senior Data Engineer (Investment Data)

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Abu Dhabi, United Arab Emirates

relocation icon

Relocation friendly

specialization icon

Other Consulting

lob icon

BCM Industry

date icon

16/09/2026

Req. VR-125076

Apply
Project description

We’re looking for an experienced, hands-on Data Engineer who is capable of designing, building, and operating data pipelines and models that power analytics and applications across investment teams and Middle/Back office. The ideal candidate has financial markets familiarity (securities, prices, corporate actions, positions/holdings) and thrives in ambiguous environments—proactively shaping solutions, not waiting for tickets. You’ll own data end-to-end: from ingesting vendor and internal sources, to modeling in our lakehouse, to making data discoverable, reliable, and cost-efficient. You’ll partner closely with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures that balance speed, governance, and scalability.

Responsibilities
bullet icon

Participate in requirements clarification and sprint planning sessions.

bullet icon

Design technical solutions and implement them, inc ETL Pipelines – Build robust data pipelines in PySpark to extract, transform, using PySpark

bullet icon

Optimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability

bullet icon

Writing unit and integration tests.

bullet icon

Support QA teammates in the acceptance process.

bullet icon

Resolving PROD incidents as a 3rd line engineer.

Skills

Must have

bullet icon

Bachelor’s degree (Computer Science, Engineering, Information Systems, or related discipline).

bullet icon

5+ years experience in data engineering roles (flexible based on depth of capability).

bullet icon

Strong hands-on experience with Databricks in production environments (prerequisite).

bullet icon

Strong programming experience with PySpark (must) and strong SQL (must).

bullet icon

Proven experience with Declarative Pipelines / pipeline orchestration on Databricks (prerequisite).

bullet icon

Strong understanding of data engineering fundamentals: ingestion patterns, transformation design, incremental processing, testing, performance tuning.

bullet icon

Experience delivering production-ready datasets with appropriate operational controls (monitoring, troubleshooting, reliability patterns).

bullet icon

Experience with modern Lakehouse concepts (Delta tables, optimization strategies, file skipping, metadata/statistics awareness).

bullet icon

Exposure to data governance practices: cataloguing, documentation, business glossary/terms, lineage.

bullet icon

Experience working in enterprise environments with CI/CD pipelines and structured release processes.

bullet icon

Familiarity with vendor market data feeds (e.g., Bloomberg, Refinitiv, MSCI, FactSet) or similar multi-source mastering patterns.

Nice to have

bullet icon

Strong Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.

bullet icon

Proven Migration Experience from Palantir / to Databricks. Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.

bullet icon

Familiarity with Dynatrace or Datadog for system observability and monitoring.

bullet icon

Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

Abu Dhabi, United Arab Emirates

Req. VR-125076

Other Consulting

BCM Industry

16/09/2026

Req. VR-125076

Apply for Senior Data Engineer (Investment Data) in Abu Dhabi

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.