Principal Data Platform Architect

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

London, United Kingdom of Great Britain and Northern Ireland

relocation icon

Relocation friendly

specialization icon

Other Consulting

lob icon

BCM Industry

date icon

04/03/2026

Req. VR-121452

Apply
Project description

We are seeking a highly experienced Principal Data Platform Architect with deep expertise in Palantir Foundry and Databricks to lead the strategic design, migration, and optimization of our enterprise data ecosystem.
This role will be responsible for driving the transition of data pipelines, ontologies, and transformation workflows from Palantir Foundry to a scalable Databricks Lakehouse architecture, ensuring data integrity, governance, performance, and long-term platform sustainability.
The ideal candidate combines strong architectural leadership with hands-on expertise in PySpark, SQL, and cloud-based data platforms. You will work closely with data engineering, DevOps, and business stakeholders to modernize the platform, establish enterprise best practices, and deliver a seamless, secure, and high-performance migration.

Responsibilities
bullet icon

Define and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance frameworks.

bullet icon

Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL.

bullet icon

Implement validation frameworks to ensure complete data accuracy, consistency, and lineage throughout the migration process.

bullet icon

Optimize Spark workloads, cluster configurations, and storage strategies to ensure high performance and cost-efficient operations in Databricks.

bullet icon

Collaborate with data engineers, platform teams, and business stakeholders to minimize migration risk, ensure smooth cutover, and maintain production stability.

Skills

Must have

bullet icon

Strong Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.

bullet icon

Advanced Databricks Experience. Deep knowledge of Databricks architecture, Delta Lake, job orchestration, cluster management, and performance tuning.

bullet icon

Proven Migration Experience (Palantir → Databricks). Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.

bullet icon

Expert-Level PySpark & Python Skills. Strong ability to design, optimize, and refactor distributed data processing workflows.

bullet icon

Advanced SQL & Data Modelling Expertise. Experience in dimensional modeling, lakehouse architecture patterns, and query optimization.

bullet icon

Cloud Platform Experience (Azure preferred). Hands-on experience deploying and managing data platforms in cloud environments, including storage, security, and networking considerations.

Nice to have

bullet icon

Understanding of the Investment Data Domain.

bullet icon

Familiarity with Dynatrace or Datadog for system observability and monitoring.

bullet icon

Databricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

London, United Kingdom of Great Britain and Northern Ireland

Req. VR-121452

Other Consulting

BCM Industry

04/03/2026

Req. VR-121452

Apply for Principal Data Platform Architect in London

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.