Skip to content

Senior Data Engineer

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Remote India, India

relocation icon

Relocation friendly

specialization icon

DWH Development

lob icon

BCM Industry

date icon

17/09/2026

Req. VR-118739

Apply
Project description

Senior data engineer developing and operating Databricks / Spark pipelines and Delta Lake lakehouse layers on Azure for the Client. Accountable for pipeline reliability, data freshness and dataset quality against agreed SLAs.
Key tasks
• Develop and operate Databricks / Spark pipelines (PySpark, SQL, Delta Live Tables or Workflows).
• Design Delta Lake / lakehouse layers (bronze–silver–gold), partitioning and Unity Catalog governance.
• Build ETL/ELT jobs and orchestration with Azure Data Factory and/or Airflow; manage dependencies and retries.
• Implement data-quality checks and validation (expectations, reconciliation, anomaly alerts).
• Tune Spark job performance and cluster cost (autoscaling, Photon, job clusters, spot).
• Manage schema evolution and change control; document lineage and transformations.

Responsibilities
bullet icon

Pipeline reliability and data freshness against agreed SLAs.

bullet icon

Accuracy and completeness of curated datasets.

bullet icon

Schema change management and backward compatibility for downstream consumers.

bullet icon

Documentation of data lineage and transformations (Unity Catalog, data catalogue).

Skills

Must have

bullet icon

Bachelor's degree in Computer Science, Engineering, Information Systems or a related field, or equivalent practical experience.

bullet icon

7+ years in data engineering, of which 3+ on Databricks / Apache Spark and 2+ on Azure data services (ADF, ADLS, Delta Lake).

bullet icon

Databricks (Workflows, Delta Live Tables, Unity Catalog), Apache Spark (PySpark, Spark SQL), Delta Lake.

bullet icon

Azure: Data Factory, Data Lake Storage Gen2, Key Vault, Event Hubs, Synapse or SQL DB; Azure DevOps CI/CD for notebooks and jobs.

bullet icon

Python and SQL at expert level; data modelling (dimensional, data vault) and ELT design.

bullet icon

Orchestration (ADF, Airflow), data-quality frameworks (Great Expectations, DLT expectations), monitoring and alerting.

bullet icon

Performance and cost tuning of Spark workloads; Git-based development and testing of pipelines.

Nice to have

bullet icon

Databricks Certified Data Engineer Professional; Azure DP-203.

bullet icon

Streaming (Structured Streaming, Kafka / Event Hubs).

bullet icon

dbt, Power BI semantic models, MLflow.

bullet icon

Experience in financial services, sovereign wealth / investment holding or other regulated enterprise environments.

bullet icon

Experience working with distributed teams (onsite UAE with nearshore India / offshore Poland squads).

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

Remote India, India

Req. VR-118739

DWH Development

BCM Industry

17/09/2026

Req. VR-118739

Apply for Senior Data Engineer in Remote India

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.