Databricks Developer with Cloud Experience

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Gurugram, India

relocation icon

Relocation friendly

specialization icon

BigData Development

lob icon

BCM Industry

date icon

16/04/2026

Req. VR-122115

Apply
Project description

The role is for a Senior Analyst Engineer specializing in Databricks development and cloud-based data engineering. The position focuses on designing, building, optimizing, and managing large-scale data pipelines and advanced analytics solutions using Databricks on cloud platforms such as Azure, AWS, or GCP.
The engineer will work closely with data platform, analytics, and application teams to ensure scalable, high‑performance, secure, and cost‑efficient data solutions aligned with organizational architecture and governance standards.

Responsibilities
bullet icon

Design and develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.

bullet icon

Build and maintain high-performance data ingestion and transformation workflows.

bullet icon

Implement Delta Lake best practices, including ACID transactions, schema evolution, time travel, and optimized storage formats.

bullet icon

Develop and operationalize data pipelines, jobs, and workflows using Databricks Workflows or cloud-native orchestration tools.

bullet icon

Optimize Spark jobs for performance, scalability, and cost-efficiency.

bullet icon

Manage and monitor Databricks clusters, including autoscaling, cluster policies, and job cluster configurations.

bullet icon

Implement CI/CD for Databricks code using tools like GitHub Actions, Azure DevOps, or Jenkins.

bullet icon

Ensure data security, governance, and compliance, including access controls, encryption, and Unity Catalog.

bullet icon

Collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions.

bullet icon

Create and maintain technical documentation, adhere to change management processes, and contribute to automation and continuous improvement initiatives.

Skills

Must have

bullet icon

8 to 10 years of experience in data engineering, with at least 3-5 years hands-on experience in Databricks.

bullet icon

Strong expertise in PySpark, Spark SQL, and distributed data processing fundamentals.

bullet icon

Proven experience building end-to-end ETL/ELT pipelines on cloud platforms.

bullet icon

Hands-on experience with Delta Lake, optimized file formats (Parquet), and data lake architectures.

bullet icon

Strong understanding of cloud ecosystems (Azure, AWS, or GCP), including storage, networking, security, and compute services.

bullet icon

Experience designing and tuning high-performance Spark jobs, optimizing partitions, caching, and cluster usage.

bullet icon

Proficiency in Git, CI/CD pipelines, and version-controlled development workflows.

bullet icon

Solid understanding of data security, access management, and governance frameworks.

bullet icon

Strong communication skills and ability to work with cross-functional teams.

Nice to have

bullet icon

Experience with Azure Databricks specifically (preferred), including integration with ADF, ADLS, and Azure DevOps.

bullet icon

Knowledge of MLflow, feature engineering, or machine learning workflows.

bullet icon

Exposure to automation frameworks, DevOps practices, and infrastructure-as-code (Terraform, ARM, CloudFormation).

bullet icon

Familiarity with Unity Catalog, Lakehouse architecture, and data governance concepts.

bullet icon

Experience working within structured change, incident, and release management frameworks.

Other
seniority icon

Languages

English: B2 Upper Intermediate

seniority icon

Seniority

Senior

Gurugram, India

Req. VR-122115

BigData Development

BCM Industry

16/04/2026

Req. VR-122115

Apply for Databricks Developer with Cloud Experience in Gurugram

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.