Senior Data Engineer

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Pune, India

specialization icon

Data Modeling

lob icon

BCM Industry

date icon

21/05/2026

Req. VR-122986

Apply
Project description

We are looking for a highly skilled Senior/Lead Data Engineer to design, build, and manage scalable data pipelines and data lake solutions. You need to have strong expertise in big data technologies, cloud platforms, and data engineering best practices, along with experience leading teams and delivering high-impact data solutions.

Responsibilities
bullet icon

Key Responsibilities:

bullet icon

Design and develop end-to-end ETL/data pipelines using PySpark, Databricks, Delta Lake, and AWS S3.

bullet icon

Integrate data from APIs, mainframe systems, HDFS, Hive, Delta tables, and AWS S3 into enterprise data lakes.

bullet icon

Perform Exploratory Data Analysis (EDA) and Data Quality Analysis (DQA).

bullet icon

Implement Delta Lake best practices including ACID transactions, schema enforcement, and incremental loads.

bullet icon

Build and optimize scalable, reliable, and fault-tolerant pipelines.

bullet icon

Orchestrate workflows using Databricks Workflows, Airflow (EMR), and Control-M.

bullet icon

Collaborate with business stakeholders to translate requirements into technical solutions.

bullet icon

Ensure data governance, data quality, and performance optimization.

bullet icon

Troubleshoot production issues and provide timely resolution. Leadership Responsibilities:

bullet icon

Lead and mentor a team of data engineers.

bullet icon

Conduct code reviews and enforce best practices.

bullet icon

Drive solution design and architecture decisions.

bullet icon

Provide technical guidance and delivery support.

bullet icon

Manage production support and ensure SLA adherence.

bullet icon

Work hours are 11 am/12.00 pm

bullet icon

8.00 pm/9.00 pm IST

bullet icon

You should be able to do hybrid role 2-3 days a week from office, have very strong preference

Skills

Must have

bullet icon

Strong experience in PySpark, Spark SQL, and Python

bullet icon

Hands-on experience with Databricks and Delta Lake

bullet icon

Strong understanding of data lake and data warehouse concepts

bullet icon

Experience with AWS services (S3, EMR)

bullet icon

Strong SQL and Hive/HDFS experience

bullet icon

Experience with Airflow, Control-M, or similar tools

bullet icon

Knowledge of data quality frameworks

bullet icon

Strong problem-solving and analytical skills

bullet icon

Excellent communication and stakeholder management

bullet icon

Ability to work in a fast-paced environment

Nice to have

bullet icon

Experience in Insurance domain

bullet icon

Exposure to ML data pipelines

bullet icon

CI/CD and DevOps knowledge

bullet icon

Experience handling large-scale data (100M+ records/day)

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

Pune, India

Req. VR-122986

Data Modeling

BCM Industry

21/05/2026

Req. VR-122986

Apply for Senior Data Engineer in Pune

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.