Project description

As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered on the banking & finance sector. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques and intuitive workflows that allow our users to derive insights from big data that in turn drive their businesses. You will have the opportunity to create high-performance analytic solutions based on data sets measured in the billions of transactions and front-end visualizations to unleash the value of big data. You will have the opportunity to develop data-driven innovative analytical solutions and identify opportunities to support business and client needs in a quantitative manner and facilitate informed recommendations/decisions through activities like building automated data pipelines, designing data architecture/schema, performing jobs in big data cluster by using different execution engines and program languages such as Hive/Impala, Python, Kafka, PySpark etc.

Responsibilities

Drive the evolution of Data & Services products/platforms with an impact-focused on data engineering.

Design and implement scalable data architecture and data pipelines.

Solving complex problems with multi-layered data sets, as well as optimizing existing machine learning libraries and frameworks.

Provide support for deployed data applications and analytical models by being a trusted advisor to Data Scientists/AI Engineers.

Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.

Ingest, and incorporate new sources of real-time, streaming, batch into our platform to enhance the insights we get from running tests and expand the ways and properties on which we can test and experiment with new tools to streamline the development, testing, deployment, and running of our data pipelines.

Evaluate trade-offs between many analytics solutions to a problem, considering usability, technical feasibility, timelines, and differing stakeholder opinions to make a decision.

Break large solutions into smaller, releasable milestones to collect data and feedback from product managers, clients, and other stakeholders.

Evangelize releases to users, incorporating feedback, and tracking usage to inform future development.

Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.

Work with small, cross-functional teams to define the vision, establish team culture and processes.

Escalate technical errors or bugs detected in project work.

Skills

Must have

Must-Have Years of Experience : 8+ years

Working proficiency in using Python, PySpark, SQL, Hadoop platforms to build Big Data products & platforms.

Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts

At least 6 years of relevant hands-on experience as a Data Engineer in an individual contributor capacity.

Experience in working with Cloud APIs (e.g., Azure, AWS)

Experience in working with SQL database like Postgres, Oracle

Preferably with hands-on experience with Hadoop big data tools (Hive, Impala, Spark)

Experience with data pipeline and workflow management tools: NIFI, Airflow.

Good troubleshooting and debugging skills.

Proficient in standard software development, such as version control, testing, and deployment using Jenkins & DAB (Databricks Asset Bundle).

Ability to quickly learn and implement new technologies.

Ability to Solve complex problems with multi-layered data sets.

Ability to innovate and determine new approaches & technologies to solve business problems and generate business insights & recommendations.

Ability to multi-task and strong attention to detail

Flexibility to work as a member of a matrix based diverse and geographically distributed project teams

Good communication skills

both verbal and written

and strong relationship, collaboration skills, and organizational skills.

Nice to have

Good-to-have

Experience in working with CI/CD.

Comfortable in developing shell scripts for automation.

Degree in Computer Science, Electrical Engineering or equivalent experience

Other

Languages

English: C1 Advanced

Seniority

Senior

Related jobs

View all vacancies

Data Engineer

BigData Development

United States of America

Central

Data Engineer with AWS

BigData Development

India

Gurugram

Data Engineer with AWS

BigData Development

India

Bengaluru

Pune, India

Req. VR-120495

BigData Development

BCM Industry

27/02/2026

Req. VR-120495

Apply for Senior Data Engineer in Pune

*Indicates a required field

First name

Last name

Your country

Your City

Phone

Specialization

Attach your resume (max file size 1MB; allowed extensions: doc, txt, pdf, docx) Upload resume

Number of years of experience in the specialization you are applying for

What are your monthly gross salary expectations?

Read Explanatory Notes

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.

Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.

We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.

With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.

Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.

Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.

By clicking the Agree and Send button, you consent that Luxoft Holding Inc. can process your provided personal data for the purpose of processing your application to establish a potential employment, internship or relocation with Luxoft Holding Inc., a relevant affiliate of the Luxoft Group or Luxoft Group’s clients, as applicable. You consent to the retention of your personal data, with the purpose of contacting you for potential future employment opportunities. If you refer a friend, we will process your provided personal data of you and your referral to award you with a bonus for such recommendation. You can withdraw your consent at any time with effect for the future. Before you consent, please click on „Read these Explanatory Notes“ and view our Privacy Notice (e.g. for your data subject rights).

Note: Our system automatically converts each CV into our standardized format, enabling our HR teams to process applications more efficiently.

I consent that Luxoft Holding Inc. and the affiliates of the Luxoft Group can process my personal data for the purpose of sending me regular emails with information about Luxoft as an employer including job vacancies and (ii) marketing communications with information about recruitment-related events, organized webinars, conferences, as well as the Logeek Magazine and other similar publications. I can withdraw my consent at any time with effect for the future. These communications are personalised to my interests in accordance with our Privacy Notice.

Related Jobs

All jobs

MENU

Senior Data Engineer

Project description

Responsibilities

Skills

Other

Related jobs

Data Engineer

Data Engineer with AWS

Data Engineer with AWS