Senior AI Data Engineer

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Chennai, India

specialization icon

AI/ML

lob icon

BCM Industry

date icon

31/08/2026

Req. VR-121109

Apply
Project description

We are looking for AI Engineers for a strategic initiative to build Agentic AI use cases around Trading Surveillance. Ideal candidate is someone with strong pyspark background coupled with proven experience build Agentic AI pipelines for code conversion from Q KDB to Pyspark.

Responsibilities
bullet icon

Design, develop, and maintain full-stack Python applications with modern frontend frameworks

bullet icon

Build and optimize RAG (Retrieval-Augmented Generation) systems for AI applications

bullet icon

Create and implement efficient vector databases and knowledge stores

bullet icon

Develop APIs that connect frontend interfaces with backend AI services

bullet icon

Implement and maintain CI/CD pipelines for AI applications

bullet icon

Monitor application performance and troubleshoot issues in production

bullet icon

Design and maintain data pipelines, ETL/ELT workflows, and data infrastructure to support AI and analytics workloads

Skills

Must have

bullet icon

Minimum of 5 years of experience in AI/ML solution implementation (mandatory)

bullet icon

Minimum of 3 years of experience in Pyspark processing high volume data (mandatory)

bullet icon

AI & ML Skills:

bullet icon

Multi-Agent System Design & Orchestration

bullet icon

Full-stack AI Integration (Frontend to Backend)

bullet icon

Advanced Prompt Engineering

bullet icon

LLM Observability, Evaluation & Monitoring (LLMOps)

bullet icon

Data Engineering Skills:

bullet icon

Proficient in Pyspark coding and concepts. Example: Lazy evaluation, window functions, spark architecture and performance finetuning (ex: data skew reduction (salting etc), joins (broadcast, merge sort joins ect)

bullet icon

SQL proficiency and query optimization

bullet icon

Main Technologies:

bullet icon

Pyspark

bullet icon

Git hub Copilot

Nice to have

bullet icon

--

Other
seniority icon

Languages

English: C2 Proficient

seniority icon

Seniority

Senior

Chennai, India

Req. VR-121109

AI/ML

BCM Industry

31/08/2026

Req. VR-121109

Apply for Senior AI Data Engineer in Chennai

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.