Back to jobs
Senior Data Engineer
Successfully
Req. VR-122051
We are seeking a Senior Data Engineer with 7-8 years of experience designing and delivering large-scale, cloud-native data integration solutions. The role focuses on building and optimizing PySpark and Informatica-based ETL pipelines, integrating enterprise MDM systems, and enabling reliable, high-performance data platforms to support analytics and operational use cases across the organization.
Design and implement end-to-end PySpark ETL pipelines to extract, transform, and load large-scale MDM datasets into AWS S3 and cloud platforms.
Optimize pipeline performance using Spark SQL tuning, caching strategies, and efficient cluster utilization to ensure scalable and cost-effective processing.
Develop reusable, standardized PySpark components aligned with internal engineering frameworks and best practices.
Build, maintain, and support Informatica BDM and PowerCenter mappings, workflows, and sessions for business-critical ETL processes feeding Oracle MDM and cloud destinations.
Integrate data from multiple heterogeneous sources, including legacy SQL databases, Oracle MDM, and Kafka streams.
Automate and orchestrate batch workflows using Autosys and Apache Airflow.
Collaborate with architects, data stewards, analysts, and cross-functional stakeholders to deliver cloud migration and data modernization initiatives.
Ensure proper unit testing, SIT/UAT support, documentation, and production deployments for all data engineering deliverables.
Must have
7-8 years of hands-on experience in data engineering, ETL development, and large-scale data integration within enterprise environments.
Strong expertise in PySpark, Spark SQL, and distributed data processing.
Hands-on experience with AWS, particularly S3 and cloud-based data platforms.
Solid experience with Informatica BDM and PowerCenter.
Experience integrating data from Oracle MDM, relational databases, and Kafka.
Proficiency with workflow orchestration tools such as Autosys and Apache Airflow.
Strong understanding of ETL design patterns, data quality frameworks, and MDM concepts.
Nice to have
N/A
Languages
English: C1 Advanced
Seniority
Senior
Bengaluru, India
Req. VR-122051
BI Engineering
BCM Industry
06/05/2026
Req. VR-122051
Apply for Senior Data Engineer in Bengaluru
*Indicates a required field