Back to jobs
Senior Big Data Engineer (Java/Scala)
Successfully
Req. VR-117033
We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .
Choosing the right technologies for our use cases, deploy and operate.
Setting up Data stores structured, semi structured and non-structured.
Secure data at rest via encryption
Implement tool to access securely multiple data sources
Implement solutions to run real-time analytics
Use container technologies
Must have
6+ years of relevant technology experience
Programming Skills:
Strong proficiency in Java or Scala.
Solid understanding of SQL and experience working with structured, semi-structured, and unstructured data.
Big Data & Data Engineering:
Deep experience with Big Data frameworks such as Apache Spark, Hadoop, and Kafka.
Hands-on experience in designing and managing data pipelines, ETL workflows, and real-time streaming applications.
Familiarity with data warehousing solutions (e.g., Hive, Trino, BigQuery, Redshift, Snowflake).
Architecture & Infrastructure:
Background in microservices-based architectures and API integrations.
Hands-on expertise with Kubernetes and Docker for containerization and orchestration.
Cloud & DevOps:
Experience with cloud platforms like AWS, Google Cloud Platform (GCP), or Azure, including services such as EMR, Dataproc, or BigQuery.
Understanding of data security best practices, including encryption and secure access controls.
Development Practices:
Knowledge of Agile/Scrum methodologies.
Soft Skills:
Team-oriented, respectful, and able to collaborate effectively in cross-functional teams.
Strong problem-solving skills and a growth mindset with a willingness to learn and adapt.
Nice to have
Exposure to data visualization and exploration tools such as Apache Superset is a plus.
Experience with workflow orchestration tools such as Apache Airflow is an advantage.
Familiarity with Unix/Linux environments is beneficial.
Experience with CI/CD pipelines and modern DevOps tools is a plus.
Languages
English: C2 Proficient
Seniority
Senior
Chennai, India
Req. VR-117033
BigData Development
BCM Industry
05/09/2025
Req. VR-117033
Apply for Senior Big Data Engineer (Java/Scala) in Chennai
*Indicates a required field