Python Java Data Engineer,
Bangalore

Project Description

---

The Bank was founded in 1853, is an international banking organisation, headquartered in London, with some 1,750 offices in more than 70 countries, with a world-wide staff complement of about 100,000 people.
Excelian have been asked to build a Digital focused fully autonomous feature team to assist with a number of cutting edge initiatives.

Responsibilities

---

• 8+ years of experience as a developer with experience in developing distributed systems; demonstrated experience mentoring and guiding junior members of the team
• Capable of mentoring and guiding junior members of the team who have had less experience in developing software systems
• Demonstrated ability to program in Python (working knowledge of Pandas, Numpy and Asyncio)
• Strong knowledge of Python 3 and associated libraries. Constantly write unit tests and document all code.
• Solid understanding of the development process pipeline, effective code version control & continuous Integration, Deployment.
• Working knowledge in various database and storage technologies such as Postgres, S3
• Excellent problem solving abilities and judgment with strong attention to detail
• Motivated by the transformational effects of technology-at-scale
• Good to have knowledge of great_expectations.

Skills

---

Must have

o Must have worked on at least 2 End-To-End implementation of Data Related Project
o Should have hands-on experience in various data sources(Postgres/Oracle/Excel/Parquet/CSV/ORC/s3)
o Should have hands-on experience in building a ETL/ELT pipeline to stream the data to Hadoop EcoSystem or Target Storage Platform
o Solid experience in building a data model in various SQL/NoSQL database (Postgres/Cassandra/Elastic Search/MangoDB)
o Experience in building a Data Quality Framework on various types of Datasets
o Expertise in DW/DM to store the insights
o Solid experience in building the various micro service using either Flask/ Other Framework to expose the insights
o Experience in deploy the MicroService in Docker/Kubernate/OpenShift
o Expertise in Numpy, Pandas, Python/Java, Spark, Hive, HDFS
o Experience in fine tuning the performance in DW/DM

Nice to have

o Knowledge or working experience in Exploratory Data Analysis
o Knowledge or working experience in building AI or ML pipeline
o Knowledge or working experience in various ML/AI/Statistical Alogrithm

Languages

---

English: A1 Beginner

Relocation package

---

If needed, we can help you with relocation process. Click here for more details: see more details