Bright minds,
sharp solutions

Luxoft is a global IT service provider of innovative technology solutions that delivers measurable business outcomes to multinational companies. Its offerings encompass strategic consulting, custom software development services, and digital solution engineering. Luxoft enables companies to compete by leveraging its multi-industry expertise in the financial services, automotive, communications, and healthcare & life sciences sectors. For more information, please visit the website.

Line of Business:

Financial Services

Position:

Senior Big Data Developer, Warsaw

Project Description

Our client, top tier global investment bank, is building a new high-performance analytics platform with big data calculation engines and storage to aid in achieving its strategic goals.

The primary purpose of this platform is to calculate transaction costs analytics in both real-time and batch modes to feed this data to trading systems and reporting dashboards for quantitative traders.

Responsibilities

The candidate will develop high-performance calculation engine platform which processes huge volumes of data in streaming and batch modes as a part of a co-located team in Warsaw with close interaction with other teams over the globe.

- Analysis of existing systems to be replaced with new solution
- Design and architecture of the new platform
- Development of components to support existing functionality
- Creating components to implement new business demands
- Scalability and performance optimization
- Integration with various external data sources (Storm, JDBC, KDB+, websockets, REST services, flat files)
- Creating high-performance in-memory intermediate layer (Spark streaming, Redis)
- Organizing data logistics and processing (Kafka, Spark)
- Organizing efficient persistent data storage for reporting (HDFS, AVRO, parquet)
- Creating high-performance data processing engines both near real-time and batch (Spark, Spark Streaming)

Skills

Must

Skills required:
- Java 8 (+Spring) 3+ years
- Spark, Spark Streaming 2+ years
- Kafka 1+ years
- Parquet, AVRO
- HDFS, Hive, Hbase, Impala
- JDBC, KDB+, websockets, REST

Nice to have

Nice to have:
- Scala, Python
- Apache Storm
- Redis, in-memory storage

Languages

  • English: Upper-intermediate

Relocation package

If needed, we can help you with relocation process. Click here for more details:

Hot

WHERE

Warsaw

Work Type

BigData (Hadoop etc.)

Ref number
VR-41679
ADD TO MY JOB
RECOMMEND A FRIEND
Apply