Data Engineer,




Office Address

Project Description

About the Project

Luxoft has contract with a major Telecommunications provider looking to build a team of strong technical consultants to drive cost savings through data exploration. This agile team will work closely with clients to identify data sources, bring them together and normalize the data structure to be ingested for analytics. The work will be centered around telco network equipment to create a repeatable framework of data exploration. This high visibility project will drive business value realization using big data techniques and agile methodologies.

This project will implement a 3 step process including the following:
o First to identify the contacts, source of information and availability of data.
o Second, using the requirements, develop a pipeline for the data into a normalized structure called the BRD (Business Ready Dataset).
o Third will be to automate the process of data acquisition and BRD creation into a production environment with checks and balances (monitoring, etc.).

These steps will be implemented by various roles/team members and repeated for multiple equipment types using an Agile team method.


    o Development of a self-service platform to be used by our customers driving cost savings initiatives.
    o Contribute to an Agile team of developers focused on data ingestion across multiple sources.
    o Operate in a CI/CD environment.
    o Implement data extraction from various/distributed sources utilizing scripting and storage in a SQL/HSQL environment.
    o Strong analytical, planning, and organizational skills with an ability to manage competing demands
    o Strong experience in data exploration with large data sets


Must have

    o SQL
    o Spark
    o Python/Pyspark
    o Scala
    o Hadoop
    o Linux and Bash (scripting)
    o HIVE HQL
    o Git
    o JAVA
    o Cloud (Azure preferred)
    o MySQL (optional)

Nice to have

    o Cloud Big Data expertise
    o Experience in Telco networking equipment and the data produced/generated across various equipment vendors


English: C2 Proficient

Relocation package

If needed, we can help you with relocation process. Click here for more details: see more details

Work Type

BigData (Hadoop etc.)

Ref Number


Explore More

LoGeek Magazine
icon Logeek Luxoft
Learn more
icon Events Luxoft
Learn more
Relocation Program
icon Relocation Luxoft
Learn more
icon Referral Luxoft
Learn more
and Grads
icon Students Luxoft
Learn more