Bright minds,
sharp solutions

Luxoft is a global IT service provider of innovative technology solutions that delivers measurable business outcomes to multinational companies. Its offerings encompass strategic consulting, custom software development services, and digital solution engineering. Luxoft enables companies to compete by leveraging its multi-industry expertise in the financial services, automotive, communications, and healthcare & life sciences sectors. For more information, please visit the website.

Line of Business:

Financial Services

Position:

Big Data Architect

Project Description

Big Data Architect

Responsibilities

 Analyse the existing stack and provide recommendation
 Designing the Technical architecture and application customization
 Responsible for development and troubleshooting on Hadoop technologies like HDFS, Hive, Sqoop, Spark, MapReduce2, HBase, and Kafka.
 Translate, load and exhibit unrelated data sets in various formats and sources.
 Managing and Reviewing Hadoop Log Files
 Manage Hadoop jobs using scheduler
 Support MapReduce programs running on the Hadoop cluster.
 Fine tune applications and systems for high performance and higher volume throughput.

Skills

Must

 Extensive knowledge about Hadoop Architecture and HDFS
 Strong hands-on experience in Core Java (Ideally have the knowledge of Java 8)
 Familiar with Unix/Linux operation system
 Expertise in writing HiveSQL, Impala scripts, shell scripting
 Java Map Reduce
 Proven Knowledge of workflow/ schedulers
 Ability to deal with Data Loading tools like Flume and Sqoop
 Strong knowledge in SQL (Oracle, MySQL, MariaDB)
 Cloud exposure with OpenShift, Docker image build
 Knowledge in Kafka and Spark Streaming
 Good Knowledge in Spark Programming

Nice to have

 Experience in ELK or Solr search tools would be advantageous

Languages

  • English: Advanced/Fluent

Relocation package

If needed, we can help you with relocation process. Click here for more details:

WHERE
Singapore
Work Type
BigData (Hadoop etc.)
ADD TO MY JOBS
RECOMMEND A FRIEND
Apply

Check us out on: