Position

Backend Developer,
Middletown, NJ

Location


Middletown, NJ

Office Address


Project Description


Role is a big data software engineer, supporting several different applications and projects in the Data Science department. One of the applications builds video session records from one of the Data Science feeds - Creates a daily report based off the video session records by service providers. Another application receives and scans data and publishes it to one of the datalakes. Maintaining statistics on ingested and published files.

Responsibilities


    This person will need to be able to:
    • be plugged into any project in a developer capacity
    • be able to translate business requirements into software architecture and design
    • and execute - develop code, build and execute unit testing, work with product owners, other developers and leads on the team, QA and support personnel to architect, design, build, test, deploy, fix and support her code.

Skills


Must have

    a. Golang, C/C++, Python and shell knowledge (not all are mandatory)
    b. Pyspark - allow python to access a Hadoop environment through SPARK
    c. SQL (querying and working with major SQL DBs — e.g. Oracle, Postgres, MySQL, ..)
    d. Extensive experience working in a Linux and Hadoop environment
    i. Experience in basic system administration
    e. Experience in development of high-performance Linux/Unix applications, including multithreading/multiprocessing
    f. HDFS dfs CLI - command line interface
    g. Experience with processing large amounts of data
    i. data ingestion, data movement, data cleansing, data quality
    h. Kafka
    i. Knowledge of Hive, Postgres
    j. Understanding of data networking fundamentals (IP, TCP, UDP, GTP, etc.) and experience with basic network configuration

Nice to have

    • Azure
    • C
    • DataBricks
    • Snowflake
    • Palantir

Languages


English: C2 Proficient

Seniority


Senior

Relocation package


If needed, we can help you with relocation process. Click here for more information.

Work Type


Other System Languages

Ref Number


VR-61000