Senior Spark Developer (Python, AWS, SQL)

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Toronto, Canada

specialization icon

BigData Development

lob icon

BCM Industry

date icon

04/09/2025

Req. VR-117257

Apply
Project description

We are seeking a highly skilled Spark Developer with strong experience in Python, AWS, and SQL to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing solutions, ensuring data quality, scalability, and performance. This role requires a solid background in distributed computing, cloud environments, and data engineering best practices.
Compensation for NYC: 120-150000 USD Gross per year and based on interview results.

Responsibilities
bullet icon

Design, develop, and maintain scalable data pipelines using Apache Spark (batch and/or streaming).

bullet icon

Build, optimize, and manage ETL/ELT workflows integrating multiple data sources.

bullet icon

Develop data solutions in Python for data transformations, automation, and orchestration.

bullet icon

Leverage AWS services (S3, EMR, Glue, Lambda, Redshift, Kinesis, etc.) to implement cloud-native data platforms.

bullet icon

Write efficient SQL queries for data extraction, transformation, and reporting.

bullet icon

Ensure data quality, lineage, and governance across pipelines.

bullet icon

Collaborate with data engineers, architects, and analysts to deliver end-to-end data solutions.

bullet icon

Troubleshoot performance bottlenecks and optimize Spark jobs for speed and cost-efficiency.

Skills

Must have

bullet icon

8+ years of experience in data engineering or backend development.

bullet icon

Hands-on experience with Apache Spark (PySpark) in large-scale data environments.

bullet icon

Strong proficiency in Python programming.

bullet icon

Expertise in SQL (including advanced queries, performance tuning, and optimization).

bullet icon

Experience working with AWS services such as S3, Glue, EMR, Lambda, Redshift, or Kinesis.

bullet icon

Understanding of data warehousing concepts and ETL best practices.

bullet icon

Strong problem-solving skills and ability to work in an agile, collaborative environment.

Nice to have

bullet icon

Experience with Databricks or similar Spark-based platforms.

bullet icon

Knowledge of streaming frameworks (Kafka, Flink).

bullet icon

Familiarity with CI/CD pipelines, Docker, Kubernetes, Terraform.

bullet icon

Exposure to data modeling (star schema, snowflake, data vault).

bullet icon

Experience in financial services / capital markets .

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

Toronto, Canada

Req. VR-117257

BigData Development

BCM Industry

04/09/2025

Req. VR-117257

Apply for Senior Spark Developer (Python, AWS, SQL) in Toronto

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.