Senior Software Engineer - AWS, Glue, PySpark

Apply
Apply

Share

successfully icon

Successfully

The vacancy has been successfully added to favorites

location icon

Melbourne, Australia

specialization icon

Python

lob icon

BCM Industry

date icon

24/11/2025

Req. VR-115355

Apply
Project description

Join a high‑performing engineering squad building and operating production‑grade software and data processing solutions on AWS. You will drive a shift‑left quality culture, strong automation, and resilient designs while owning features end to end from design to deployment and monitoring. The environment includes Python, PySpark and Spark on AWS (Glue, EMR, S3), Airflow for orchestration, and modern CI/CD. The team partners closely with product and platform groups to deliver reliable, observable services for financial services use cases.

Responsibilities
bullet icon

Design, build and maintain robust, scalable services and data processing pipelines in Python and PySpark on AWS.

bullet icon

Implement automation across testing, quality, security and deployment, embedding unit, integration and contract tests into CI/CD.

bullet icon

Orchestrate and operate jobs and workflows using Airflow and AWS Glue, ensuring reliability, cost efficiency and observability.

bullet icon

Collaborate with product, platform and QA to ensure systems are testable, observable and resilient, with clear SLOs and dashboards.

bullet icon

Own features end to end including design, implementation, code reviews, performance tuning, deployment and production support.

bullet icon

Contribute to engineering standards, code quality and governance, including DevSecOps practices and release processes.

bullet icon

Mentor engineers, promote best practices and continuously improve tooling, pipelines and developer experience.

Skills

Must have

bullet icon

Experience:

bullet icon

8+ years of hands-on programming and software development.

bullet icon

Proven ability to design and build automation frameworks.

bullet icon

Familiarity with observability tools and microservices architecture.

bullet icon

The successful applicant will use a broad range of tools, languages, and frameworks. We encourage applicants who might have a strong number of skills below, even if you do not know all of them.

bullet icon

Python and scripting: Strong hands‑on development in Python plus pragmatic shell scripting in Linux environments.

bullet icon

AWS data stack: Commercial experience with AWS Glue, Spark/PySpark and S3 for large‑scale data processing.

bullet icon

Orchestration: Building, scheduling and operating pipelines with Airflow including DAG design, retries and SLAs.

bullet icon

SQL and RDBMS: Solid SQL for data transformation and analysis, with exposure to Teradata or Oracle.

bullet icon

CI/CD and shift‑left testing, DevSecops: Unit, integration and contract tests embedded in pipelines using Git‑based workflows and common tools such as TeamCity, GitHub Actions, Jenkins or Octopus.

bullet icon

Observability: Practical use of logging, metrics and tracing with tools like CloudWatch and Splunk to monitor production health.

bullet icon

Cloud‑native engineering: Designing for scalability, reliability and cost on AWS, following security and governance standards.

bullet icon

AI skills: Effective use of AI coding assistants and test‑generation tools e.g. (e.g., GitHub Copilot, Roo code) to accelerate development while maintaining quality.

Nice to have

bullet icon

Ab Initio or SAS: Prior experience integrating or migrating legacy ETL workloads.

bullet icon

Data warehousing: Knowledge of Redshift, Athena, EMR or Iceberg formats.

bullet icon

API and microservices: Experience testing and integrating with RESTful services and event streams.

bullet icon

Test automation frameworks: Familiarity with Playwright, DevTest, Appium, Sahi or similar, plus contract testing.

bullet icon

Dashboards and reporting: Building engineering or quality dashboards for delivery and production health.

bullet icon

Team leadership: Mentoring engineers and uplifting standards across squads.

Other
seniority icon

Languages

English: C2 Proficient

seniority icon

Seniority

Senior

Melbourne, Australia

Req. VR-115355

Python

BCM Industry

24/11/2025

Req. VR-115355

Apply for Senior Software Engineer - AWS, Glue, PySpark in Melbourne

*Indicates a required field

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.


Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.


We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.


With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.


Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.


Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.