Project description

We are seeking a highly experienced Databricks Architect to lead the design, implementation, and optimization of enterprise-grade data platforms and AI-enabled workloads for a global food corporation. This role requires a hands-on technical leader who can translate business and data requirements into scalable Databricks-based solutions while ensuring robust governance, performance, and operational resilience. The ideal candidate will combine deep Databricks expertise with strong architecture leadership and the ability to operate within a managed service delivery model.

Responsibilities

Lead the architecture, design, and implementation of Databricks-based data platforms, pipelines, and AI/ML workloads.

Define scalable lakehouse patterns using core Databricks capabilities such as Apache Spark, Delta Lake, Databricks SQL, MLflow, and governance components.

Design robust batch and streaming data pipelines for high-volume, business-critical workloads.

Establish architecture standards for performance optimization, workload orchestration, reliability, observability, and cost control.

Translate business and technical requirements into solution blueprints, reference architectures, and implementation roadmaps.

Collaborate with data engineers, analysts, data scientists, DevOps teams, and business stakeholders to deliver end-to-end solutions.

Ensure strong data governance, security, and compliance practices across the Databricks environment.

Support AI and advanced analytics use cases by enabling reliable feature engineering, model lifecycle practices, and production-ready data foundations.

Provide technical leadership during solution delivery, troubleshooting, and optimization of existing workloads.

Act as a trusted advisor to client stakeholders, offering recommendations on architecture decisions, risks, trade-offs, and delivery priorities.

Skills

Must have

Deep hands-on expertise with the Databricks platform, including architecture, workspace design, cluster strategy, jobs orchestration, and platform optimization.

Strong command of Apache Spark and distributed data processing concepts, including performance tuning and optimization for complex data engineering workloads.

Proven experience designing and delivering enterprise data solutions using Delta Lake and lakehouse architecture principles.

Strong proficiency in Python and SQL; Scala is an advantage.

Demonstrated capability in building and optimizing ETL/ELT pipelines, data models, and large-scale ingestion frameworks.

Experience supporting AI/ML workloads on Databricks, including MLflow, model lifecycle considerations, and production-ready data preparation.

Solid knowledge of cloud-native architecture patterns on AWS, Azure, or GCP, including storage, networking, identity, and security integration.

Experience with data governance, access control, lineage, and compliance frameworks in enterprise environments.

Familiarity with CI/CD, infrastructure-as-code, monitoring, and operational best practices for data platforms.

Ability to engage in deep technical problem-solving and contribute immediately to complex delivery scenarios with minimal ramp-up time.

Nice to have

Databricks certifications relevant to data engineering, machine learning, or platform architecture.

Experience in large enterprise or global delivery environments with complex stakeholder landscapes.

Background in consumer goods, manufacturing, supply chain, or similarly data-intensive industries.

Experience with real-time processing, orchestration frameworks, and integration with enterprise data ecosystems.

Strong communication skills with the ability to explain architecture decisions to both technical and non-technical stakeholders.

Other

Languages

Spanish: C1 Advanced,English: C1 Advanced

Seniority

Lead

Related jobs

View all vacancies

Mexico City, Mexico

Req. VR-122964

Data Architecture

Cross Industry Solutions

18/05/2026

Req. VR-122964

Apply for Databricks Architect in Mexico City

*Indicates a required field

First name

Last name

Your country

Your City

Phone

Specialization

Attach your resume (max file size 1MB; allowed extensions: doc, txt, pdf, docx) Upload resume

Number of years of experience in the specialization you are applying for

What are your monthly gross salary expectations?

Read Explanatory Notes

Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.

Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.

We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.

With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.

Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: DPO@luxoft.com.

Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.

By clicking the Agree and Send button, you consent that Luxoft Holding Inc. can process your provided personal data for the purpose of processing your application to establish a potential employment, internship or relocation with Luxoft Holding Inc., a relevant affiliate of the Luxoft Group or Luxoft Group’s clients, as applicable. You consent to the retention of your personal data, with the purpose of contacting you for potential future employment opportunities. If you refer a friend, we will process your provided personal data of you and your referral to award you with a bonus for such recommendation. You can withdraw your consent at any time with effect for the future. Before you consent, please click on „Read these Explanatory Notes“ and view our Privacy Notice (e.g. for your data subject rights).

Note: Our system automatically converts each CV into our standardized format, enabling our HR teams to process applications more efficiently.

I consent that Luxoft Holding Inc. and the affiliates of the Luxoft Group can process my personal data for the purpose of sending me regular emails with information about Luxoft as an employer including job vacancies and (ii) marketing communications with information about recruitment-related events, organized webinars, conferences, as well as the Logeek Magazine and other similar publications. I can withdraw my consent at any time with effect for the future. These communications are personalised to my interests in accordance with our Privacy Notice.

Related Jobs

All jobs

MENU

Databricks Architect

Project description

Responsibilities

Skills

Other

Related jobs