Sr Databricks Data Engineer

Location: Brazil (preference) and Mexico. Duration: 6 to 12 months. Rates as per MSA. Client: Mondelez.

Role Summary

We are seeking an experienced Senior Databricks Data Engineer with 5‑10 years of experience in designing, building, and optimizing modern data platforms. The ideal candidate will have deep expertise in the Databricks ecosystem, including Databricks Genie, Delta Lake, Unity Catalog, SQL, Workflows, with a strong foundation in data engineering and analytics for the client. The candidate will be responsible for building scalable data pipelines, enabling self‑service analytics, supporting AI‑driven insights, and working closely with global stakeholders. Portuguese language proficiency is mandatory to effectively collaborate with Portuguese‑speaking business and technical teams.

Key Responsibilities

• Be an integral part of large‑scale client delivery and data transformation engagements.
• Design, develop, and maintain scalable data pipelines using Databricks and Spark technologies.
• Build and optimize ETL/ELT workflows to ingest, process, and transform large volumes of structured and unstructured data.
• Leverage Databricks Genie to enable natural language querying and self‑service business insights.
• Develop and manage Lakehouse architectures using Delta Lake and Databricks best practices.
• Implement data governance, lineage, security, and access control using Unity Catalog.
• Work across all phases of the SDLC including requirement gathering, design, development, testing, deployment, and support.
• Perform performance tuning and optimization of Spark workloads and distributed data processing jobs.
• Collaborate with data architects, data analysts, business stakeholders, and cross‑functional teams to deliver business‑driven solutions.
• Mentor junior team members and contribute to technical excellence and engineering best practices.
• Drive data quality, monitoring, and operational excellence across enterprise data platforms.
• Communicate effectively with Portuguese‑speaking stakeholders to understand requirements, provide updates, and deliver solutions.

Required Qualifications

• Bachelor's or master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 5‑10 years of experience in Data Engineering, Big Data, or Analytics Engineering.
• Strong hands‑on experience with the Databricks platform.
• Expertise in Databricks Workflows, Databricks SQL, Databricks Genie, Delta Lake, Unity Catalog, and Lakehouse Architecture.
• Strong programming experience in SQL.
• Experience designing and developing enterprise‑scale data pipelines and transformation frameworks.
• Strong understanding of relational, dimensional, and modern data modeling techniques.
• Experience handling large‑scale distributed data processing workloads.
• Knowledge of data governance, data quality, metadata management, and security best practices.
• Experience with Git‑based source control and CI/CD practices.

Preferred Qualifications

• Experience implementing Data Intelligence and AI‑powered analytics solutions within Databricks.
• Familiarity with Machine Learning workflows and MLOps concepts.
• Experience integrating Databricks with enterprise data sources, BI platforms, and reporting tools.
• Knowledge of data streaming technologies such as Spark Structured Streaming and Kafka.
• Databricks Certified Data Engineer Associate or Professional certification.
• Experience working in global delivery environments.

Required Skills

Technical Skills

• Databricks
• Databricks Genie
• Delta Lake
• Unity Catalog
• Databricks SQL
• Databricks Workflows
• SQL
• Data Modeling
• ETL/ELT Development
• Data Governance
• Lakehouse Architecture
• Git & CI/CD

Functional Skills

• Team handling and mentoring
• Stakeholder management
• Project management
• Problem solving
• Analytical thinking
• Communication skills
• Creative thinking
• Client engagement

Language Requirements

• Portuguese and Spanish – read, write, and speak (mandatory).
• English proficiency required for global collaboration.