Lead Data Engineer

About the role

The Lead Data Engineer- Databricks is responsible for leading the design and delivery of modern data and analytics solutions for clients across various industries. This role involves translating business needs into scalable data platform capabilities using Databricks and cloud-based technologies.

Responsibilities

• Leading the design and delivery of Databricks-based data and analytics solutions for client engagements
• Managing project teams and workstreams across requirements gathering, solution design, development, testing, and deployment
• Translating business and technical requirements into scalable data pipelines, data models, and platform capabilities
• Advising client stakeholders on architecture, implementation approaches, and operating model considerations for modern data platforms
• Overseeing solution quality, issue resolution, and delivery progress while supporting project economics and timeline management

Requirements

• Strong experience leading delivery teams, advising stakeholders, and driving solution execution across complex environments
• Bachelor's degree with 6+ years of experience delivering data engineering, analytics, or cloud data platform solutions
• 3+ years of experience with Databricks and Apache Spark, and 3+ years of experience with Python and SQL
• 2+ years of experience leading project teams or workstreams
• Ability to work independently and collaborate as part of a team, with effective written and verbal communication skills, meticulous attention to detail, and ability to build and sustain professional relationships
• Ability to lead projects or workstreams, manage and prioritize multiple tasks in a fast-paced and dynamic environment, and provide clear guidance to others

Qualifications

• Master's degree preferred
• Experience with Delta Lake, Unity Catalog, or MLflow
• Experience with AWS, Azure, or GCP
• Experience designing batch and streaming data pipelines
• Experience with data governance, data quality, or platform security controls
• Experience supporting client presentations, proposals, or solution demonstrations