Azure Databricks Lead

About the role

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Job Location: Charlotte, NC - Onsite Hybrid

Responsibilities

• Design enterprise-scale Lakehouse architectures using Databricks.
• Define target-state data platform architectures and migration roadmaps.
• Develop reference architectures, reusable frameworks, and accelerator solutions.
• Establish enterprise data governance, security, and operational standards.

Requirements

• Well versed with role based access controls, data masking, developing models with Unity Catalog to enable secure sharing and ensure classification, lineage, and auditability.
• Hands on experience with Pyspark job development and implementation.
• Familiarity with CI/CD methods desired.
• Background working with orchestration tools, such as Airflow.
• Strong knowledge of Unity Catalog and large scale governance.
• Experience in advanced features of Databricks like Databricks Apps, Delta sharing.
• Knowledge of real time and streaming integration.

Pay

The base compensation range for this role in the posted location is: 110841 - 145000

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade
• Company paid holidays
• Personal Days
• Sick Leave
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs
• Other benefits as provided by local policy and eligibility