Sr. Azure Databricks Admin (Onsite)

Responsibilities

• Administer and maintain Azure Databricks workspaces, clusters, and Unity Catalog across dev, staging, and production environments.
• Design and enforce cluster policies, access controls, and workspace configurations aligned with enterprise security standards.
• Manage Unity Catalog — including metastores, catalogs, schemas, and fine-grained data access policies.
• Monitor platform health, cluster utilization, job performance, and implement auto-scaling and cost optimization strategies.
• Integrate Databricks with Azure services including ADLS Gen2, Azure Key Vault, Azure Active Directory, Event Hubs, and Synapse Analytics.
• Implement secrets management, service principals, and managed identity configurations using Azure AD and Databricks Secrets.
• Automate infrastructure provisioning using Terraform, ARM/Bicep templates, or Databricks Terraform provider.
• Establish and maintain CI/CD pipelines for Databricks workflows using Azure DevOps or GitHub Actions.
• Collaborate with security teams to ensure compliance with data governance, audit logging, and lineage tracking.
• Troubleshoot cluster failures, job bottlenecks, Spark performance issues, and data pipeline errors.
• Maintain runbooks, platform documentation, and administer change management processes.

Requirements

Not specified

Qualifications

Not specified

Skills

Not specified

Benefits

Not specified

Pay

The annual salary for this position is between $ 90,000 - $ 145,000 depending on experience and other qualifications of the successful candidate.

Schedule

Not specified