Azure Databricks Admin

About the role

The role involves overseeing the administration, security, and integration of new NPI tools on Azure/AWS platforms. It includes maintaining platform stability, operational efficiency, and security governance, while aligning with enterprise data management strategies.

Responsibilities

• Oversee Platform administration, Security, and new NPI tools integration on Azure/AWS
• Manage cloud platform operations with a focus on FinOps support, optimizing resource utilization, cost visibility, and governance across multi-cloud environments
• Support business users, drive metadata adoption, and maintain high availability of platforms
• Work closely with Data Governance, Data Engineering, Infrastructure, and Security teams to design scalable solutions

Requirements

• Bachelor’s degree or foreign equivalent from accredited institution
• Three years of progressive experience in IT cloud infrastructure, architecture, and operations, including security and platform administration
• Experience in designing scalable data ingestion and transformation workflows, including batch and streaming processes
• Experience in creating integration guidelines to configure and integrate Databricks with other security tools relevant to data access control
• Experience in implementing data security and governance using Unity Catalog, access controls, and data classification techniques
• Experience in supporting migration of legacy systems to Databricks on cloud platforms like Azure, AWS, or GCP
• Expertise in Databricks platform, security features, Unity Catalog, and data access control mechanisms
• Experience with data classification and masking techniques
• Strong understanding of cloud cost management, with hands-on experience in usage analytics, budgeting, and cost optimization strategies across multi-cloud platforms
• Deep expertise in Azure/AWS big data & analytics technologies, including Databricks, real-time data ingestion, data warehouses, serverless ETL, No SQL databases, DevOps, Kubernetes, virtual machines, web/function apps, monitoring and security tools
• Deep expertise in Azure/AWS networking and security fundamentals, including network endpoints & network security groups, firewalls, external/internal DNS, load balancers, virtual networks and subnets
• Proficiency in scripting and automation tools, such as PowerShell, Python, Terraform, and Ansible
• Certifications in Azure/AWS/Databricks platform administration, networking, and security are preferred
• Experience with machine learning & AI integration using MLflow, AutoML, or custom models

Qualifications

• Located within commuting distance of Plano/TX, Hartford, Indianapolis, Raleigh or willing to relocate to the area