Platform and Databricks DevOps Engineer
About the role
As a Databricks Platform DevOps Engineer at Booz Allen, you'll lead the design, automation, and reliable operation of Databricks Lakehouse environments that power mission-critical analytics, AI, and data initiatives for defense, intelligence, and civil clients. You'll drive CI/CD maturity, infrastructure as code, platform governance, and operational excellence to deliver secure, scalable, and cost-optimized Databricks platforms at enterprise scale.
Due to the nature of work performed within this facility, U.S. citizenship is required.
Responsibilities
- Manage account and workspace administration, including creating and managing workspaces, configuring settings, enabling features such as serverless compute or previews, and handling account-level configurations via the account console.
- Oversee identity and access management, provisioning users, groups, and service principals via System for Cross-domain Identity Management (SCIM), assigning roles and entitlements, managing workspace assignments, and enforcing least-privilege access.
- Implement and govern Unity Catalog metastores, catalogs, schemas, tags, lineage, sharing, and fine-grained access controls to ensure data security, compliance, and discoverability across workspaces.
- Administer compute resources, managing cluster policies, instance pools, job clusters, serverless options, Photon engine usage, and resource limits to standardize environments and control costs.
- Own infrastructure as code deployments such as Terraform and Databricks Terraform Provider, across multiple environments such as dev, test, staging, and production, with strong governance and rollback capabilities.
- Design and maintain automation for notebooks, clusters such as serverless and Photon-optimized, Delta Live Tables pipelines, workflows and jobs, and Delta Lake configurations.
- Monitor platform health, performance, and costs, accessing audit logs, billable usage dashboards, system tables, and operational metrics, setting budget alerts, and optimizing spending.
- Enforce security and compliance best practices, including encryption, private networking, IP access lists, credential management, and alignment with FedRAMP and DoD standards.
- Automate administrative tasks using Databricks REST APIs, Terraform Databricks Provider, Asset Bundles, scripting, including Python or Bash, and CI/CD integrations for repeatable, auditable operations.
- Troubleshoot complex issues, perform root-cause analysis, maintain disaster recovery and backup strategies, and provide Tier-3 support to users, data engineers, and platform teams.
- Mentor junior administrators, conduct platform reviews, document procedures, and stay current with Databricks features such as Lakeflow or enhanced governance, to evolve client environments.
Requirements
- 3+ years of experience in Databricks administration
- Experience with cloud platform operations, data platform engineering, or DevOps or infrastructure roles
- Experience with Terraform or IaC tools, REST APIs, and monitoring and observability concepts
- Experience with scripting or automation in platforms, such as Python or Bash, for administrative tasks
- Experience with cloud using AWS, GCP, or Azure
- Ability to collaborate with technical teams and stakeholders
- Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
- Bachelor's degree
- Cloud Certification
Qualifications
- Experience administering Databricks such as account console, workspace settings, Unity Catalog, and compute or cluster management
- Experience with identity federation, including SCIM provisioning, role-based access control, and governance in cloud data platforms using AWS or GCP
- Experience developing enterprise cloud-native solutions involving Kubernetes, Docker, AWS, or Jenkins
- Experience with Azure
- Experience creating and improving continuous automation across multiple technical stacks
- Experience creating and improving continuous deployment tools built on Kubernetes
- Experience triaging and resolving issues related to both open-source and commercial tools in public cloud environments
- Possession of strong problem-solving, analytical, and communication skills
- Master’s degree
Benefits
Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values.
Pay
The projected compensation range for this position is $77,600.00 to $176,000.00 (annualized USD).
Schedule
Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility. Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility. Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.