Databricks Platform Engineer

About the role

Do you want to work at the forefront of advanced technology and solve complex platform challenges? Data platforms enable pivotal insights when they are engineered for scalability, observability, and cost-efficiency. As a Databricks Platform Engineer, you will design, build, and optimize the infrastructure and DataOps workflows that power meaningful outcomes for a high-impact Fortune 500 client program. You will leverage Databricks, Infrastructure as Code such as Terraform and Terragrunt, Python, and SQL to scale and govern our data environments. You will collaborate within a robust, 70+ person cross-functional ecosystem spanning Data Engineering, AI, Data Science, Governance, and Reporting. As our platform strategy evolves, you will play a key role in driving CI/CD automation, ensuring platform observability, assisting in managing cloud budgets, and securely integrating new AI capabilities.

Responsibilities

• Design, build, and optimize infrastructure and DataOps workflows
• Leverage Databricks, Terraform/Terragrunt, Python, and SQL to scale and govern data environments
• Collaborate with cross‑functional teams in Data Engineering, AI, Data Science, Governance, and Reporting
• Drive CI/CD automation and DataOps workflows using GitHub and GitHub Actions
• Implement platform observability, logging, and operational monitoring (Splunk or Dynatrace)
• Assist in managing cloud budgets and optimizing compute costs
• Securely integrate new AI capabilities and support MLOps

Requirements

• 4+ years of experience with Python and SQL, and interacting with REST APIs and CLI tools to manage infrastructure
• 3+ years of experience with Databricks platform architecture, administration, and distributed processing environments
• 3+ years of experience implementing Infrastructure as Code (IaC) utilizing Terraform and Terragrunt
• Experience designing CI/CD pipelines and DataOps workflows utilizing GitHub and GitHub Actions
• Experience implementing platform observability, logging, and operational monitoring utilizing Splunk or Dynatrace
• Experience navigating enterprise governance, managing change requests, and supporting auditable applications
• Bachelor’s degree

Nice‑to‑have

• 3+ years of experience configuring Databricks platform components, prioritizing Unity Catalog administration, workflows, and Delta Lake architecture
• Experience with Python, SQL, Scala, or Java
• Experience with scaling AI workloads, integrating new AI technologies, and supporting MLOps capabilities
• Experience working in an Agile development environment
• Ability to assist in implementing strict budget controls and optimizing compute costs across Databricks and cloud resources
• Ability to display a solution‑oriented mindset
• Bachelor’s degree in a technical field such as Computer Science or Computer Engineering

Benefits

• Health, life, disability, financial, and retirement benefits
• Paid leave, professional development, tuition assistance, work‑life programs, dependent care
• Recognition awards program for exceptional performance

Pay

The projected compensation range for this position is $77,600.00 to $176,000.00 (annualized USD).