Databricks Platform Engineer

About the role

We partner with global enterprises to design and build large-scale data platforms that power the products and operations at the center of their business. As adoption grows, so does the work of keeping the platform resilient, automated, and easy to onboard onto. That includes building out disaster recovery, tuning networking, maintaining the infrastructure-as-code that new projects depend on, and clearing the blockers that slow teams down.

Responsibilities

• Deploy and manage Databricks platform resources with Terraform, and build reusable wrapper modules that let new projects onboard consistently.
• Onboard new applications and initiatives onto the Databricks platform, working directly with the teams that own them.
• Build and harden disaster recovery for the Databricks environment, including replication, failover, and recovery testing.
• Optimize networking for the platform, including private connectivity, network security, and workspace configuration.
• Build and maintain CI/CD and platform automation for infrastructure and deployments.
• Resolve blockers and impediments that surface during platform build and onboarding.
• Provide production support, including primary and secondary on-call for high-severity incidents, root cause analysis, and follow-up corrective work.
• Track and update work in the client's ticketing systems, and document runbooks and standards so the platform stays operable.

Requirements

• 6+ years in platform, DevOps, or cloud infrastructure engineering, including hands-on administration of Databricks in production.
• Strong Terraform experience, including writing and maintaining reusable modules.
• Experience with the Databricks Terraform provider is a strong plus.
• Solid cloud infrastructure experience, especially networking: VPCs or VNets, private endpoints, DNS, and security groups.
• Experience building CI/CD pipelines for infrastructure and platform deployments.
• Working knowledge of Unity Catalog, workspace administration, and cluster policies.
• Experience supporting production platforms, including incident response and on-call.
• Comfortable in a client-directed model, where priorities are set through the client's governance process and can shift as new initiatives arrive.
• Clear written communication, including runbooks and incident write-ups.
• Fluent English, both written and spoken.

Skills

• Experience designing or testing disaster recovery for Databricks or other data platforms.
• Scripting in Python or Bash for platform automation.
• Experience with ServiceNow or similar ITSM tools.
• Prior work in healthcare or other regulated industries.
• Databricks Platform Administrator accreditation or a cloud certification (AWS, Azure).

Benefits

• Flexible working hours in a remote environment.
• Health insurance (medical and dental) for W2 Employees.
• 401K Contribution.
• A professional development fund to enhance your skills and knowledge.
• 15 days of paid time off annually