Lead Databricks Platform Engineer
Overview
How You’ll Make an Impact
A subsidiary of Publicis Groupe, Epsilon powers data-driven marketing at massive scale for some of the world’s leading brands. We’re hiring a Lead Databricks Administrator to own and evolve our Databricks platform across cloud environments. This is a high-impact role focused on driving platform standards, strengthening governance, and improving reliability across enterprise data systems. You’ll support large-scale Data Lake environments across AWS, Azure, and GCP, helping enable critical data operations for key clients.
Responsibilities
- Lead and scale Databricks platform administration across enterprise workspaces and multi-cloud environments (AWS, Azure, GCP)
- Establish and enforce standards for workspace provisioning, access controls, compute configuration, and governance to improve platform consistency and stability
- Drive operational excellence by implementing repeatable processes, automation, and best practices across Databricks environments
- Strengthen platform reliability, performance, and cost efficiency through proactive monitoring, optimization, and issue resolution
- Partner cross-functionally with Engineering, Security, Cloud, and Operations teams to ensure secure, compliant, and scalable platform architecture
- Own and improve identity and access management practices (least privilege, group management, service principals, admin controls)
- Lead troubleshooting and resolution of complex issues across Databricks, cloud infrastructure, networking, and data workloads
- Evaluate and adopt new Databricks capabilities to enhance governance, scalability, and operational efficiency
- Build and maintain documentation, runbooks, and platform standards to support long-term maintainability and audit readiness
- Mentor team members and promote best practices to elevate overall platform maturity
- Support production operations, incident response, and ongoing platform health in a high-impact, enterprise environment
Qualifications
- BS in Computer Science or related technical discipline, or equivalent practical experience
- 7+ years of experience in data platform, database administration, or cloud infrastructure roles
- 3+ years of hands-on experience administering Databricks (workspaces, clusters, jobs, SQL Warehouses, platform services)
- Strong expertise in:
- Databricks workspace and account management
- Platform governance, access controls, and administration best practices
- Compute configuration, cluster policies, and workload optimization
- Supporting Databricks across AWS, Azure, or GCP environments
- Infrastructure provisioning and automation (Terraform, APIs, scripting, CI/CD pipelines)
- Strong understanding of identity and access management: SSO, SCIM provisioning, RBAC, Service principals, group management, least privilege models
- Working knowledge of Unity Catalog, data governance frameworks, and secure data access patterns
- Implementing and maintaining platform standards (naming conventions, provisioning workflows, configuration baselines, access controls)
- Monitoring, troubleshooting, and optimizing platform performance, reliability, and cost efficiency
- Diagnosing issues across Databricks, cloud infrastructure, networking, identity, and data pipelines
- Strong SQL, Unix/Linux, and scripting skills; Python or Scala is a plus
- Experience building and maintaining documentation, runbooks, and operational processes to support audit readiness and platform scalability
- Proven ability to communicate effectively with the ability to work effectively across engineering, security, and platform teams
Additional Information
When You Join Us, We’ll Create Something EPIC Together
Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels. Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world. Our pillars aren't just words. They're how we show up every day. People centricity: We focus on employee well-being in an environment where colleagues truly care about each other. Collaboration: We work together, support one another, and collectively achieve goals. Growth: There are endless opportunities for growth through learning, development and career advancement. Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches. Flexibility: We’ve created a balance between work and personal life, and we encourage adaptability to solve problems creatively. Our values guide us to create value for our clients, our people and consumers. Act with integrity Work together to win together Innovate with purpose Respect all voices Empower with accountability
Benefits
- Time to Recharge: Flexible time off (FTO), 15 paid holidays
- Time to Recover: Paid sick time
- Family Well-Being: Parental/new child leave, childcare & elder care assistance, adoption assistance
- Extra Perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling
Compensation Range
USD $98,000.00 - USD $182,000.00/Annually