Senior Staff Software Engineer - Enzyme
About the role
We're seeking a dedicated technical leader to spearhead the Materialized Views engineering team within the Lakeflow Engineering team at Databricks. This team is responsible for the entirety of the ETL product line, including products such as Materialized Views, Structured Streaming, and Delta Live Tables. We run one of the world's largest data engineering platforms, processing exabytes of data daily for tens of thousands of customers.
As part of this team, you will work in one or more of the following areas to design and implement next-generation systems that leapfrog state-of-the-art:
- Incrementally maintaining materialized views
- Query optimization
- Resource management
- Efficient storage structures
- Automatic physical data optimization
Responsibilities
- Solve real business needs at large scale by applying your software engineering expertise.
- Deliver a highly scalable, available, and fault-tolerant architecture for materialized views.
- Perform low-level systems debugging, performance measurement, and optimization on large production clusters.
- Drive architecture design, influence product roadmap, and take ownership of new projects.
- Introduce tools to enable greater automation and operability of services.
- Use your deep experience to help prevent and investigate production issues.
- Plan and lead complex technical projects that involve collaboration with multiple teams.
Requirements
- 15+ years of industry experience building and supporting large-scale distributed systems.
- A passion for database systems, storage systems, distributed systems, language design, or performance optimization.
- Experience working towards a multi-year vision with incremental deliverables.
- Motivated by delivering customer value and impact.
- Strong foundation in algorithms and data structures and their real-world use cases.
- Experience driving company initiatives toward customer satisfaction.
- BS/MS/PhD in Computer Science or related majors, or equivalent experience.
Pay
Databricks is committed to fair and equitable compensation practices. The local pay range for this role in Mountain View, California is $235,000—$295,000 USD. Actual compensation is based on factors such as job-related skills, depth of experience, relevant certifications, and specific work location. The total compensation package may also include eligibility for annual performance bonus, equity, and benefits.
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all our employees. For specific details on the benefits offered in your region, visit our benefits page.