Senior Software Engineer - Database Engine Internals
About the role
The role involves designing and implementing next-generation query engines and structured storage systems that can outperform specialized data warehouses while retaining the expressiveness of general-purpose systems. This includes work in areas such as query compilation and optimization, distributed query execution, vectorized execution engines, data security, resource management, transaction coordination, efficient storage structures, and automatic physical data optimization.
Responsibilities
- Design and implement next-generation query engines and storage systems
- Optimize query compilation and execution for high performance and flexibility
- Develop distributed query execution strategies and scheduling algorithms
- Implement vectorized execution engines for improved performance
- Ensure data security and privacy compliance
- Manage resources efficiently for optimal performance
- Optimize storage structures for better data access and efficiency
- Automate physical data optimization processes
Requirements
A passion for database systems, storage systems, distributed systems, language design, or performance optimization is essential. Experience working towards a multi-year vision with incremental deliverables and a strong motivation to deliver customer value and impact are preferred. 5+ years of experience working in a related system is also preferred.
Qualifications
PhD in databases or distributed systems is optional but highly valued.
Skills
Proficiency in distributed computing, query processing, and performance tuning is necessary. Experience with Apache Spark, SQL, and NoSQL databases is beneficial.
Benefits
Details on benefits are available upon request.
Pay
The pay range for this role is $166,000—$225,000 USD. Actual compensation packages are determined based on various factors including job-related skills, depth of experience, relevant certifications and training, and specific work location.
Schedule
The schedule is flexible and designed to accommodate the needs of the employee and the organization.