Senior Software Engineer

Job Summary

The Cloudera Data Platform (CDP) team is seeking a Senior Software Engineer with expertise in distributed systems to design and develop highly scalable enterprise products that bridge distributed computation and storage.

About the Role

Joining the Data Platform Pillar, you will be responsible for developing and supporting a Catalog service built around the Apache Iceberg REST specification, contributing to open-source projects, and working on customer deployments.

Responsibilities

• Develop and support a highly scalable Catalog service for Cloudera Data Platform (CDP) across hybrid cloud environments.
• Design and develop a Unified Catalog service serving as a single endpoint for segregated data sets.
• Contribute to premier open-source projects, building tools that define industry interactions with large-scale unstructured data.
• Work daily with a high-impact stack featuring Apache Iceberg, Spark, Impala, and Hive.
• Support customer deployments, escalations, and improve the stability of the product.

Requirements

• Bachelor’s degree with 5+ years of industry experience, or Master’s degree with 3+ years of industry experience, including 3+ years building scalable, high-performance large-scale systems.
• Proven expertise in Java (preferred) or other OOP languages, with strong skills in data structures, algorithms, and clean coding habits.
• Strong understanding of public cloud concepts (AWS/Azure/GCP), with experience in cloud storage integration and access-control APIs.
• Familiarity with authentication and authorization mechanisms specifically for public cloud deployments.
• Strong debugging skills in Java environments, including experience analyzing logs, thread dumps, and heap dumps.
• Self-starter with the ability to work independently and collaborate effectively with geographically distributed teams.
• Strong oral and written communication skills with a sharp attention to detail and a focus on software quality.

Qualifications

• Experience with the Big Data ecosystem and open table formats such as Apache Iceberg or Apache Hudi.
• Proven experience developing REST-based services, with a specific focus on metadata services.
• Working knowledge of AWS STS (Security Token Service) or similar cloud identity and access management tools.
• Strong understanding of database internals, including query processing and query optimization techniques.
• Active contributions to Apache open-source projects or a history of involvement in the developer community.

Skills

• Experience with distributed systems and large-scale data processing.
• Knowledge of Apache Iceberg, Spark, Impala, and Hive.
• Proficiency in Java or other OOP languages.
• Experience with public cloud concepts and cloud storage integration.
• Strong debugging and problem-solving skills in Java environments.
• Ability to work independently and collaborate with geographically distributed teams.
• Experience with REST-based services and metadata services.
• Understanding of database internals and query processing.
• Contributions to open-source projects or involvement in the developer community.

Benefits

• Generous PTO Policy
• Unplugged Days
• Flexible WFH Policy
• Mental & Physical Wellness programs
• Phone and Internet Reimbursement program
• Access to Continued Career Development
• Comprehensive Benefits and Competitive Packages
• Paid Volunteer Time
• Employee Resource Groups

Pay

Competitive salary based on experience and qualifications.

Schedule

Full-time position.