Jobs · Engineering · California

Staff Software Engineer, Big Data Storage

Pinterest · Palo Alto, CA · 2 days ago
HybridEngineering$177k–$365k/yrFull-time

About the role

We're looking for a Staff Software Engineer to help build the next generation of Pinterest's big data storage platform. You'll work on some of the most exciting big data open source technologies — especially Apache Iceberg — at exabyte scale to power the data infrastructure that helps Pinners discover and do what they love.

As a Staff Software Engineer, you'll serve as a technical leader and hands-on contributor, designing and building highly scalable storage systems for Pinterest's data lake. You'll partner closely with teams across data, ML/AI, analytics, and infrastructure to evolve our storage and metadata management capabilities, enabling efficient, reliable, and governed access to data at massive scale.

What you'll do

  • Design, implement, and optimize Pinterest's exabyte-scale data lake storage platform.
  • Lead complex technical projects and initiatives for data lake storage and metadata management, driving them from architecture through execution.
  • Collaborate with stakeholders and partner teams across the organization to design storage and metadata layer technologies that unlock big data and ML/AI innovations.
  • Build storage capabilities that efficiently support large-scale ML/AI workloads, including high-throughput data access, schema evolution, and large-scale column backfills.
  • Shape the long-term technical direction for scalable, reliable, and efficient big data storage systems.
  • Engage with and contribute to open source communities such as Apache Iceberg, Spark, and Flink to help address Pinterest's scaling challenges.

What we're looking for

  • 8+ years of relevant industry experience designing and building large-scale production distributed systems.
  • Strong experience designing and maintaining scalable storage, metadata, or data lake infrastructure.
  • Experience building storage capabilities for large-scale ML/AI or analytics workloads, including high-throughput data access, schema evolution, and large-scale column backfills.
  • Deep knowledge with building distributed systems, data storage systems, and production infrastructure.
  • Experience with big data technologies such as Apache Iceberg, Spark, Flink, Presto/Trino, Hive, or similar systems.
  • Proficiency in programming languages like Java, Scala, or Python.
  • Proven ability to lead complex technical initiatives and influence architecture across teams.
  • Strong collaboration, communication, and problem-solving skills, with a drive for technical excellence and innovation.
  • Bachelor's degree in a relevant field such as Computer Science, or equivalent experience.

Pay

US based applicants only: $177,185—$364,795 USD. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise.

Schedule

This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. This position is not eligible for relocation assistance.

Similar jobs