Staff Software Engineer, Data Infrastructure

About the role

We are looking for a Staff Data Infrastructure Engineer to join our growing team. This is a senior individual contributor role for someone who thrives on hard technical problems and brings the experience and judgment to shape foundational infrastructure decisions.

Responsibilities

• Designing and operating a high-throughput, real-time data integration platform across diverse customer environments
• Architecting a scalable open table format layer for reliable data storage at petabyte scale
• Building and optimizing distributed data processing pipelines with Apache Spark and adjacent streaming technologies
• Driving performance, reliability, and cost efficiency across the full data infrastructure stack
• Collaborating with platform and product engineering teams to define data contracts, schemas, and integration patterns
• Establishing best practices, tooling, and patterns that raise the quality bar for data infrastructure across the organization

Requirements

• Deep passion for data infrastructure — you care about building systems that are correct, fast, and resilient at scale
• Thrive on ambiguity and are energized by defining the right solution to hard, open-ended problems
• Strong technical vision with the ability to translate complex data requirements into clean, durable infrastructure designs
• Desire to own significant portions of the data stack end-to-end, from ingestion to serving
• Committed to operational excellence — you build things you’re proud to operate

Qualifications

• 8+ years of experience architecting and operating large-scale data infrastructure systems in production environments
• Deep expertise with open table formats, particularly Apache Iceberg — including schema evolution, partitioning strategies, compaction, and time travel
• Extensive hands-on experience with Apache Spark for batch and streaming data processing at scale
• Strong background in real-time data integration and stream processing, leveraging technologies such as Apache Kafka, Apache Flink, or equivalents
• Solid experience with data pipeline orchestration using Airflow or similar tools
• Strong software engineering fundamentals in Python and/or Scala, with a track record of writing production-quality code
• Extensive experience with AWS or comparable cloud platforms, including S3-based data lake architectures
• Experience with Kubernetes and containerized deployment of data workloads
• Degree in Computer Science, Engineering, or a related field, or equivalent practical experience

Benefits

Salary Range: $200,000 - $275,000 Annually + Benefits + Equity (if applicable) + Bonus (if applicable)

Pay

$200,000 - $275,000 Annually

Schedule

Open to working in office