Jobs · Engineering · California

Software Engineer, Platform ($200k-$250k + Equity) at Duckbill

Jack & Jill · San Francisco, CA · Yesterday
On-siteEngineering$200k–$250k/yrFull-time

Job Description

  • Build and maintain streaming and batch data processing pipelines for hundreds of millions of rows using OTel, API pulls, and S3.
  • Develop the contract application engine that reconciles complex, unstructured cloud agreements with real-time consumption data for mission-critical financial accuracy.
  • Design multi-provider data models and partitioning strategies in ClickHouse to deliver sub-second performance on heavy analytical workloads for strategic finance leaders.

What You Will Do

Join a high-impact team building Skyway, a financial platform for AI-native companies managing massive infrastructure costs.

The ideal candidate

  • Strong professional experience building large-scale data systems using Python, SQL, and OLAP databases like ClickHouse, Snowflake, or DuckDB.
  • Deep understanding of ETL pipelines, lakehouse architectures, and the nuances of reconciling streaming versus batch data sources in high-precision environments.
  • Self-directed engineer who thrives in high-autonomy environments and maintains a fastidious approach to data quality when no clear spec exists.

About the role

Join a high-impact team building Skyway, a financial platform for AI-native companies managing massive infrastructure costs. You will architect data systems processing hundreds of millions of billing rows using Python and ClickHouse. As one of the first ten engineers, you will own the infrastructure transforming unstructured cloud agreements into precise, actionable financial data.

Responsibilities

  • Build and maintain streaming and batch data processing pipelines for hundreds of millions of rows using OTel, API pulls, and S3.
  • Develop the contract application engine that reconciles complex, unstructured cloud agreements with real-time consumption data for mission-critical financial accuracy.
  • Design multi-provider data models and partitioning strategies in ClickHouse to deliver sub-second performance on heavy analytical workloads for strategic finance leaders.

Requirements

  • Strong professional experience building large-scale data systems using Python, SQL, and OLAP databases like ClickHouse, Snowflake, or DuckDB.
  • Deep understanding of ETL pipelines, lakehouse architectures, and the nuances of reconciling streaming versus batch data sources in high-precision environments.
  • Self-directed engineer who thrives in high-autonomy environments and maintains a fastidious approach to data quality when no clear spec exists.

Qualifications

Founded by domain experts with seven years of research, Duckbill provides the financial infrastructure used by AI labs and neoclouds to manage nine-figure infrastructure agreements.

Skills

Strong professional experience building large-scale data systems using Python, SQL, and OLAP databases like ClickHouse, Snowflake, or DuckDB.

Benefits

Backed by $7.75M from Heavybit and Uncork Capital with a massive competitive advantage derived from seven years of proprietary benchmark data.

Schedule

Massive autonomy in an engineering team of six where you will make foundational technical decisions and ship code to production daily.

Pay

$200k-$250k + Equity

Similar jobs