Jobs · Information Technology · California

Software Engineer, Platform ($200k-$250k + Equity) at Duckbill

Jack & Jill · San Francisco, CA · Yesterday
On-siteInformation Technology$200k–$250k/yrFull-time

About the role

Jill, our AI Recruiter, is recruiting for a Software Engineer, Platform position at Duckbill.

Responsibilities

  • Build and maintain streaming and batch data processing pipelines for hundreds of millions of rows using OTel, API pulls, and S3.
  • Develop the contract application engine that reconciles complex, unstructured cloud agreements with real-time consumption data for mission-critical financial accuracy.
  • Design multi-provider data models and partitioning strategies in ClickHouse to deliver sub-second performance on heavy analytical workloads for strategic finance leaders.

Requirements

  • Strong professional experience building large-scale data systems using Python, SQL, and OLAP databases like ClickHouse, Snowflake, or DuckDB.
  • A deep understanding of ETL pipelines, lakehouse architectures, and the nuances of reconciling streaming versus batch data sources in high-precision environments.
  • A self-directed engineer who thrives in high-autonomy environments and maintains a fastidious approach to data quality when no clear spec exists.

Qualifications

  • Experience with Python, SQL, and OLAP databases like ClickHouse, Snowflake, or DuckDB.
  • Knowledge of ETL pipelines, lakehouse architectures, and the reconciliation of streaming versus batch data sources.
  • Ability to design and implement multi-provider data models and partitioning strategies in ClickHouse.

Skills

  • Python programming skills.
  • SQL and database management skills.
  • Experience with ClickHouse and other OLAP databases.
  • ETL pipeline development and management.
  • Lakehouse architecture knowledge.
  • Data modeling and partitioning strategies.

Benefits

  • $200k-$250k salary range.
  • Equity compensation.

Pay

$200k - $250k + equity

Schedule

Full-time

Benefits

  • Health insurance.
  • Retirement plans.
  • Flexible work schedule.
  • Professional development opportunities.

What You Will Do

Join a high-impact team building Skyway, a financial platform for AI-native companies managing massive infrastructure costs. You will architect data systems processing hundreds of millions of billing rows using Python and ClickHouse. As one of the first ten engineers, you will own the infrastructure transforming unstructured cloud agreements into precise, actionable financial data.

Why this role is remarkable

  • Direct impact on $10M+ compute decisions for the world's leading AI labs and neoclouds through your data models and financial engines.
  • Backed by $7.75M from Heavybit and Uncork Capital with a massive competitive advantage derived from seven years of proprietary benchmark data.
  • Massive autonomy in an engineering team of six where you will make foundational technical decisions and ship code to production daily.

Who are Jack & Jill?

Jack is an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then he helps you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.

Jill is the AI Recruiter working for the company. She recruits from Jack's network, making an introduction when she spots an excellent candidate.

This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network. Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description. We appreciate this can make them look a bit suspect, but there isn't much we can do about it. Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.

Similar jobs