Jobs · Information Technology · California

Senior Data Engineer, NimbleRx

Swoop · Redwood City, CA · 1 mo ago
Information TechnologyTemporary

About the role

This role is part of the NimbleRx team, which powers the data layer for all other teams at Swoop. Your work will accelerate product, analytics, operations, and data science efforts.

Qualifications

  • 5+ years of experience building production data pipelines and platforms
  • Deep Python (PySpark) and SQL fluency, including tuning Spark jobs at scale
  • Hands-on experience with distributed compute (Spark/EMR), streaming (Kinesis), and object storage (S3)
  • Solid Postgres fundamentals — query optimization, indexing, replication, replica routing, and a feel for when the database is the bottleneck
  • Experience with Iceberg and Trino, or similar
  • Comfort with CI/CD and Terraform
  • Already building with AI — frontier models, agentic coding tools, or something you hacked together last weekend
  • A bias for shipping iteratively and instrumenting what you ship — you’d rather demo a rough v1 in two days than a polished v3 in two weeks

What You'll Do

  • Own the data platform end-to-end — ingestion, transformation, storage, query, and access — and drive its roadmap as the company’s data needs grow
  • Build and evolve batch and streaming pipelines on PySpark/EMR, Kinesis, Lambda, and Step Functions, ingesting from Postgres, Salesforce, third-party vendors, and product event streams into our Iceberg-based lake
  • Model the warehouse: design SCD tables, event tables, and the conventions other engineers and analysts follow when adding new data
  • Partner with product, engineering, analytics, and operations stakeholders across the company to turn data requests into well-scoped, reliable pipelines — and write the docs and tooling that let them self-serve next time
  • Own the security and compliance backbone of our data systems, including audit logging, access control, and temporary-access workflows
  • Optimize backend query performance where the data layer meets product code — read-replica routing, indexing, caching, and IO instrumentation in our Java/Spring services
  • Lead investigation and remediation when data infrastructure misbehaves — IOPS spikes, pipeline failures, schema drift, late data — and make the fixes durable
  • Use AI as a daily accelerant for pipeline scaffolding, schema work, and ad-hoc investigations — and ship internal AI tooling that lets other teams do the same
  • Mentor engineers and analysts across the company on how to work with the data platform

Pay

The Pay Range For This Role Is 205,000 - 240,000 USD per year (Hybrid (Redwood City, CA, US))

Similar jobs

Data Engineer, Senior

Booz Allen HamiltonHuntsville, AL· 3 mo ago
Information Technology$78k–$176k/yrapply on careers.boozallen.com

Data Engineer, Senior

Booz Allen HamiltonCharlottesville, VA· 2 mo ago
$78k–$176k/yrapply on careers.boozallen.com

Data Engineer, Senior

StellarusCalifornia, United States· 4 mo ago
Information Technology$103k–$154k/yrapply on ecge.fa.us2.oraclecloud.com