Senior Software Engineer - Backend, Data Products - MarTech/AdTech
Three Pillars Recruiting · San Francisco, CA · 3 wk ago
On-siteEngineeringFull-time
About the role
As a Senior Software Engineer on Backend, Data Products, you build the product itself — the composable, self-correcting pipeline capabilities customers actually use. This is applied backend engineering: turning a hard product vision into resilient, shippable features.
Responsibilities
- Build and extend Reactors — the Observe / Match / Act / Compose primitives that make pipelines composable and self-correcting.
- Develop connectors, ingestion, and transformation tooling for diverse, messy marketing data sources, including schema evolution.
- Build data validation and quality into the pipeline (e.g., Great Expectations–style contracts) so correctness is enforced, not hoped for.
- Design and ship the backend / GraphQL surface that exposes pipeline capabilities to internal teams and customers.
- Orchestrate multi-step pipeline work with workflow engines (Temporal) and event-driven dispatch (NATS/JetStream).
- Collaborate in a sprint-based cycle with product and science to turn analytical workloads into production features.
Requirements
- 5+ years writing production software, with deep Python (3.10+, async/await, type hints; pandas, SQLAlchemy, Pydantic).
- Built resilient, observable ETL/ELT pipelines that ingest, transform, and validate data at scale.
- API/backend design: GraphQL and/or REST contracts, versioning, and ergonomics other engineers actually enjoy using.
- PostgreSQL depth — schema design, query optimization; comfortable with both ORM and raw SQL.
- Experience with event-driven and workflow-orchestrated systems (Temporal, NATS / Kafka, or similar).
- Experience with data validation / quality frameworks, and a habit of designing for correctness and debuggability.
Nice to have
- Plugin / extension development (Apache NiFi or similar) and fluency with AI coding assistants as part of your workflow.
- Performance-sensitive work in a systems language (Rust, C++); graph / lineage modeling; connector ecosystems.
Qualifications
The role is right for you if you:
- Like turning a hard product vision into clean, composable systems others build on.
- Build and ship alongside the team, and treat pipeline correctness as a feature.
Job-3645277