Software Engineer, Data Pipelines
Reinforced Learning · Buffalo-Niagara Falls Area · 3 days ago
EngineeringFull-time
The role Expert work arrives as trajectories, documents, diffs and preferences. Customers receive versioned, validated, documented datasets. Everything in between is yours: ingestion, validation, transformation, packaging and delivery. What you’ll own Pipelines that validate and transform expert submissions into customer formats.Schemas and quality gates, so bad records never reach a delivery.Dataset versioning and lineage from raw submission to shipped file.Delivery tooling for secure handoff into customer environments.Pipelines that are observable and easy for dataset leads to operate. What you bring Strong Python and experience with batch and streaming data systems.Care for data correctness: schemas, idempotency, backfills, audits.Pipelines you’ve operated in production on a major cloud.Pragmatism about tooling. Helpful, not required Dataset formats used in model training.Data contracts or lineage tooling.