Jobs · Engineering · New York

Software Engineer, Data Pipelines

Reinforced Learning · Buffalo-Niagara Falls Area · 3 days ago
EngineeringFull-time
The role Expert work arrives as trajectories, documents, diffs and preferences. Customers receive versioned, validated, documented datasets. Everything in between is yours: ingestion, validation, transformation, packaging and delivery. What you’ll own Pipelines that validate and transform expert submissions into customer formats.Schemas and quality gates, so bad records never reach a delivery.Dataset versioning and lineage from raw submission to shipped file.Delivery tooling for secure handoff into customer environments.Pipelines that are observable and easy for dataset leads to operate. What you bring Strong Python and experience with batch and streaming data systems.Care for data correctness: schemas, idempotency, backfills, audits.Pipelines you’ve operated in production on a major cloud.Pragmatism about tooling. Helpful, not required Dataset formats used in model training.Data contracts or lineage tooling.

Similar jobs

Software Engineer

HaystackMassachusetts, United States· 3 wk ago
$144k–$194k/yrapply on haystack.cv

Software Engineer

HumanaWashington, DC· 1 mo ago
RemoteInformation Technology$81k–$110k/yr

Software Engineer

Brooks AutomationChelmsford, MA· 1 mo ago
$106k/yrapply on brooksauto.wd1.myworkdayjobs.com

Software Engineer

ASRC FederalOklahoma City, OK· 1 mo ago
Engineeringapply on jobs.dayforcehcm.com

Software Engineer

HaystackGreater Sioux Falls Area· 1 mo ago
$106k–$141k/yrapply on haystack.cv

Software Engineer

AllianceBernsteinNashville, TN· 1 mo ago
Engineeringapply on abglobal.wd1.myworkdayjobs.com