Software Development Engineer, AI Data Infrastructure
Amazon · Middlesex County, MA · 1 mo ago
ConsultingFull-time
About the role
Build the data infrastructure that powers the next generation of robotics and AI. Design scalable platforms that help scientists discover, access, and transform complex multi-modal datasets. Work at the intersection of data engineering, AI/ML infrastructure, and robotics — building systems that directly enable foundation model training for robotic manipulation.
What you'll build
- A data management platform that ingests, processes, and serves petabyte-scale multi-modal datasets — including video, sensor telemetry, and structured metadata — captured from instrumented robotic workcell environments
- Systems that enable science teams to discover relevant datasets in minutes instead of weeks, transform raw data into training-ready formats, and maintain full data lineage and reproducibility across experiments
Key job responsibilities
- Design and build data ingestion pipelines that process continuous multi-modal recordings (video, pose tracking, force/tactile telemetry) from instrumented capture environments into structured, searchable datasets
- Develop search and discovery services that enable scientists to find relevant datasets across large catalogs using keyword, metadata filtering, and semantic search capabilities
- Build data transformation and quality validation frameworks that automate repetitive data processing tasks and enforce data quality standards across registered datasets
- Implement episode segmentation workflows that process continuous session recordings into discrete, labeled task executions with synchronized multi-stream alignment
- Collaborate with science teams to understand their data access patterns and build programmatic interfaces that integrate with ML training workflows and notebook environments
- Design and develop scalable solutions using cloud-native architectures (AWS services including S3, OpenSearch, Lambda, Step Functions) in a large distributed computing environment
- Contribute to metadata enrichment tooling and automated documentation generation that improves dataset discoverability and reduces producer onboarding friction
- Participate in code reviews, contribute to technical documentation, and maintain operational excellence through monitoring, alerting, and on-call responsibilities
- Work in an agile environment practicing CI/CD principles while building resilient, fault-tolerant distributed systems
- Leverage and contribute to AI-powered tools (including GenAI capabilities) to enhance development productivity and data quality automation
Basic qualifications
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 2+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
- Experience programming with at least one software programming language
Preferred qualifications
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Pay
USA, MA, N.Reading - 143,700.00 - 194,400.00 USD annually. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location.
Benefits
- Medical, Dental, and Vision Coverage
- Maternity and Parental Leave Options
- Paid Time Off (PTO)
- 401(k) Plan
- Health insurance including prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching