Software Development Engineer - Testing Infrastructure & Performance, Trainium/Neuron, Annapurna Labs

About the role

The Neuron team within Annapurna ML develops the software stack that powers AWS’s custom AI training and inference chips (Trainium, Inferentia). Our team builds and operates the testing infrastructure and performance characterization systems that ensure every release meets quality and performance bars before reaching customers. We directly enable the velocity and reliability of Neuron software releases.

Responsibilities

• Design, build, and maintain automated testing infrastructure (Python) that validates Neuron compiler, runtime, and framework integrations across hardware targets
• Build and operate data pipelines that ingest performance benchmarks, test results, and system metrics from distributed test runs into centralized data stores
• Create and maintain integration test frameworks that validate end-to-end model compilation, execution, and performance across Trainium configurations
• Create automated alerting and triage tooling that identifies performance regressions early and routes them to the right owners
• Extend testing infrastructure to support new model architectures, training workflows, and hardware generations as they come online

Requirements

• Bachelor's degree or above in computer science or equivalent
• Experience with Python in a production or infrastructure context
• Experience building data pipelines (ETL, batch/streaming processing, data warehousing)
• Experience with testing frameworks and test automation at scale

Qualifications

• Master's degree in computer science, machine learning, engineering, or related fields, or experience with Machine and Deep Learning toolkits such as MXNet, TensorFlow, Caffe and PyTorch
• Experience building performance dashboards or observability tooling (Grafana, QuickSight, CloudWatch, or similar)
• Experience with distributed systems testing or hardware-in-the-loop test infrastructure
• Familiarity with statistical methods for regression detection or performance analysis

Skills

• Experience with AWS services (S3, DynamoDB, Lambda, Step Functions, ECS)

Benefits

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit here for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at here.