Software Development Engineer I, ML Infra Services, Annapurna Labs

About the role

Annapurna Labs is a startup acquired by AWS in 2015 and is now fully integrated. The organization spans silicon engineering, hardware design and verification, software, and operations. They have delivered AWS Nitro, ENA, EFA, Graviton, F1 EC2 Instances, AWS Neuron, Inferentia and Trainium ML Accelerators, and scalable NVMe storage.

Responsibilities

• Design and implement tooling for profiling, optimization, and resource management of ML workloads on custom accelerators.
• Build high-impact solutions that ship to a large and growing customer base.
• Participate in design discussions, code reviews, and cross-functional collaboration with hardware, software, and customer-facing teams.
• Create metrics, implement automation, and resolve root causes of software defects.
• Work in a startup-like environment where you're always focused on the most important problems.

About the team

This is a high-impact, high-visibility team where your work directly accelerates every Neuron team's ability to ship, effectively multiplying the output of 100+ engineers. You'll work at the cutting edge of AI infrastructure, at the intersection of Kubernetes, custom silicon, and large-scale ML workloads.

Qualifications

• Basic Qualifications:
  • Are 18 years of age or older
  • Experience with at least one modern language such as Java, Python, C++, or C# including object-oriented design
  • Experience with at least one general-purpose programming language such as Java, Python, C++, C#, Go, Rust, or TypeScript
  • Experience with data structure implementation, basic algorithm development, and/or object-oriented design principles
  • Proficiency in Java and at least one of Go, Python, or TypeScript
  • Familiarity with Git and CI/CD pipelines
• Preferred Qualifications:
  • Experience from a technical internship
  • Experience in optimization mathematics such as linear programming and nonlinear optimization
  • Experience with distributed, multi-tiered systems, algorithms, and relational databases
  • Work 40 hours/week, and overtime as required
  • Experience from previous technical internship(s) or demonstrated project experience
  • Experience with Cloud platforms (preferably AWS), database systems (SQL and NoSQL), AI tools for development productivity, contributing to open-source projects, and/or version control systems
  • Internship or project experience with AWS services (EKS, EC2, Lambda, S3, DynamoDB, or SQS)
  • Familiarity with distributed systems or big data architectures
  • Experience with Linux systems and performance profiling
  • Exposure to compiler toolchains, code generation, or instruction set architectures (CPU, NPU, GPU)

Pay

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location.

• USA, CA, Cupertino - 127,100.00 - 185,000.00 USD annually

Schedule

Work 40 hours/week, and overtime as required.