DirectJobHub
Jobs · Consulting · Washington

Sr. Machine Learning Compiler Engineer, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS) · Seattle, WA · 1 wk ago
ConsultingFull-time

About the Product

The AWS Machine Learning accelerators are at the forefront of AWS innovation. Trainium delivers best-in-class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud, enabled by the AWS Neuron Software Development Kit (SDK). The SDK includes an ML compiler, the Neuron Kernel Interface (NKI) compiler, and a runtime that natively integrates into popular ML frameworks such as PyTorch and JAX.

Neuron Kernel Interface (NKI) is a bare-metal language and compiler for directly programming NeuronDevices available on AWS Trainium instances. NKI allows developers to optimize and run new operators directly on NeuronCores while fully utilizing available compute and memory resources.

Explore NKI

AWS Neuron is used at scale by customers such as Epic Games, Snap, Airbnb, Autodesk, Amazon Alexa, and Amazon Rekognition, among others across various segments.

About the Team

The Amazon Annapurna Labs team builds innovative silicon and software for AWS customers, combining cloud scale with world-class engineering talent across disciplines including silicon engineering, hardware design, software, and operations. The team operates in large, dynamic spaces with small, agile teams—there is no blueprint, fostering a culture of invention and experimentation.

Learn more about our history

Here at AWS, we embrace diversity and inclusion, with ten employee-led affinity groups reaching 40,000 employees globally. Our culture is reinforced by the 16 Leadership Principles, encouraging team members to seek diverse perspectives, learn continuously, and earn trust.

About the Role

As a Sr. Machine Learning Compiler Engineer on the NKI team, you will be a thought leader in the ground-up development and scaling of a compiler that handles the world’s largest ML workloads. You will architect and implement business-critical features, publish cutting-edge work, and mentor a team of experienced engineers while collaborating hands-on with AWS ML teams. A background in machine learning and AI accelerators is preferred but not required.

Candidates must be currently located in or willing to relocate to Seattle, WA; Cupertino, CA; or Austin, TX.

Work/Life Balance

The team values work-life balance, focusing on the flow between personal and professional life to bring energy to both. Flexible working hours are offered to help you find your own balance.

Mentorship & Career Growth

The team is dedicated to supporting new members, with a mix of experience levels and tenures. Knowledge sharing and mentorship are prioritized, and projects are assigned to help team members develop into well-rounded professionals while tackling increasingly complex tasks.

Responsibilities

  • Architect and implement business-critical features for the NKI compiler.
  • Publish cutting-edge work in machine learning compilation.
  • Mentor a team of experienced engineers.
  • Collaborate with AWS ML teams as a hands-on technical partner.
  • Optimize compiler performance for large-scale ML workloads.

Requirements

  • 5+ years of non-internship professional software development experience.
  • 5+ years of programming experience with at least one software programming language.
  • 5+ years of experience leading design or architecture (design patterns, reliability, and scaling) of new and existing systems.
  • 5+ years of experience in the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.

Preferred Qualifications

  • Bachelor’s degree in computer science or equivalent.
  • Experience with machine learning and AI accelerators.

Pay

The base salary range for this position varies by location:

  • Cupertino, CA: $193,300 - $261,500 USD annually.
  • Austin, TX: $168,100 - $227,400 USD annually.
  • Seattle, WA: $168,100 - $227,400 USD annually.

Compensation includes sign-on payments and restricted stock units (RSUs). Final compensation is determined based on experience, qualifications, and location.

Benefits

  • Health insurance (medical, dental, vision, prescription, Basic Life & AD&D, with options for supplemental life plans).
  • Employee Assistance Program (EAP) and mental health support.
  • Medical Advice Line and Flexible Spending Accounts.
  • Adoption and surrogacy reimbursement coverage.
  • 401(k) matching.
  • Paid time off and parental leave.

Learn more about our benefits

Similar jobs