Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

About the role

Join us in shaping the future of AI with AWS Neuron. As a senior software engineer in the Compiler team, you'll optimize ML models for AWS Inferentia and Trainium, accelerating deep-learning workloads.

Responsibilities

• Design, implement, test, deploy, and maintain compiler optimization passes for Neuron
• Work closely with chip architects, runtime/OS engineers, and ML apps teams to deploy cutting-edge ML models on AWS accelerators
• Collaborate with open-source communities and influence industry-wide partners to optimize cutting-edge ML workloads
• Create features and address peculiarities of AWS accelerators to developers, and implement tools for analyzing numerical errors and resolving compiler defects
• Participate in design discussions, code reviews, and communicate with internal and external stakeholders
• Contribute to a startup-like development environment, focusing on the most critical projects

Requirements

• Bachelor's degree in computer science or equivalent
• 5+ years of full software development life cycle experience
• 3+ years of experience in developing compiler features and optimizations
• Proficiency in C++ (preferred)
• Experience with LLVM and/or MLIR
• Experience with LLM, Vision, or other deep-learning models

Qualifications

• Master or PhD degree in computer science or equivalent
• Experience with compiler design, resource management, instruction scheduling, memory allocation, data transfer optimization, compute graph optimization, code generation, and Instruction Set Architecture

Skills

• Object-oriented programming languages (C++, Java)
• Experience with ML frameworks (PyTorch, TensorFlow, JAX)
• Experience with OpenXLA, StableHLO, MLIR

Benefits

Explore the product and our history! AWS Neuron Compiler Guide

AWS Neuron

AWS Neuron SDK

AWS Silicon Innovation

Pay

$193,300.00 - $261,500.00 annually

Schedule

Full-time