Software Development Engineer, Neuron Foundation Tools

About the role

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. As the Software Development Engineer for the Neuron Foundation Tools Team, you will be responsible for working alongside a team of engineers to develop and maintain high-performance monitoring and profiling tools for machine learning applications and AI accelerators.

Responsibilities

• Work on design, development, and deployment of the Neuron Profiler and other Neuron Tools.
• Provide deep insights into performance bottlenecks and system behavior for internal and external customers.
• Optimize AI workloads across hardware platforms such as Trainium and Inferentia devices.
• Manage the full development life cycle of the Neuron Profiler/Tools toolchain, ensuring scalability, reliability, and usability.
• Collaborate with cross-functional teams to ensure that the C++ compiler and runtime generate key information so customers can understand and optimize the performance of our custom hardware.
• Drive innovations that allow the profiler to support multiple frameworks, such as PyTorch, JAX, and XLA.

Requirements

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience programming with at least one software programming language

Qualifications

• Bachelor's degree in computer science or equivalent

Skills

• Established background in building AI/ML and performance analysis tools
• Direct customer-facing experience
• Strong motivation to achieve results

Benefits

Amazon offers flexibility in working hours and encourages a balanced work-life approach. The company supports new members through mentorship and career growth opportunities, including access to various employee-led affinity groups and innovative benefit offerings.

Pay

The base salary range for this position is $143,700.00 - $194,400.00 annually.

Schedule

Details on the schedule are not specified in the job posting.