Runtime/Driver Software Development Engineer, Neuron Runtime
About the role
Neuron SDK is the complete software stack for the AWS Inferentia and Trainium machine learning accelerators designed by Annapurna Labs inside AWS. The Neuron SDK consists of a compiler, runtime, frameworks, and tooling customers need. It’s also preinstalled in Amazon Deep Learning AMIs and Deep Learning Containers for customers to quickly get started with running high performance and cost-effective inference and training.
This position is for a Software Engineer for the AWS Neuron SDK team with a deep background in Linux and device drivers. You will work with the team to define key interfaces and develop the runtime stack and driver that manages the accelerator. You will also work in pre-silicon environments (such as emulation) to shift-left Runtime Software Stack readiness and develop validation content to check out hardware/silicon features.
This is a fast-paced, intellectually challenging position where you’ll work with thought-leaders in multiple technology areas. You’ll have high standards for yourself and everyone you work with, and you’ll be constantly looking for ways to improve our products' performance, quality, and cost.
Responsibilities
- Design and implement high-performance software drivers to ensure high throughput from software to hardware.
- Define key interfaces for the runtime stack and driver managing the accelerator.
- Develop and validate software in pre-silicon environments (e.g., emulation) to ensure Runtime Software Stack readiness.
- Create validation content to test hardware and silicon features.
- Collaborate with cross-functional teams to improve product performance, quality, and cost.
Requirements
- 3+ years of non-internship professional software development experience.
- 2+ years of non-internship design or architecture experience (design patterns, reliability, and scaling) of new and existing systems.
- Experience programming with at least one software programming language.
- Deep knowledge and experience with hardware-based accelerator platforms and the software layers that interact with and manage them.
Qualifications
- 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Bachelor's degree in computer science or equivalent.
- Experience in computer architecture.
- Experience writing low-level drivers.
Benefits
- Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance, with options for supplemental life plans).
- Employee Assistance Program (EAP) and Mental Health Support.
- Medical Advice Line and Flexible Spending Accounts.
- Adoption and Surrogacy Reimbursement coverage.
- 401(k) matching.
- Paid time off and parental leave.
Pay
Base salary range: $143,700 - $194,400 USD annually. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on experience, qualifications, and location.
Location: USA, TX, Austin
Company: Annapurna Labs (U.S.) Inc.