Lead Engineer, ML Network Stack - Annapurna Labs

About the role

The Lead Engineer, ML Network Stack at Annapurna Labs is responsible for developing and maintaining the infrastructure that monitors and reports on the functionality and performance of massive testing workloads run at scale. This involves using internal Amazon CI/CD tools, Linux, and public AWS products to automate the delivery of software to customers, writing Python code to set up large clusters and run benchmarks and applications for ML and HPC workloads, and managing the complexity of infrastructure covering various instance types, software stacks, Linux operating systems, and cutting-edge releases.

Responsibilities

• Lead the development and maintenance of monitoring and reporting infrastructure for large-scale testing workloads.
• Automate the delivery of software to customers using internal Amazon CI/CD tools, Linux, and public AWS products.
• Write Python code to efficiently set up and run benchmarks and applications for ML and HPC workloads.
• Create and maintain automated dashboards and visualizations using AWS Managed Grafana and Athena to digest and present performance data.
• Invent and implement automatic mechanisms to alert developers to functional and performance regressions.
• Manage the complexity of infrastructure that covers multiple instance types, software stacks, Linux operating systems, and cutting-edge releases.

Requirements

• 5+ years of non-internship professional software development experience.
• 5+ years of leading design or architecture of new and existing systems.
• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• 3+ years as a mentor, tech lead, or leading engineering teams.
• 3+ years of experience in SW/HW Co-Design.

Qualifications

• Bachelor's degree in computer science or equivalent.
• Experience creating automated dashboards and visualization (such as Grafana).

Skills

• Solid knowledge of Linux, networking, and performant coding.
• Experience with embedded systems.
• Experience with high-speed networking or HPC/RDMA interconnects.

Benefits

Includes sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Comprehensive benefits include medical, dental, vision, prescription, life insurance, AD&D insurance, EAP, mental health support, medical advice line, flexible spending accounts, adoption and surrogacy reimbursement coverage, 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

Pay

Base salary range: $193,300.00 - $261,500.00 USD annually for USA, CA, Cupertino; $168,100.00 - $227,400.00 USD annually for USA, WA, Seattle.

Schedule

Not specified.