Lead Engineer, ML Network Stack - Annapurna Labs

About the role

The role involves being the lead engineer on a team that builds and maintains the infrastructure monitoring and reporting on functionality and performance of massive testing workloads run at scale. Responsibilities include using internal Amazon CI/CD tools, Linux, and public AWS products to automate the delivery of software to customers, writing Python code to spool up large clusters and run benchmarks and applications for ML and HPC workloads, using AWS Managed Grafana and Athena to digest performance data, and creating dashboards for developers and stakeholders. Additionally, the role involves inventing automatic mechanisms to alert developers to functional and performance regressions.

Responsibilities

• Lead the design and implementation of new and existing systems
• Automate the delivery of software to customers using internal Amazon CI/CD tools
• Write Python code to spool up large clusters and run benchmarks and applications for ML and HPC workloads
• Create and maintain automated dashboards and visualizations using AWS Managed Grafana and Athena
• Invent and implement automatic mechanisms to alert developers to functional and performance regressions
• Manage the complexity of infrastructure covering various instance types, software stacks, Linux operating systems, and cutting-edge releases

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of leading design or architecture of new and existing systems
• 5+ years of full software development life cycle experience
• 3+ years of experience as a mentor, tech lead, or leading engineering teams
• 3+ years of experience in SW/HW Co-Design

Qualifications

• Bachelor's degree in computer science or equivalent
• Experience creating automated dashboards and visualization (such as Grafana)
• Experience with AWS Managed Grafana and Athena
• Experience with AWS Managed Grafana and Athena

Skills

• Solid knowledge of Linux, networking, and performant coding
• Experience with embedded systems
• Experience with high-speed networking or HPC/RDMA interconnects

Benefits

• Comprehensive benefits including medical, dental, vision, prescription, life insurance, AD&D insurance, EAP, mental health support, medical advice line, flexible spending accounts, adoption and surrogacy reimbursement coverage
• 401(k) matching
• Paid time off
• Parental leave

Pay

$193,300.00 - $261,500.00 USD annually

Schedule

Full-time