Software Engineer II, ML

About The Company

Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world.

About The Role

The Machine Learning Server Software Team is seeking talented candidates interested in developing data-driven software for our advanced Machine Learning servers. In this role, you will be responsible for building production-grade software that initializes, monitors, and maintains the most sophisticated machine learning acceleration servers globally. Your work will span from low-level hardware initialization—such as accelerator chip setup, clock, and voltage configurations—to system-level device drivers for interfaces like I2C, PCIe, and SPI. This position does not involve developing machine learning algorithms but focuses on optimizing the hardware systems that execute and accelerate these algorithms. Your contributions will directly impact the performance and scalability of our server infrastructure, enabling cutting-edge AI and machine learning applications worldwide.

Qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of experience in system design or architecture, including design patterns, reliability, and scalability
• Proficiency in at least one programming language such as C, C++, Python, or Lua
• Bachelor's degree in computer science, electrical engineering, or a related field (or equivalent experience)

Responsibilities

• Develop and maintain software associated with server components and their integration into EC2 environments
• Collaborate with hardware, test, and manufacturing teams to create coordinated software packages for qualification and rapid deployment
• Design, implement, and optimize software modules for hardware initialization, monitoring, debugging, and testing
• Write clean, maintainable, well-documented code that can be reused and scaled across multiple projects
• Participate in code reviews, testing, and troubleshooting to ensure high-quality deliverables
• Contribute to automation efforts to improve scalability and efficiency of server software operations

Benefits

• Competitive salary packages, including sign-on bonuses and restricted stock units (RSUs)
• Comprehensive health insurance coverage (medical, dental, vision, prescription drugs)
• Basic Life & AD&D insurance, with options for supplemental plans
• Employee Assistance Program (EAP) and mental health support services
• Flexible Spending Accounts and wellness programs
• 401(k) retirement savings plan with company matching
• Paid time off, parental leave, and family support programs
• Opportunities for professional growth, mentorship, and career development