AI Hardware Systems Engineer, Annapurna Labs, Trainium Machine Learning Fleet Operations

Key job responsibilities

• Member of a team responsible for system remediation, operational excellence, and customer experience on bleeding edge ML products
• Utilize data to root cause hardware failures and identify live trends on the most complex systems in AWS
• Implement and improve system level testing across the product lifecycle
• Develop software which can be maintained, improved upon, documented, tested, and reused
• Dive deep on issues at the intersection of hardware and software

A day in the life

As a Platform Development Engineer, you are the dedicated owner of an ML server platform in our fleet. Your mission is to maximize its health, sellability, and customer experience. You start each day with eyes on the fleet — reviewing dashboards to identify trends and triaging emergent issues, then partnering with hardware and software engineering teams to debug, investigate, and translate findings into permanent fixes. You own the end-to-end testing story and manage tradeoffs between coverage and velocity. You direct new automations, tooling, and data infrastructure to scale your operations. You manage software deployments, debug issues with them, and run status meetings to align all platform stakeholders on how the product is performing.

About The Team

The MLA Fleet Operations team was formed to maintain an exceptionally high quality bar for our fleet of advanced machine learning accelerators and server products. We perfect the customer experience by developing scalable software for rapid incident response times and data visualization as well as diving deep into hardware issues as they arise.

Basic Qualifications

• 2+ years of non-internship professional software development experience
• 1+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
• 1+ years of administrative experience in networking, storage systems, operating systems and hands-on systems engineering experience
• Knowledge of systems engineering fundamentals (networking, storage, operating systems)
• Experience programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby
• Experience with Linux/Unix
• Experience debugging and systems analysis to identify and quickly resolve or mitigate issues
• Bachelor's degree in Computer Science, Computer Engineering, or Electrical Engineering

Preferred Qualifications

• Experience in hardware design and validation of components, subsystems and systems
• Experience with SOC bring-up and post-silicon validation
• Master's degree in Computer Science, Computer Engineering, or Electrical Engineering