Machine Learning Engineer, Alexa AI

About the role

The Alexa AI team is looking for a passionate, talented, and inventive Machine Learning Engineer with a strong machine learning background, to build capabilities such as fine tuning, distillation, and LLM Inference. As a ML engineer with the Alexa AI team, you will be responsible for machine learning platform focus on LLM training, production deployment, and optimizations to advance the state of LLMs. You will collaborate closely with Applied Scientists and other MLEs, leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate development of Generative Artificial Intelligence solutions.

Responsibilities

• Will work with other team engineers to investigate design approaches, prototype new technology and evaluate technical feasibility.
• Work closely with Applied scientists to process data, scale machine learning models.
• Work in an Agile/Scrum environment to deliver high quality software.

Basic Qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience working with PyTorch or JAX software
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field

Preferred Qualifications

• Experience working with PyTorch or JAX software, or experience with vLLM, SGLang, TensorRT or similar platforms in production environments
• Experience developing large model hosting platforms, establishing frameworks, and scaling and optimizing inference system.
• Experience developing and maintaining MLOps tool in large organizations.