Senior Software Development Engineer , Stores Foundational AI - Rufus

Key job responsibilities

• Arcitect and build scalable ML infrastructure powering LLM training and post-training workflows, including supervised fine-tuning, reinforcement learning, and continuous learning from live traffic
• Transform real-world customer interactions into high-quality training signals, enabling continuous model improvement and better customer experiences
• Build and optimize post-training and RL systems, including reward modeling, policy optimization, data collection loops
• Drive experimentation and iteration velocity by building tooling and frameworks that enable rapid hypothesis testing, signal validation, and model quality improvements
• Partner closely with applied scientists to translate frontier techniques (e.g., RLHF, agentic workflows, multi-turn optimization) into reliable, production-grade systems
• Own systems end-to-end, including design, implementation, deployment, observability, and operational excellence
• Raise the engineering bar through technical leadership, design reviews, and mentorship, influencing best practices across the organization

Basic Qualifications

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team
• Experience with vLLM, SGLang, TensorRT or similar platforms in production environments
• Experience with CUDA kernels or ML/low-level kernels

Preferred Qualifications

• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent
• Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution

Company

• Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
• Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
• The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs).
• Final compensation will be determined based on factors including experience, qualifications, and location.
• Amazon also offers comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave.