Senior Software Development Engineer , Stores Foundational AI - Rufus
Amazon · Palo Alto, CA · 2 wk ago
ConsultingFull-time
Key job responsibilities
- Architect and build scalable ML infrastructure powering LLM training and post-training workflows, including supervised fine-tuning, reinforcement learning, and continuous learning from live traffic
- Transform real-world customer interactions into high-quality training signals, enabling continuous model improvement and better customer experiences
- Build and optimize post-training and RL systems, including reward modeling, policy optimization, data collection loops.
- Drive experimentation and iteration velocity by building tooling and frameworks that enable rapid hypothesis testing, signal validation, and model quality improvements
- Partner closely with applied scientists to translate frontier techniques (e.g., RLHF, agentic workflows, multi-turn optimization) into reliable, production-grade systems
- Own systems end-to-end, including design, implementation, deployment, observability, and operational excellence
- Raise the engineering bar through technical leadership, design reviews, and mentorship, influencing best practices across the organization
- 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team
- Experience with vLLM, SGLang, TensorRT or similar platforms in production environments
- Experience with CUDA kernels or ML/low-level kernels
- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution
Basic Qualifications
Preferred Qualifications
Pay
Base salary range: $168,100.00 - $227,400.00 USD annually
Schedule
Not specified