Sr. Software Development Engineer, Amazon Shopping (Rufus)

About the role

We're enhancing the shopping experience on Amazon through the conversational capabilities of large language models. You'll have the opportunity to contribute meaningfully to the industry while working alongside talented scientists, engineers, and technical program managers (TPMs) to create solutions that serve our customers. This role involves architecting, designing, and developing agentic services and applications powered by large language models, with a focus on back-end systems and online services.

Responsibilities

• Build expertise in online service architecture, API development, and distributed systems that power responsive agentic AI applications at scale.
• Develop service orchestration patterns, efficient agent frameworks, and real-time processing systems.
• Partner with engineers and scientists to deliver exceptional user experiences in a fast-paced environment.
• Contribute to the technical roadmap, service reliability metrics, and optimizations for intelligent agents that reason, plan, and execute complex tasks.
• Establish best practices to improve LLM application efficiency and enable new agentic AI features for Amazon Stores customers.
• Design and implement large-scale distributed agentic AI applications, collaborating with technical and business leaders.
• Contribute to prioritization, estimation, and sprint planning activities.

Requirements

• 5+ years of non-internship professional software development experience.
• 5+ years of programming experience with at least one software programming language.
• 5+ years of experience leading design or architecture (design patterns, reliability, and scaling) of new and existing systems.
• Experience as a mentor, tech lead, or leading an engineering team.
• Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques.

Preferred Qualifications

• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Experience building or operating LLM-powered agent systems (tool use, ReAct loops, multi-step orchestration).
• Experience with agent evaluation frameworks (offline evaluation, LLM-as-Judge, composite scoring, or quality measurement at scale).
• Experience hosting or serving large language models at scale (model deployment, inference optimization, GPU cluster management, vLLM/TensorRT).

About the Team

The Amazon Shopping Team is focused on improving shopping on Amazon using the conversational capabilities of large language models. We are working on an AI-first initiative to enhance search using large-scale foundation models, which are also utilized by various partner teams in Amazon Stores. Our goal is to build large language models (LLMs) that empower conversational applications and facilitate online shopping.

Pay

USA, CA, Palo Alto: $193,300.00 - $261,500.00 USD annually
USA, WA, Seattle: $168,100.00 - $227,400.00 USD annually

Benefits

• Sign-on payments and restricted stock units (RSUs).
• Comprehensive health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance, and optional supplemental life plans).
• Employee Assistance Program (EAP) and Mental Health Support.
• Medical Advice Line and Flexible Spending Accounts.
• Adoption and Surrogacy Reimbursement coverage.
• 401(k) matching.
• Paid time off and parental leave.

Learn more about our benefits at amazon.jobs/en/benefits.