Sr. Applied Science Manager, Perfect Order Experience (POE) AI
About the role
The Perfect Order Experience (POE) AI team combines artificial intelligence, machine learning, and economic insights to ensure exceptional customer experiences and seller success on Amazon. We develop advanced scientific solutions that protect product authenticity, maintain quality standards, and safeguard intellectual property across Amazon's vast catalog. Our work spans from building detection systems using state-of-the-art Large Language Models to creating automated investigation processes and risk treatment mechanisms. Our solutions directly impact billions of customer interactions and enable millions of sellers to thrive while maintaining the highest standards of trust and quality. We are seeking an exceptional Senior Applied Science Manager to lead key AI initiatives to ensure a perfect order experience for Amazon customers. In this role, you will spearhead the development of a domain specific large language model designed to comprehend complex seller behaviors and relationships. You will lead the research and implementation on LLM pre-training, fine-tuning and reinforcement learning for LLM reasoning. You will implement and influence ranker models that intelligently adjust product visibility based on risk signals and trust metrics.
Key job responsibilities
- Drive AI strategy and lead a team of applied scientists in developing ML solutions.
- Lead the end-to-end development of a domain specific LLM.
- Drive the development of large-scale pre-training and post-training strategies for the LLM using domain-specific datasets.
- Architect automated risk detection and treatment systems that combine multi-modal signals to identify product quality issues and implement optimization-based mitigation strategies.
- Collaborate with other science teams to develop/influence ranker models that optimize product visibility.
About the team
The POE AI Science team sits at the forefront of Amazon's efforts to ensure customers can shop with confidence. Our team combines artificial intelligence, machine learning, and economic insights to protect product authenticity, maintain quality standards, and safeguard intellectual property across Amazon's vast catalog. The work we do directly impacts billions of customer interactions and enables millions of sellers to thrive while maintaining the highest standards of trust and quality.
Basic Qualifications
- Ph.D. in Computer Science, Machine Learning, or related technical field, or equivalent practical experience
- Experience leading and managing teams of scientists/engineers in delivering ML solutions at scale
- Strong track record in developing and deploying production ML systems
- Strong publication record or proven industrial innovations (e.g., patents) in ML/AI
Preferred Qualifications
- Strong communication skills with ability to translate complex technical concepts to various audiences
- Experience with LLM development, including pre-training, fine-tuning, and reinforcement learning
- Knowledge of search, ranking, or recommendation systems
- Experience with multi-modal ML systems combining text, image, and structured data
Pay
- USA, WA, Seattle - 218,800.00 - 295,900.00 USD annually
Benefits
- Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
- 401(k) matching
- Paid time off
- Parental leave
- Sign-on payments and restricted stock units (RSUs) included in compensation package