Sr. Product Mgr. Tech, Catalog Experimentation and Impact Measurement

About the role

Do you want to shape Amazon's experimentation and impact-measurement capabilities in the era of Generative AI? As we navigate the rapidly changing landscape of e-commerce, your role will be crucial in shaping how Amazon teams, sellers, and vendors optimize catalog listings for a superior customer experience. Join the Catalog Experimentation and Impact Measurement (CEM) team on our mission to create the best product listings that help customers make well-informed, fast buying decisions. We build the feedback loops that let Large Language Models and Amazon teams enrich product data through experimentation at Amazon scale.

Responsibilities

• Lead the conceptualization, delivery, and worldwide adoption of the Catalog Experimentation Platform (CEP).
• Collaborate with economists to help users design experiments correctly and guide them in interpreting outcomes generated through rigorous statistical analysis.
• Advocate for decisions in the best interest of customers even when the outcomes are unpleasant for the experimenters.
• Measure the impact of initiatives that intend to improve product data quality: estimate how improvements translate into incremental sales and customer benefit; partner teams run controlled experiments while the team reviews their design and aggregates results across the organization.
• Collaborate with economists to identify and apply the best possible causal-inference methodology for each initiative, and extend the scope of the platform to make it the go-to destination at Amazon for measuring the impact of catalog improvement programs.
• Collaborate with engineering counterparts to build systems for automation, self‑service mechanisms, and guardrails to make experimentation and impact measurement work at Amazon scale without compromising reliability.
• Work backwards from the customer experience to define strategy and build a product roadmap for the Catalog Experimentation Platform (CEP), used to run A/B experiments on catalog listings.
• Launch new products and features by partnering with CEP engineering and science teams.
• Drive adoption by partnering with the teams building large language models for the catalog and with business stakeholders across different product categories.
• Partner with economists and other product managers on the team to develop frameworks and shape how business stakeholders and leadership think about impact‑measurement methodologies.
• Represent CEP in Amazon‑wide forums on experimentation and impact measurement.
• Learn about the strengths and challenges of experimentation platforms used across the industry.
• Develop product strategy — positioning, go‑to‑market, and competitive advantage — in collaboration with your engineering and science counterparts.
• Track key product metrics and communicate wins, misses, and learnings to your key stakeholders.
• Conduct office hours to guide experimentation users.
• Communicate strategy and key updates to org leadership through monthly flashes and business‑review forums.

Requirements

• 5+ years of product or program management, product marketing, business development or technology experience
• Bachelor's degree
• Experience with feature delivery and tradeoffs of a product
• Experience owning/driving roadmap strategy and definition
• Experience with end‑to‑end product delivery
• Experience contributing to engineering discussions around technology decisions and strategy related to a product
• Experience managing technical products or online services
• Experience representing and advocating for a variety of critical customers and stakeholders during executive‑level prioritization and planning

Qualifications

• Bachelor's degree in math/statistics/engineering or other equivalent quantitative discipline

Benefits

• Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• Paid time off
• Parental leave

Pay

Base salary range: $151,200.00 – $204,600.00 USD annually (USA, WA, Seattle). The Amazon package also includes sign‑on payments and restricted stock units (RSUs).