Senior Technical Program Manager, Customer Experience and Business Trends

About the role

The Senior Technical Program Manager will build advanced model and agent evaluation capabilities that measure the performance of GenAI (LLMs, multi-modal models, LLM-based agents) and end-customer experience. This role will influence how Amazon teams improve customer experiences through comprehensive model assessment and optimization capabilities.

Responsibilities

• Work with product managers and software development managers to scope and define roadmap priorities.
• Develop and execute program roadmaps across product, engineering, and science teams.
• Define success metrics and KPIs, tracking progress towards program goals.
• Create cost awareness of both headcount investment and OPEX, and establish tracking and forecasting mechanisms for OP1/OP2 input.
• Leverage technical experience of Agents/LLMs to highlight project risks, look around corners, and help the team deliver efficiently.
• Anticipate bottlenecks, provide escalation management, and make strategic tradeoffs to optimize time-to-launch.
• Interface with senior leadership to provide program updates and strategic recommendations.

Requirements

• 5+ years of technical product or program management experience
• 7+ years of working directly with engineering teams experience
• 3+ years of software development experience
• 5+ years of technical program management working directly with software engineering teams experience
• Experience managing programs across cross functional teams, building processes and coordinating release schedules

Qualifications

• Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
• Experience defining KPI's/SLA's used to drive multi-million dollar businesses and reporting to senior leadership
• Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware

Skills

• Deep technical expertise in data-driven decision making
• Proven experience planning, executing, and delivering projects across cross-functional teams
• Hands-on experience in LLM-based agent development or LLM/Agent evaluation
• The ability to influence without authority across multiple teams

Benefits

Amazon offers comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

Base salary range for this position is $148,700.00 - $201,200.00 annually.