AI Editor, Alexa for Shopping - Content and Marketing Experiences

About the role

Alexa for Shopping makes it easy for customers to find and discover products to meet their unique needs by helping with product research, providing comparisons and recommendations, answering specific product questions, and more. The AI Editor will be responsible for improving the fluency of our AI models through human-in-the-loop evaluations and LLM judge audits. They will uphold and contribute to quality, style, and tone guidelines, while using customer feedback to continually improve Amazon’s ability to be helpful to customers. Cross-functional partnership will be key, as this team works across Product, Science, and Design teams to evaluate CX metrics, develop scalable reporting systems, and ensure continual model improvements.

Responsibilities

• Improve the fluency of AI models through human-in-the-loop evaluations and LLM judge audits
• Contribute to quality, style, and tone guidelines
• Use customer feedback to continuously improve Amazon’s ability to be helpful to customers
• Evaluate CX metrics and develop scalable reporting systems
• Ensure continual model improvements through cross-functional collaboration

Requirements

• Bachelor's degree in English, Communications, Linguistics, or a related field
• 2+ years of technical writer, editor, or content strategist experience
• Experience with human-in-the-loop AI evaluation, prompt engineering, or AI model quality assessment

Qualifications

• Exceptional written and oral communication skills
• Excellent judgment
• Strong project management skills
• Deep curiosity about how things work
• A passion for serving customers
• Enjoy context-switching and partnering at all levels of the organization to deliver results

Skills

• Fluency in natural language processing and machine learning concepts
• Experience with AI model evaluation and improvement
• Strong analytical and problem-solving skills
• Ability to work collaboratively across multiple teams

Benefits

• Comprehensive benefits including medical, dental, vision, prescription, life insurance, and retirement plans
• Paid time off and parental leave
• Flexible spending accounts and mental health support

Pay

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs).

Schedule

Full-time