Jobs · Information Technology · California

WEM AQM Prompt Engineer

TalentAlly · San Ramon, CA · 3 days ago
Information Technology$70k–$196k/yrFull-time

About the role

Join us in bringing joy to customer experience. Five9 is a leading provider of cloud contact center software, bringing the power of cloud innovation to customers worldwide. Living our values everyday results in our team-first culture and enables us to innovate, grow, and thrive while enjoying the journey together. We celebrate diversity and foster an inclusive environment, empowering our employees to be their authentic selves.

Responsibilities

  • Design, author, and iteratively optimize LLM evaluation prompts within Five9 AQM, translating quality management frameworks into accurate, testable prompt logic.
  • Partner with customers and internal delivery consultants during AQM implementation engagements to define evaluation scope, intent, and pass/fail criteria.
  • Select and analyze representative call samples to validate prompt performance; apply precision and recall thinking to measure and improve prompt accuracy.
  • Maintain a structured prompt library - versioning prompts, documenting changes, and managing prompt lifecycle from initial design through to production handover.
  • Collaborate with QA and Implementation teams to integrate prompt outputs into broader QM workflow design, including scoring forms and reporting.
  • Identify prompt failure patterns and apply structured debugging techniques, including chain-of-thought adjustments, instruction clarity improvements, and few-shot example tuning.
  • Contribute to the development of Five9 AQM prompt engineering standards, best practice documentation, and reusable prompt templates.
  • Support pre-sales activities by demonstrating Five9 AQM prompt capabilities and articulating the value of AI-driven quality evaluation to prospective customers.
  • Stay current with LLM developments, prompt engineering research, and the evolving Five9 AQM product roadmap.

Requirements

  • Minimum 3 years' hands-on experience as a Speech Analytics Analyst, QM Analyst, or WEM Application Consultant with deep involvement in category/topic design and optimization in Verint (Categories/CategorySets), NICE (Category Sets), Genesys (Topics), or equivalent platforms.
  • Demonstrable prompt engineering skills - either via formal qualification or a verifiable portfolio of prompt design work (production prompts, evaluation outputs, or documented iteration cycles).
  • Strong understanding of contact center Quality Management processes, evaluation frameworks, and scoring methodologies.
  • Experience selecting and analyzing call/interaction samples for model validation; comfortable applying precision, recall, and F1-score thinking to prompt performance measurement.
  • Proven ability to translate business and QM requirements into structured, testable evaluation logic.
  • Excellent written communication skills - prompt engineering is fundamentally a writing discipline.
  • Experience working in a customer-facing or professional services environment.
  • BA/BS or equivalent experience.

Qualifications

  • Formal prompt engineering certification or coursework (e.g., DeepLearning.AI Prompt Engineering for Developers, Anthropic Prompt Engineering certification, OpenAI Prompt Engineering course, or equivalent).
  • Hands-on experience with one or more major LLM platforms (OpenAI, Anthropic Claude, Google Gemini, or similar) including direct API or playground usage.
  • Prior exposure to Five9 AQM or equivalent AI-native QM solutions.
  • Experience with NICE Enlighten, Qualtrics, Medallia, or other AI-driven analytics platforms.
  • Familiarity with JSON, basic scripting, or no-code automation tools - useful for prompt testing workflows.
  • Experience developing training materials or internal knowledge base documentation.
  • Background in compliance-driven QM environments (financial services, healthcare, utilities).

Skills

  • Analytical Rigor - applies structured, data-driven thinking to prompt design and performance measurement.
  • Linguistic Precision - writes clear, unambiguous instructions; understands how wording choices affect model behavior.
  • Iterative Mindset - comfortable with test-and-learn cycles; treats prompt refinement as an ongoing discipline, not a one-time task.
  • Domain Expertise - deep understanding of contact center operations, QM frameworks, and agent evaluation best practices.
  • Customer Orientation - able to translate client QM goals into technical prompt requirements and communicate findings clearly to non-technical stakeholders.
  • Intellectual Curiosity - keeps pace with the rapidly evolving LLM and generative AI landscape.

Benefits

Our Total Reward Package includes:

  • Health, dental, and vision coverage, beginning on the first day of employment.
  • Short & Long-Term Disability, Basic Life Insurance.
  • A 401k saving plan with employer matching.
  • Access to an innovative mental health support platform that offers personalized care and resources in areas such as: therapy, coaching and self-guided mindfulness exercises for all covered employees and their covered dependents.
  • A generous employee stock purchase plan.
  • Paid Time Off, Company paid holidays, paid volunteer hours and 12 weeks paid parental leave.

Pay

$70,400—$195,700 USD

Schedule

This role is fully remote for candidates who reside outside the 30 mile radius of one of our offices. For candidates who reside within a 30 mile radius of one of our offices, this role is Hybrid and would require 3 days a week (T, W, TH) in office.

Application Instructions

Note: Five9 will never request that an applicant send money as a prerequisite for commencing employment with Five9. VEVRAA Federal Contractor. We request Priority Protected Veteran & Disabled Referrals for all of our locations within the state.

Similar jobs

WEM AQM Prompt Engineer

TalentAllyAtlanta, GA· 3 days ago
Information Technology$70k–$196k/yrapply on talentally.com

WEM AQM Prompt Engineer

TalentAllyCharlotte, NC· 3 days ago
Information Technology$70k–$196k/yrapply on talentally.com

WEM AQM Prompt Engineer

TalentAllyNew York, NY· 3 days ago
Information Technology$70k–$196k/yrapply on talentally.com

WEM AQM Prompt Engineer

TalentAllyHouston, TX· 3 days ago
Information Technology$70k–$196k/yrapply on talentally.com

Prompt Engineer

Jobright.aiCayce, SC· Yesterday
Engineering$15k–$20k/yrapply on jobright.ai