Product Analyst (Prompt Context Designer)

About the role

STAND 8 provides end-to-end IT solutions to enterprise partners across the United States and with offices in Los Angeles, New York, New Jersey, Atlanta, and more including internationally in Mexico and India. The Product Analyst (Context Designer) is responsible for designing, documenting, and optimizing AI-powered conversational experiences that support business operations and customer interactions.

Responsibilities

• Write, refine, and configure natural-language prompts that guide voice AI agents through defined business processes and customer interactions.
• Design conversational flows, decision paths, response logic, and escalation scenarios based on approved business requirements.
• Partner closely with sales, servicing, fulfillment, production, and operational teams to capture and document AI use cases.
• Facilitate requirements discussions to clarify business rules, negotiate priorities, identify exceptions, and resolve process gaps.
• Translate business objectives into detailed functional requirements, user stories, acceptance criteria, and conversational design specifications.
• Review, validate, organize, and curate operational documentation, including PDFs, procedures, policies, and knowledge articles.
• Help establish and maintain verified source-of-truth content used by retrieval-augmented generation and vector database solutions.
• Plan and execute A/B tests across prompts, conversational approaches, and response configurations.
• Analyze AI interaction data to identify opportunities to improve accuracy, tone, completion rates, customer experience, and issue resolution.
• Support the Product Owner in developing and documenting a "Golden Dataset" of representative test scenarios for automated and manual AI evaluations.
• Collaborate with platform engineers and technical teams to validate integrations, API interactions, data exchanges, and end-to-end platform functionality.
• Identify inconsistencies, missing information, edge cases, and potential risks within AI-generated responses and conversational workflows.
• Document findings, testing results, recommendations, and configuration changes in a clear and repeatable manner.

Qualifications

• 3-5 years of experience as a Product Analyst, Business Analyst, Product Operations Analyst, or in a comparable analytical role.
• Working knowledge of generative AI concepts, including large language models, prompt design, retrieval-augmented generation, vector databases, and AI evaluation methods.
• Strong experience gathering, documenting, validating, and negotiating business and functional requirements.
• Demonstrated ability to translate complex business processes into clear workflows, decision logic, user stories, and acceptance criteria.
• Strong written communication skills with the ability to create precise, natural, and contextually appropriate language.
• Experience designing or documenting conversational workflows, customer journeys, process flows, or decision trees.
• Strong analytical skills with experience evaluating test results, identifying patterns, and making data-informed recommendations.
• Exceptional attention to detail, particularly when reviewing business rules, source documentation, prompts, and AI-generated outputs.
• Able to work effectively with product owners, business stakeholders, subject-matter experts, and engineering teams.
• Able to quickly learn technical concepts and communicate effectively between business and technology groups.

Preferred (Optional)

• Prior experience with Mortgage, Banking or Financial services.
• Experience supporting conversational AI, voice AI, virtual agents, chatbots, or other prompt-driven applications.
• Familiarity with A/B testing, AI quality measurement, model evaluation, or test-dataset development.
• Exposure to AWS-based platforms, API integrations, or cloud-hosted AI solutions.
• Experience working within financial services, mortgage, lending, servicing, or another highly regulated environment.
• Familiarity with Agile product development methodologies and tools used to manage requirements, backlogs, and testing.

Benefits

• Medical coverage and Health Savings Account (HSA) through Anthem
• Dental/Vision/Various Ancillary coverages through Unum
• 401(k) retirement savings plan
• Paid-time-off options
• Company-paid Employee Assistance Program (EAP)
• Discount programs through ADP WorkforceNow
• Additional Details: The base range for this contract position is $36 - $48 per hour, depending on experience. Our pay ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hires of this position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Qualified applicants with arrest or conviction records will be considered.

About Us

STAND 8 provides end-to-end IT solutions to enterprise partners across the United States and globally with offices in Los Angeles, Atlanta, New York, Mexico, Japan, India, and more. STAND 8 focuses on the "bleeding edge" of technology and leverages automation, process, marketing, and over fifteen years of success and growth to provide a world-class experience for our customers, partners, and employees. Our mission is to impact the world positively by creating success through PEOPLE, PROCESS, and TECHNOLOGY.

Contact Us

Check out more at www.stand8.io; and reach out today to explore opportunities to grow together!