DirectJobHub
Jobs · Information Technology · Texas

Product Owner (AI & Prompt Strategy)

Stand8 Technology Consulting · Carrollton, TX · Yesterday
On-siteInformation Technology$47–$62.5/hrContract

About the role

STAND 8 provides end-to-end IT solutions to enterprise partners across the United States and internationally in Mexico and India. We have offices in Los Angeles, New York, New Jersey, Atlanta, and more.

Responsibilities

  • Own the overall product vision and roadmap for enterprise conversational AI and voice-agent initiatives.

  • Define and govern the enterprise AI persona, brand voice, system instruction, and prompt development strategy.

  • Lead product orchestration across sales, servicing, fulfillment, and operational teams supporting parallel AI-agent development.

  • Architect multi-agent conversational models that route user intent to specialized AI agents.

  • Develop, test, refine, and optimize system prompts, prompt templates, system instructions, and few-shot examples.

  • Balance conversational quality, contextual accuracy, token efficiency, latency, and operational performance across AWS-based AI solutions.

  • Establish product frameworks and dashboards to measure prompt effectiveness, AI performance, and customer outcomes.

  • Track AI-specific metrics including hallucination rates, contextual accuracy, containment rates, task completion, latency, escalation frequency, and user abandonment.

  • Utilize customer feedback and operational metrics to continuously improve AI performance.

  • Lead prioritization of business requirements across multiple stakeholder groups.

  • Identify dependencies, resolve competing priorities, and eliminate business and technical bottlenecks.

  • Define and maintain representative AI evaluation datasets and testing scenarios.

  • Partner with engineering teams to integrate automated evaluation pipelines and quality frameworks.

  • Lead A/B testing initiatives for prompts, conversational flows, personas, and response strategies.

  • Define product success metrics aligned with business KPIs.

  • Collaborate with engineering teams on APIs, infrastructure integration, latency optimization, and AI safety guardrails.

  • Mentor Product Analysts responsible for prompt development, testing, business requirements, and knowledge management.

  • Present product strategy, roadmap, risks, and performance updates to executive leadership.

Qualifications

  • 5-7 years of experience in Product Management, Product Ownership, AI Product Management, or a comparable product leadership role.

  • Demonstrated experience leading conversational AI, voice AI, generative AI, or large language model products.

  • Strong knowledge of prompt engineering, including system prompts, system instructions, prompt templates, few-shot examples, context management, and iterative tuning.

  • Proven ability to design multi-agent systems, agent-routing models, complex conversational architectures, or state-machine workflows.

  • Experience translating complex business rules and operational processes into precise technical configurations and natural-language interaction flows.

  • Strong understanding of large language models, retrieval-augmented generation, AI orchestration, vector databases, and automated evaluation methods.

  • Experience defining product strategy, roadmaps, success metrics, requirements, user stories, and acceptance criteria for enterprise technology products.

  • Strong analytical background with experience developing performance dashboards, evaluating data, and identifying actionable trends.

  • Experience planning and executing A/B tests, controlled experiments, or iterative product-optimization initiatives.

  • Familiarity with AI-specific performance measures, including hallucination rates, contextual accuracy, containment, prompt latency, and task completion.

  • Ability to work effectively with engineering teams on API integrations, cloud infrastructure, platform performance, and technical dependencies.

  • Exceptional leadership, communication, facilitation, negotiation, and stakeholder-management skills.

  • Ability to lead multiple workstreams and coordinate priorities across business, product, operations, and engineering teams.

  • Strong written communication skills with the ability to develop clear, precise, and contextually appropriate AI instructions.

Preferred (Optional)

  • Prior experience within mortgage, banking, lending, fintech, financial services, or complex customer-servicing environments.

  • Experience designing or scaling enterprise voice AI, virtual-agent, chatbot, or contact-center automation solutions.

  • Experience working within a federated hub-and-spoke product or technology operating model.

  • Exposure to AWS-based generative AI platforms, services, infrastructure, or AI-development environments.

  • Familiarity with LLM-as-a-judge methodologies, automated AI-evaluation pipelines, and Golden Dataset development.

  • Experience defining and implementing AI-safety guardrails, content controls, escalation logic, and responsible-AI practices.

  • Experience managing or mentoring Product Analysts, Business Analysts, Prompt Designers, or AI-product team members.

  • Familiarity with Agile product-development methodologies and tools used to manage product roadmaps, backlogs, requirements, testing, and releases.

Benefits

  • Medical coverage and Health Savings Account (HSA) through Anthem

  • Dental/Vision/Various Ancillary coverages through Unum

  • 401(k) retirement savings plan

  • Paid-time-off options

  • Company-paid Employee Assistance Program (EAP)

  • Discount programs through ADP WorkforceNow

  • Additional Details

  • The base range for this contract position is $47 - $62.50 per hour, depending on experience.

Similar jobs