Director of AI Operations & Governance (R5464)
About the role
Shield AI is seeking a Director of AI Operations & Governance to operationalize and govern our workplace AI ecosystem across all AI initiatives. Reporting to the VP of Workplace AI, this role will own license and platform operations, AI governance, security posture, and ongoing lifecycle management of AI tools that support Shield AI's business functions.
Responsibilities
The role will be the central owner of "post–dev-ops" for AI, ensuring systems are reliable, compliant, secure, and continuously improving in line with production usage and business needs, while building and leading the team responsible for AI sustainment.
- Technical AI/ML Ownership: Evaluate, benchmark, fine-tune, and adjust configurations of ML and generative AI models in production.
- Apply applied AI/ML research and emerging techniques to inform build-vs-buy decisions, model selection, and architecture choices across the AI portfolio.
- Partner directly with data science and ML engineering teams on model performance issues, drift detection, and retraining or reconfiguration needs.
- Maintain technical fluency in prompt engineering, retrieval-augmented generation, agentic/orchestration frameworks, and the practical distinctions between generative AI and traditional ML systems.
- AI Sustainment & Governance: Own AI sustainment and governance for workplace AI tools across enablement, bought solutions, and custom builds.
- Manage all AI-related licenses and entitlements, monitor usage, optimize allocations, drive reallocation, and partner with Finance for cost visibility and optimization.
- Monitor production usage patterns and performance to recommend roadmap items, enhancements, and deprecations based on real-world dynamics in production.
- Own and triage support tickets for workplace AI tools and platforms, driving resolution across vendors, internal engineering, and security partners.
- Lead continuous evaluations of AI tools and models, including monitoring drift, benchmarking performance, and ensuring tools remain effective and aligned with business KPIs.
- Maintain the updates and security outlook for AI platforms, coordinating patches, version upgrades, vulnerability remediation, and compliance with Shield AI security policies.
- Orchestrate model swaps and configuration changes in production, including rollout planning, risk assessment, change control, and post-deployment monitoring.
- Design, maintain, and govern shared prompt libraries, including standards for prompt quality, reuse, versioning, and training for end-users and builders.
- Own management of secrets used by AI tools and orchestrators, ensuring secure storage, rotation, and access control in partnership with Security and IT.
- Define and maintain connectors and extensions to ensure reliable, secure data access for AI workflows.
- Establish and operate auditability frameworks for AI tools, including logging, traceability of AI-assisted actions, and reporting for compliance and risk management.
- Lead AI governance practices for workplace AI in partnership with Security, Legal, and HR.
- Partner with business solution and build teams to ensure their deliverables meet sustainment, observability, and governance requirements before moving to production.
- Define operational playbooks, SLAs, and incident response procedures for AI systems.
Leadership & Strategy
Build, lead, and develop a team of AI operations professionals, contractors, and platform specialists, establishing career paths and scaling the function as the organization matures.
- Set the strategic direction for AI operations and governance, translating enterprise priorities into a multi-quarter roadmap and budget owned by this role.
- Provide regular status and risk updates to the VP of Workplace AI and other senior leadership, including adoption metrics, reliability indicators, governance findings, and cost trends.
Requirements
- 15+ years in platform operations, ML/AI operations, DevOps, or SaaS sustainment roles, including significant experience in leadership/people management.
- Direct, hands-on experience developing, training, fine-tuning, or evaluating machine learning models or generative AI systems.
- Working knowledge of AI/ML research practices and the ability to apply current research to production decision-making.
- Software engineering or data science background sufficient to engage deeply with technical teams on model behavior, integration issues, and system design tradeoffs.
- Direct experience with AI platforms or orchestration tools and their operational management, including at an organizational or strategic level.
- Demonstrated understanding of the distinct technical and operational challenges of generative AI versus traditional ML.
- Strong background in governance, compliance, or security in the context of data-driven or AI systems.
- Demonstrated ability to manage licenses and cost optimization for SaaS or AI tools at scale.
- Hands-on experience with monitoring and observability stacks and using those signals to shape product roadmaps and operational improvements.
- Strong technical fluency across APIs, connectors, and integrations.
- Proven track record building and leading high-performing teams, including hiring, mentoring, and developing talent.
- Excellent executive communication skills, with ability to translate production dynamics and risk into clear recommendations for senior business and technical leaders.
Pay
The salary for this role is $280,000 - $420,000 a year.