Principal Product Manager - Foundry Inferencing & Training (CoreAI - multiple roles)
PMs for Hire · New York, NY · 3 wk ago
Marketing$140k–$275k/yrFull-time
Overview
Microsoft Foundry sits at the center of Microsoft’s AI strategy, powering how models are trained, evaluated, launched, and operated at global scale. Within CoreAI, the AI Models & Training organization is responsible for the platforms, infrastructure, and execution systems that turn cutting-edge research into reliable, production-ready AI capabilities.
Responsibilities
- Product Strategy & Ownership
- Own product strategy and roadmap across AI model training, inference, experimentation, and platform enablement, balancing near-term delivery with long-term scale
- Maintain end-to-end accountability from concept through launch, iteration, and measurable impact
- Model Lifecycle & Platform Enablement
- Drive initiatives across the AI model lifecycle, partnering with engineering and research to bring new capabilities from research into production
- Enable internal teams and customers to access, integrate, and adopt models through high-quality platform experiences
- Execution, Velocity & Operating Rigor
- Lead complex, multi-quarter initiatives with high visibility, managing dependencies, risks, and tradeoffs across teams
- Improve execution velocity by reducing friction in planning, experimentation, launches, and iteration cycles
- Experimentation, Metrics & Continuous Improvement
- Define and track metrics for efficiency, performance, reliability, and adoption, using experimentation and data to drive decisions
- Identify opportunities for automation, simplification, and continuous improvement as systems scale
- Cross-Functional Leadership & Communication
- Act as a connective leader across engineering, data science, research, infrastructure, and go-to-market teams
- Influence senior stakeholders through clear decision framing, executive-ready narratives, and data-backed recommendations
Qualifications
- Required Qualifications
- Bachelor’s Degree and 8+ years of experience in product management, technical program management, software engineering, or related technical fields (or equivalent experience)
- Other Requirements
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Preferred Qualifications
- Proven ability to lead product strategy and execution in highly technical, ambiguous, cross-functional environments
- Strong technical fluency and ability to partner deeply with engineering, infrastructure, or research teams
- Excellent written and verbal communication skills, including executive-level influence
- 10+ years of experience delivering large-scale platforms, cloud services, or AI-powered products
- Experience with AI/ML platforms, model training systems, inference infrastructure, or experimentation frameworks
- Familiarity with cloud infrastructure and distributed systems (e.g., GPUs, compute fleets, data pipelines)
- Track record of launching and scaling complex products with measurable business or platform impact
- Able to operate as a force multiplier in fast-paced, high-stakes environments
Pay
- Product Management IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
- Product Management IC6 - The typical base pay range for this role across the U.S. is USD $163,000 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.