Senior Technical Program Manager, Machine Learning Infrastructure

About Us

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products designed to solve real-world business problems. We’re training and deploying frontier models for enterprises building AI systems. We believe our work is instrumental to the widespread adoption of AI and are looking for folks who want to be part of that.

We obsess over what we build. Each team member contributes to increasing the capabilities of our models and the value they drive for customers. Cohere is a global team of researchers, engineers, designers, and more, passionate about their craft. We are co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany, and Paris.

About the Role

As Cohere continues to grow, the size and complexity of our programs have increased. We are looking for exceptional Technical Program Managers (TPMs) to help manage this growth. At Cohere, TPMs are pivotal to our success, acting as operational experts specializing in cross-functional efforts. Great TPMs at Cohere execute with precision at the tactical level while partnering with senior leaders to shape strategy. The opportunities for scaling impact are endless.

TPMs at Cohere are described by stakeholders as organized, execution-oriented, pragmatic, and adaptable. You will work alongside some of the most talented engineers in the world on cutting-edge AI technology. No two days will be the same—this dynamic, high-growth environment is perfect for those excited about solving novel problems, bringing structure to fast-paced environments, and scaling their impact alongside the company.

While we are remote-first and accept candidates globally, we strongly prioritize hiring for the Eastern Time (ET) timezone.

Responsibilities

• Manage the program portfolio covering inference, efficiency, serving, and endpoints to ensure Cohere’s infrastructure scales for a rapidly expanding user base of internal and external users.
• Lead end-to-end coordination and execution across programs, with a focus on cross-functional collaboration with Modeling and customer-facing teams.
• Identify pain points and establish processes to ensure teams can focus on development while meeting the needs of internal and external model users and improving engineering best practices.
• Build a strong culture around continuous improvement, such as liaising with incident management leads, ensuring problems are accurately root-caused, and fixes are provided in a timely manner.
• Manage overlapping projects and programs, ruthlessly prioritizing asks to ensure the company’s top priorities are met.
• Collaborate with stakeholders across the company to set, track, and manage timelines, deliverables, budgets, and scope for successful program execution.
• Deliver clear, timely, and consistent updates across engineering, leadership, and non-technical teams on progress, plans, and incidents.
• Act as a tactical and strategic partner to senior leads, providing support at both the operational and high-level strategic problem-solving levels.

Requirements

• 5+ years of Technical Program Management experience focusing on Machine Learning Infrastructure, specifically in areas such as model inference, serving, efficiency, and endpoints design & implementation.
• In-depth technical knowledge of ML infrastructure design and implementation, as well as engineering best practices, to balance velocity and structure in rapidly growing organizations.
• Experience working in chaotic, fast-paced, low-structure environments. You must be pragmatic, willing to roll up your sleeves, and capable of operating at both tactical and strategic levels to drive Cohere’s models to success.
• (Optional but strongly preferred) Hands-on technical experience. While not required, you should be able to dive deep into internal systems and develop a reputation as a subject-matter expert who brings engineering best practices and the right amount of structure to continuously improve programs.
• (Optional but preferred) Experience working with ML teams and a working understanding of how machine learning models are built to advocate for both infrastructure and modeling teams in building scalable, high-performance ML infrastructure.

If some requirements don’t perfectly align with your experience, we still encourage you to apply! We value thoughtful workers, lifelong learners, and kind, playful team members.

Benefits

• A weekly lunch stipend of $75/£75 or equivalent in your local currency.
• Full health and dental benefits, including a separate budget for mental health.
• RRSP matching, 401K, or Pension Scheme contributions.
• 100% parental leave top-up for up to 6 months for either parent.
• Annual enrichment benefits for arts & culture, fitness/wellness, quality time, and workspace improvements.
• Education & learning stipend for conferences, courses, and coaching.
• 6 weeks of paid vacation (30 working days).
• Budget for traveling to other offices if remote, plus an annual company offsite.

Schedule & Location

Cohere is remote-first. We have offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more coming soon.

• For those in the office: daily lunch programs, snacks, and regular community and social events.
• For those not near an office: a co-working benefit to work alongside others in your city.
• Everyone receives a $500 home office stipend to set up your workspace properly.