Senior Manager, Technology Consulting

About the role

Drive the performance and optimization of both training and serving for AI, delivering massive impact for customers. Build a center of excellence and scale this practice with exposure to the newest Tensor Processing Unit (TPU) and Graphics Processing Unit (GPU) hardware, the latest ML models, and advanced toolchains. Your work will directly enable AI research and production deployments across Google Cloud and the broader open-source ecosystem, addressing complex technical issues that impact the efficiency and scalability of AI industry-wide.

Responsibilities

• Design and optimize high-performance kernels (using languages like Pallas, Mosaic, and Triton) targeting Tensor Processing Unit (TPU) and Graphics Processing Unit (GPU) architectures for critical Machine Learning (ML) operations, from massive training runs to high-speed inference.
• Architect infrastructure such as benchmarking suites, autotuning frameworks, performance analysis tools, regression testing, and documentation to transform how the developer community interacts with custom kernels in key Open-Source Software (OSS) libraries.
• Track the latest advancements in hardware architectures, compiler technologies, and AI models to identify new opportunities for performance optimization through custom kernels.
• Engage with ML researchers, framework developers (JAX, PyTorch), and compiler engineers (XLA) to enhance adoption, identify new requirements, and address bottlenecks by providing appropriate solutions.

Requirements

• Bachelor's degree or equivalent practical experience.
• Overall 12+ years of industry experience; 5 years of experience with software development in C++ or Python.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• Experience with performance optimization at the kernel level.
• Experience optimizing TPU/GPU code, using low-level kernel languages like Pallas, CUDA, or Triton.
• Knowledge of ML Frameworks (JAX/PyTorch), common operations like attention and Mixture of Experts (MoEs), including model optimization and low-precision formats.
• Understanding of modern accelerators (e.g., data movement, pipelining, heterogeneous compute, and scale-out).
• Understanding of compiler principles (optimization, code generation) and toolchains such as MLIR, OpenXLA.
• Demonstrated record of building developer infrastructure, including Open-Source Software (OSS) libraries, flexible high-performance APIs, and easy-to-consume documentation to empower the community.
• Excellent investigative and problem-solving capabilities with communication skills across cross-functional teams.

Benefits

• Medical, Dental, and Vision Insurance (Subsidized).
• Health Savings Account.
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter).
• Short-Term and Long-Term Disability (Company Provided).
• Life and AD&D Insurance (Company Provided).
• Employee Assistance Program.
• Unlimited access to LinkedIn learning solutions.
• Matched 401(k) Retirement Savings Plan.
• Paid Time Off – 15-25 paid days, depending on level and tenure.
• Paid Holidays – nine (9) total per year.
• Legal Plan and Identity Theft Protection.
• Accident Insurance.
• Employee Discounts.
• Pet Insurance.
• Employee Stock Purchase Program.
• Discretionary annual bonus program (if eligible).
• Discretionary Long-Term Incentive (LTI) Program (if eligible and hired into a qualifying level).

Pay

Salary range: $180,000 - $220,000. Individual compensation offers are based on geographic location, experience, credentials, education, training, demand for the role, and overall business and labor market considerations.

Schedule

This is a remote position that cannot be performed in New York City.