On-device ML Engineering Manager (Tools & Services)

About the role

The On-Device Machine Learning team at Apple is seeking an Engineering Manager to lead the Performance Tools and Services team. This role focuses on developing tools and infrastructure that enhance the performance of on-device machine learning models. The manager will oversee a diverse team responsible for both frontend and backend services, ensuring that ML developers receive actionable insights into model execution. The position requires a strong technical understanding of ML execution, performance analysis, and the systems that connect low-level signals to high-level operations.

Requirements

• BS/MS/PhD in Computer Science or Electrical Engineering
• Two or more years of strong and validated management experience
• Knowledge of ML development and workflows, including experience with at least one authoring framework such as PyTorch
• Experience delivering web services and/or developer-facing tools, spanning frontend and backend
• Excellent communication skills
• Solid programming skills in at least one of the following languages: Python, Swift, Objective-C, C/C++
• Experience with on-device ML frameworks such as Core ML, Win ML, ONNX, TF Lite or ExecuTorch
• Experience with performance profiling, benchmarking, and analysis tooling
• Experience building and operating infrastructure for running workloads across fleets of devices
• Experience associating low-level performance data with framework-level operations
• Experience with MLIR / LLVM compiler technologies

Responsibilities

• Lead the Performance Tools and Services team in developing tools and infrastructure for on-device ML performance
• Oversee the frontend web services for introspecting ML models and their execution
• Manage the backend web services that support the frontend tools
• Ensure the on-device toolchain gathers low-level performance data and associates it with high-level operations
• Develop the first end-to-end developer experience for ML development at Apple
• Collaborate with leaders across the organization to enhance the platform
• Support internal and external clients with high-quality developer tools and capabilities