Machine Learning Engineer, Foundation Model Services

About the role

The role is focused on building and optimizing production-grade solutions for Apple's Foundation Model Services team, which powers intelligent experiences across various products. The team is responsible for running large foundation models in production, ensuring low latency and high performance. Candidates will work closely with product teams and researchers to develop cutting-edge model architectures and tools. This position offers the opportunity to impact billions of users by enhancing machine learning systems at scale.

Responsibilities

• Work closely with product teams to build production-grade solutions that launch models serving customers in real time.
• Partner with foundation model researchers to prototype and develop inference for cutting-edge model architectures.
• Build tools that help understand and remove performance bottlenecks across different hardware and use cases.
• Write high-quality code and learn quickly in a fast-moving field.
• Grow your impact by taking on larger pieces of the system.

Requirements

• 2+ years of industry experience building and shipping production software and/or machine learning systems.
• Proficiency in a modern programming language such as Go or Python.
• Experience deploying and operating services on a cloud platform using containers and Kubernetes/Docker.
• 5+ years of industry experience in ML technologies including LLMs, Machine Learning, NLP, Information Retrieval, and Statistics.
• Bachelor's degree or higher in Computer Science or a related technical field.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, and Nvidia Triton Server.

Benefits

• Flexible medical plans, confidential counseling, onsite wellness centers at major campuses, and resources for fitness and daily life.
• Fertility support, paid parental leave with gradual return, caregiving leave, and dependent-care guidance.
• Stock grants (with purchase discounts), 401(k) matching, and income-protection coverage.
• Robust time off, Apple University learning and tuition reimbursement.
• Donation matching and paid volunteer hours.
• Deep product and partner discounts.