Jobs · Information Technology · California

Staff Machine Learning Engineer - AI Foundation

XPENG Jordan · Santa Clara, CA · 2 wk ago
Information TechnologyFull-time

About the role

We are looking for a full-time Machine Learning Engineer - AI Foundation with deep knowledge and strong enthusiasm towards establishing state-of-the-art ML infrastructure for training very large foundation models and accelerating model training/inference. Our mission is to solve the autonomous driving problem. You will work with a team of talented software engineers, machine learning engineers, and research scientists to push the boundary of state-of-the-art machine learning models, enabling the next-generation end-to-end solution for autonomous driving.

Responsibilities

  • Optimize transformer-based LLMs for low-latency and high-throughput inference.
  • Optimize kernels and model graphs using tools like CUDA, Triton, and custom fused operators.
  • Implement and benchmark techniques such as Quantization, Knowledge distillation, structured and unstructured pruning, and KV-cache optimization.
  • Deploy optimized models across GPUs, CPUs, and edge accelerators.
  • Contribute to internal tooling and documentation for model optimization flows.

Requirements

  • Master’s in CS/CE/EE or equivalent, with 5-8 years of industry experience.
  • Good knowledge of PyTorch.
  • Knowledge of transformer architecture and ways to accelerate the training and inference of transformer models.

Preferred Qualifications

  • Previous experience in the autonomous driving industry.
  • Knowledge of Torchscript and Nvidia TensorRT.
  • Strong programming skills in Python and C++.
  • Familiarity with GPU, CPU, NPU, and DSP architecture.
  • Deep understanding of memory bandwidth, compute bottlenecks, and hardware-aware model optimization.
  • Ability to efficiently solve complex problems collaboratively on larger teams.

Benefits

  • A fun, supportive, and engaging environment.
  • Infrastructures and computational resources to support your work.
  • Opportunity to work on cutting-edge technologies with top talents in the field.
  • Opportunity to make a significant impact on the transportation revolution by advancing autonomous driving.
  • Competitive compensation package.
  • Snacks, lunches, dinners, and fun activities.

Pay

The base salary range for this full-time position is $215,280 - $364,320, in addition to bonus, equity, and benefits. Our salary ranges are determined by role, level, and location. The range displayed reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.

Similar jobs