Jobs · Engineering · California

AI Engineer, ML Inference Optimization, Tesla AI

Tesla · Palo Alto, CA · 1 mo ago
On-siteEngineering$176k–$420k/yrFull-time

What You'll Do

  • Design, train, and deploy large neural networks that run efficiently on heterogeneous hardware (GPU, CPU, Tesla’s in-house AI ASIC)
  • Develop and integrate quantization, sparsity, pruning, and distillation techniques to improve inference performance
  • Design inference algorithms that improve inference performance in terms of quantization and latency
  • Profile and improve latency, throughput, and memory efficiency for large ML models across edge and cloud environments
  • Collaborate with compiler and hardware engineers to co-design architectures for efficient real-time inference
  • Design and implement custom GPU kernels (CUDA / OpenCL) to accelerate model operations and post-processing pipelines
  • Conduct systematic benchmarking, scaling, and validation of inference performance across Tesla platforms

What You'll Bring

  • Proven experience in scaling and optimizing inference for large ML models, particularly transformers or similar architectures
  • Familiarity with quantization-aware training, model compression, and distillation for edge and real-time inference
  • Proficiency with Python and C++ (modern standards 14/17/20) and deep learning frameworks such as PyTorch, TensorFlow, or JAX
  • Strong understanding of computer systems and architecture, with experience deploying ML models on GPUs, TPUs, or NPUs
  • Hands-on expertise with CUDA programming, low-level performance profiling, and compiler-level optimization (TensorRT, TVM, XLA)
  • Experience collaborating with compiler/hardware engineers to bridge model and system-level optimization
  • Excellent problem-solving skills and the ability to debug and tune high-performance inference workloads

Benefits

  • Competitive pay
  • Medical plans
  • Family-building, fertility, adoption and surrogacy benefits
  • Dental (including orthodontic coverage) and vision plans
  • Company Paid (Health Savings Accounts) HSA Contribution
  • Flexible Spending Accounts (FSA)
  • 401(k) with employer match
  • Employee Stock Purchase Plans
  • Other financial benefits
  • Basic Life, AD&D Short-term and long-term disability insurance
  • Employee Assistance Program
  • Sick and Vacation time
  • Paid Holidays
  • Commuter benefits
  • Employee discounts and perks program

Similar jobs