AI Engineer, ML Inference Optimization, Tesla AI
Tesla · Palo Alto, CA · 1 mo ago
On-siteEngineering$176k–$420k/yrFull-time
What You'll Do
- Design, train, and deploy large neural networks that run efficiently on heterogeneous hardware (GPU, CPU, Tesla’s in-house AI ASIC)
- Develop and integrate quantization, sparsity, pruning, and distillation techniques to improve inference performance
- Design inference algorithms that improve inference performance in terms of quantization and latency
- Profile and improve latency, throughput, and memory efficiency for large ML models across edge and cloud environments
- Collaborate with compiler and hardware engineers to co-design architectures for efficient real-time inference
- Design and implement custom GPU kernels (CUDA / OpenCL) to accelerate model operations and post-processing pipelines
- Conduct systematic benchmarking, scaling, and validation of inference performance across Tesla platforms
What You'll Bring
- Proven experience in scaling and optimizing inference for large ML models, particularly transformers or similar architectures
- Familiarity with quantization-aware training, model compression, and distillation for edge and real-time inference
- Proficiency with Python and C++ (modern standards 14/17/20) and deep learning frameworks such as PyTorch, TensorFlow, or JAX
- Strong understanding of computer systems and architecture, with experience deploying ML models on GPUs, TPUs, or NPUs
- Hands-on expertise with CUDA programming, low-level performance profiling, and compiler-level optimization (TensorRT, TVM, XLA)
- Experience collaborating with compiler/hardware engineers to bridge model and system-level optimization
- Excellent problem-solving skills and the ability to debug and tune high-performance inference workloads
Benefits
- Competitive pay
- Medical plans
- Family-building, fertility, adoption and surrogacy benefits
- Dental (including orthodontic coverage) and vision plans
- Company Paid (Health Savings Accounts) HSA Contribution
- Flexible Spending Accounts (FSA)
- 401(k) with employer match
- Employee Stock Purchase Plans
- Other financial benefits
- Basic Life, AD&D Short-term and long-term disability insurance
- Employee Assistance Program
- Sick and Vacation time
- Paid Holidays
- Commuter benefits
- Employee discounts and perks program