Internship, Software Engineer, AI Infrastructure (Fall 2026)
Tesla · Palo Alto, CA · 2 days ago
On-siteInformation Technology$100k–$150k/yrInternship
What You'll Do
- Optimize large-scale distributed training across thousands of GPUs
- Improve training throughput, utilization, reliability, and scalability
- Develop tooling to identify bottlenecks in compute, networking, memory, and data pipelines
- Design and implement performance optimizations across PyTorch, CUDA, communication libraries, and training frameworks
- Partner with researchers to evaluate how infrastructure changes impact model quality, convergence, and downstream metrics
- Analyze training runs and build dashboards that connect system performance to model outcomes
- Drive improvements in model scaling efficiency, including larger models, longer context lengths, and higher-quality datasets
- Debug complex issues across software, hardware, networking, and machine learning systems
- Build infrastructure that accelerates experimentation and shortens iteration cycles for researchers
What You'll Bring
- Strong software engineering fundamentals in Python and C++
- Experience with distributed systems, high-performance computing, or large-scale infrastructure
- Understanding of machine learning fundamentals, including optimization, training dynamics, and evaluation
- Familiarity with PyTorch and modern deep learning frameworks
- Ability to analyze performance bottlenecks using profiling and observability tools
- Strong debugging and problem-solving skills
- Excellent communication and collaboration skills
- Pursuing a degree in Computer Science or relevant field of study with a graduation date between December 2026 - December 2027
Benefits
- Medical plans
- Family-building, fertility, adoption and surrogacy benefits
- Dental (including orthodontic coverage) and vision plans
- Company Paid (Health Savings Account) HSA Contribution
- Flexible Spending Accounts (FSA)
- 401(k), Employee Stock Purchase Plans, and other financial benefits
- Basic Life, AD&D, and short-term disability insurance
- Employee Assistance Program
- Sick and Vacation time (Flex time for salary positions), and Paid Holidays
- Back-up childcare and parenting support resources
- Voluntary benefits to include: critical illness, hospital indemnity, accident insurance, theft & legal services, and pet insurance
- Commuter benefits
- Employee discounts and perks program
Pay
Expected Compensation: $100,000 - $150,000/annual salary + benefits