AI Computing Research Intern

About the role

You're not here to write papers nobody reads. You're here to find the cost/performance frontier and ship past it.

Every dollar and millisecond you save compounds across an entire fleet of AI employees. Our best interns take a benchmark on Monday and land a production cost win by Friday — and write the changelog entry themselves. This is research with a deploy button.

Responsibilities

• Research and ship the systems that make running thousands of AI agents dramatically cheaper, faster, and more reliable
• Optimize local / self-hosted model inference — quantization, batching, speculative decoding, KV-cache strategy, tensor & pipeline parallelism
• Build model routing that sends every request to the cheapest model that can actually do the job — frontier API when it matters, local when it doesn't
• Benchmark and deploy across hardware — GPUs, edge, on-prem, alternative accelerators — and turn the numbers into real deployment decisions
• Push on agent infrastructure: orchestration, caching, context management, and parallelization for fleets of concurrent agents
• Prototype recursive self-improvement loops — agents that improve their own tooling, prompts, and evals
• Own a research question end-to-end — frame it, run the experiments, ship the result into production

Requirements

• High agency
• Strong systems + ML engineering — comfortable in Python and PyTorch, can profile, optimize, and ship without hand-holding
• Real understanding of how transformers actually run — attention, KV cache, memory bandwidth, throughput vs. latency tradeoffs
• Built and shipped something real — side project, OSS, hackathon win, research artifact, prior internship
• Comfortable with LLMs both as tooling and as objects of study — API calls, prompts, tool use, and what's happening under the hood
• Moves fast, takes feedback, pushes back when they're right

Nice-to-Haves

• Hands-on with inference engines (vLLM, TensorRT-LLM, SGLang, llama.cpp)
• GPU kernel or low-level perf work (CUDA, Triton)
• Hardware benchmarking or deployment experience (cloud GPUs, on-prem, edge, alt accelerators)
• Built with agent frameworks
• Published, open-sourced, or blogged research/tooling
• Currently enrolled in a CS / EE / math program — or dropped out of one to build