Kernel Engineer (Internship and Full-time)
Tilde Research · Palo Alto, CA · 4 wk ago
EngineeringFull-time
About the role
Tilde Research is a moonshot AI lab advancing mechanistic interpretability, new architectures, and pretraining science. We build foundational understanding of models to advance the frontier of intelligence.
Responsibilities
- Design, develop, and tune custom GPU kernels for core model operations
- Work with ML engineers to prototype and scale novel model architectures
- Contribute to system-wide efforts to improve efficiency and throughput, beyond just kernel-level optimizations
Requirements
- Experience in deep learning or related research areas
- Demonstrated exceptional capability in working on ML kernels, including strong open source contributions, thoughtful technical blog posts/work logs, previous experience working on hardware-aligned algorithms, and deep familiarity with PyTorch, Triton/TK/TileLang (>1 of), basic familiarity with CUDA, and knowledge of GPU architecture
- Communicate clearly and effectively, both verbally and in writing
- Strong algorithmic thinker
- Ability to learn quickly