Research Scientist / Engineer – Performance Optimization

Responsibilities

• Profile and optimize GPU/CPU/Accelerator code for maximum utilization and minimal latency
• Write high-performance PyTorch, Triton, CUDA, deferring to custom PyTorch operations if necessary
• Develop fused kernels and leverage tensor cores and modern hardware features for optimal hardware utilization on different hardware platforms
• Optimize model architectures and implementations for distributed multi-node production deployment
• Build performance monitoring and analysis tools and automation
• Research and implement cutting-edge optimization techniques for transformer model

Requirements

• Expert-level proficiency in Triton/CUDA programming and GPU optimization
• Strong PyTorch skills
• Proficiency with profiling tools (NVIDIA Nsight, torch profiler, custom tooling)
• Deep understanding of transformer architectures and attention mechanisms
• (Preferred) Experience with compilers/exporters such as torch.compile, TensorRT, ONNX, XLA
• (Preferred) Experience optimizing inference workloads for latency and throughput
• (Preferred) Experience with Triton compiler and kernel fusion techniques
• (Preferred) Knowledge of warp-level intrinsics and advanced CUDA optimization