GPU Kernel Development Engineer (Fellow)

About the role

As a Fellow, you will be accountable for defining and driving the end-to-end software optimization strategy to achieve industry-leading performance for our top-tier customers. You will play a pivotal role in GPU architecture feature design, usage, API design, optimization, and deployment.

The person

We are looking for a talented and motivated GPU kernel developer with broad and deep experience in compute and machine learning software development to deliver out of the box high performance ROCm core software to our customers. A great candidate will be a strong collaborator who is open to continuous learning and is excited about innovative solutions for ML and HPC on GPUs.

Key responsibilities

• Perform external benchmarking and research to define opportunities to improve GPU kernel performance on AMD machine learning products
• Analyze and optimize the performance of GPU kernels, providing insight on optimization paths across the AI software stack
• Partner with top customers and hyperscalers to understand their unique workload requirements and deliver tailored architectural wins and software optimizations
• Collaborate across hardware architecture, compiler, and framework teams to influence future silicon features based on evolving AI workload trends
• Communicate and collaborate with key technical experts across AMD and with our partners and customers to improve ROCm applications, libraries, and tools, as well as hardware

Preferred experience

• Strong understanding of modern model architectures (Transformer, Attention, KV Cache) and optimization techniques like quantization, speculative decoding, and FlashAttention
• Excellent GPU architecture knowledge, performance analysis, algorithm development, and machine learning experience
• Proven history of optimizing GPU kernels with advanced algorithms and across entire AI software stack
• Demonstrated ability to drive cross-functional initiatives in fast-paced, ambiguous environments

Preferred academic credentials

• Bachelor's or Master's or PhD degree in Computer Science, Computer Engineering, or equivalent

Location

Austin, Texas