Staff Software Development Engineer: GPU, Computer Vision, AI/ML Ops
About the role
At AMD, we are seeking an influential software engineer passionate about enhancing the performance of key applications and benchmarks. This role involves working closely with a team of industry specialists to develop and optimize the AI software stack, accelerating the development and performance of foundational models and autonomous AI agents.
Responsibilities
Architect and drive the AI Software Stack: Establishing best practices and optimizing performance from GPU kernels to large-scale distributed systems, shaping the foundational software for AMD hardware.
Accelerate Foundational Models: Directly accelerating cutting-edge applications like foundation models (LLMs) and autonomous AI agents, ensuring AMD is the platform of choice for demanding workloads.
Innovate Across Hardware and Software: Contributing to the entire co-design lifecycle, from influencing future GPU architectures to developing groundbreaking software for new accelerators and collaborating with the broader AI community.
Requirements
Exceptional technical expertise in software engineering, with a deep passion for high-performance C++ software engineering and low-level GPU programming.
A robust understanding of Large Language Models (LLMs) and AI systems, including transformer architectures, attention mechanisms, and the full model lifecycle.
Experience in code generation and/or self-improving LLMs is a plus.
Qualifications
Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.
Extensive hands-on experience in GPU programming (HIP/CUDA) and optimizing deep learning kernels and operators.
Deep knowledge of transformer architectures, attention mechanisms, and modern AI systems (Generative AI, Agentic AI).
Experience optimizing the post-training and inference pipelines of Large Language Models (LLMs).
Skills
Strong technical ownership, communication, and problem-solving skills with a track record of delivering complex technical solutions.
Benefits
The benefits offered include:
- Comprehensive health insurance
- Retirement savings plan
- Flexible work arrangements
- Professional development opportunities