Senior Developer Technology Engineer - Edge Agentic AI
Thomas To · Santa Clara, CA · 2 mo ago
EngineeringFull-time
About the role
As a Developer Technology Engineer, you will be at the forefront of innovation, working with leading industry partners and pioneering open-source projects to enable professional agentic AI workflows at the edge powered by NVIDIA's RTX and DGX platforms. This role offers an outstanding opportunity to collaborate with world-class talent and make a significant contribution to the evolving landscape of enterprise and consumer agentic AI.
What You'll Be Doing
- Work closely across internal engineering and product teams as well as external app developers and enterprise ISVs on solving local end-to-end agentic AI GPU deployment challenges on NVIDIA RTX & DGX.
- Apply powerful profiling and debugging tools for analyzing most demanding accelerated end-to-end agentic AI workflows to detect insufficient system utilization resulting in suboptimal runtime performance.
- Conduct hands-on trainings, develop sample code and host presentations to give good guidance on efficient end-to-end agentic AI deployment targeting optimal runtime performance.
- Improve LLM & GenAI user experience by working on feature and performance enhancements of OSS software, including but not limited to projects like GGML, Llama.cpp, Ollama, vLLM, ONNX Runtime.
- Collaborate with GPU driver and architecture teams as well as NVIDIA research to influence next generation GPU features by providing real-world workflows and giving feedback on partner and customer needs.
- Providing technical leadership and mentorship to junior engineers, fostering an inclusive and high-performing team environment.
Requirements
- A proven track record 5+ years of professional experience in local GPU deployment, profiling and optimization.
- A Bachelor's or Master's degree or equivalent experience in Computer Science, Engineering, or a related field.
- Strong proficiency in C/C++, Python, software design, programming techniques.
- Familiarity with and development experience on Windows and Linux.
- Experience with CUDA and NVIDIA's Nsight GPU profiling and debugging suite.
- Some travel is required for conferences and for on-site visits with external partners.
- Strong problem-solving skills and the ability to work both independently and collaboratively in a fast-paced environment.
- Excellent interpersonal and communication skills and a passion for keeping track with the latest advancements in AI technology.
Preferred qualifications
- Experience with GPU-accelerated AI inference driven by NVIDIA APIs and SDKs, specifically TensorRT-RTX, cuDNN, NVIDIA Model Optimizer.
- Expertise with professional agentic AI use cases, i.e., digital content creation and productivity workflows.
- Experience working with open-source LLM and GenAI software.
- Detailed knowledge of the latest generation GPU architectures.
- Experience with AI deployment on NPUs and ARM architectures.
Pay
The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits.