Jobs · Engineering · California

AI Engineer

Haystack · San Diego, CA · 5 days ago
HybridEngineeringFull-time

About the role

The Role Lead will be responsible for leading the accuracy-centric architecture and optimization of large language models (LLMs), vector language models (VLMs), and multimodal artificial intelligence (AI) models. They will drive day-zero hardware enablement on both current and future AI platforms, design and implement quantization strategies to balance model quality, performance, and hardware, analyze and resolve accuracy regressions and numerical stability issues across the inference stack, and collaborate with performance engineers to co-optimize kernels and execution strategies. Additionally, they will define and implement accuracy evaluation metrics and tooling for robust model deployment.

Responsibilities

  • Lead accuracy-centric architecture and optimization of LLMs, VLMs, and multimodal AI models
  • Drive day0 hardware enablement on current and future AI platforms
  • Design and implement quantization strategies to balance model quality, performance, and hardware
  • Analyze and resolve accuracy regressions and numerical stability issues across the inference stack
  • Collaborate with performance engineers to co-optimize kernels and execution strategies
  • Define and implement accuracy evaluation metrics and tooling for robust model deployment

Requirements

  • Extensive experience with LLMs and/or VLMs in production or pre-production environments
  • Expert-level understanding of quantization, numerics, and precision tradeoffs
  • Deep knowledge of transformer architectures, attention mechanisms, and MoEs
  • Proven ability to balance accuracy, performance, and hardware constraints
  • Strong Python skills and experience across compiler, kernel, and hardware abstraction layers

Qualifications

  • Bachelor's degree with 4+ years of experience, or
  • Master's degree with 3+ years of experience, or
  • PhD with 2+ years of experience in a related field

Skills

  • Expertise in LLMs and/or VLMs
  • Quantization and precision tradeoff expertise
  • Transformer architectures and attention mechanisms
  • Kernel and execution strategy optimization
  • Accuracy evaluation metrics and tooling development

Benefits

  • Opportunity to work at the forefront of Cloud AI and foundation model inference
  • A senior technical role with broad cross-functional impact
  • Competitive annual discretionary bonus
  • Opportunity for annual RSU grants
  • Comprehensive benefits package designed to support work-life balance

Pay

Competitive salary commensurate with experience

Schedule

Full-time, remote position

Similar jobs

Software Engineer

BAE Systems, Inc.Fort George G. Meade, MD· 1 wk ago
Engineering$133k–$226k/yrapply on jobs.baesystems.com

Software Engineer

EpicRound Rock, TX· 4 days ago
Information Technologyapply on epic.avature.net

Software Engineer

EpicGarland, TX· 4 days ago
Information Technologyapply on epic.avature.net