Jobs · Engineering · New York

Staff Software Engineer (AI) New York, NY

Pendo.io Japan · New York, NY · 2 days ago
Engineering$245k–$275k/yrFull-time

About the role

The Team + The Role Our Emerging Team is focused on building AI Products for our product experience (PX) platform. We build from the ground up to explore, prototype, and ship AI-native experiences that change how software teams understand and serve their users. This is not an AI layer added to existing product; it is a deliberate bet on what product intelligence looks like next. The team operates with high autonomy, moves quickly, and builds products without clear precedents. As a Staff Software Engineer (AI), you will sit at the intersection of deep technical capability and strong product judgment. You will design and build production-grade AI systems, including RAG pipelines, agentic workflows, and LLM-powered features, while making clear tradeoffs across prompting, fine-tuning, architecture, evaluation, and deployment. You will also partner closely with product, design, and engineering stakeholders to frame the right problems and communicate technical decisions clearly.

Responsibilities

  • Design and build AI-native systems, including RAG pipelines, agentic workflows, and LLM-powered product features.
  • Make principled decisions about when to prompt, when to fine-tune, and when to use a different technical approach entirely.
  • Instrument and evaluate model outputs rigorously by defining evaluation frameworks and identifying hallucinations early.
  • Implement guardrails that hold up under real-world usage and load.
  • Own model deployment, monitoring, latency optimization, cost management, and reliability at scale.
  • Contribute across the stack when needed to get complete AI products in front of users.
  • Partner closely with product and design to frame problems well before implementation begins.
  • Stay current on the research and tooling landscape, including transformers, diffusion architectures, orchestration frameworks, and emerging agent patterns.

Requirements

  • Deep hands-on experience building and shipping LLM-powered systems, including retrieval-augmented generation, tool use, and agent orchestration frameworks.
  • Demonstrated ability to set technical direction for AI systems across teams, establish architectural patterns, make foundational model strategy decisions, and raise the bar for AI engineering quality.
  • Experience owning outcomes across team boundaries, including identifying capability gaps, driving alignment across engineering and product, and influencing how a broader organization approaches AI.
  • Solid understanding of modern model architectures, including transformers and diffusion models, with the ability to make informed decisions about when and how to apply them.
  • Production experience, including model deployment, monitoring pipelines, and latency, cost, and reliability optimization in live environments.
  • Strong full-stack fundamentals and comfort working across backend and frontend systems to ship complete, user-facing AI products.
  • Exceptional communication skills, with the ability to explain complex technical decisions clearly to engineers, product managers, and executives.
  • Demonstrated product judgment and the ability to evaluate whether something should be built before determining how to build it.

Qualifications

  • Must have a bachelor’s degree in Computer Science, Engineering, Mathematics, Physics, or related field.
  • Must have 8+ years of relevant work experience.
  • Must have a proven track record of delivering impactful AI systems.
  • Must have a strong understanding of machine learning principles and techniques.
  • Must have experience with large-scale distributed systems and cloud platforms.
  • Must have experience with model evaluation and guardrails.
  • Must have experience with full-stack development.
  • Must have experience with model deployment and monitoring.
  • Must have experience with cost management and reliability optimization.
  • Must have experience with model fine-tuning.
  • Must have experience with model architecture.
  • Must have experience with model evaluation.
  • Must have experience with model deployment.
  • Must have experience with model monitoring.
  • Must have experience with model optimization.
  • Must have experience with model performance.
  • Must have experience with model reliability.
  • Must have experience with model training.
  • Must have experience with model validation.
  • Must have experience with model verification.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with model wrangling.
  • Must have experience with

Similar jobs