Sr. Software Engineer (AI) New York, NY

About the role

The Team + The Role Our Emerging Team is focused on building AI Products for our product experience (PX) platform. We build from the ground up to explore, prototype, and ship AI-native experiences that change how software teams understand and serve their users. This is not an AI layer added to existing product; it is a deliberate bet on what product intelligence looks like next. The team operates with high autonomy, moves quickly, and builds products without clear precedents. As a Sr. Software Engineer (AI), you will sit at the intersection of deep technical capability and strong product judgment. You will design and ship applied AI systems, including RAG pipelines, agentic workflows, and LLM-powered features, from prototype through production. You will make principled technical decisions, evaluate model behavior rigorously, and communicate tradeoffs clearly to engineers and non-engineers alike. This role is based in our New York office.

Responsibilities

• Design and build AI systems including RAG pipelines, agentic workflows, and LLM-powered features. You will take work from prototype through production and ensure it can hold up in real customer environments.
• Make principled decisions on when to prompt, when to fine-tune, and when to use a different tool entirely. You will explain these tradeoffs clearly so the team can move quickly without sacrificing quality.
• Instrument and evaluate model outputs rigorously by defining evaluation frameworks and catching hallucinations early. You will implement guardrails that can withstand real-world load and production use.
• Own model deployment, monitoring, latency optimization, cost management, and reliability at scale. You will help ensure AI systems are observable, efficient, and dependable in production.
• Contribute across the stack when needed because this team ships products, not just models. You will work across backend and frontend to get AI-powered experiences in front of users.
• Partner closely with product and design to frame problems well before writing code. You will push back when the framing is wrong and help the team focus on what should be built, not just what can be built.
• Stay current on the research and tooling landscape, including transformers, diffusion architectures, orchestration frameworks, and emerging agent patterns. You will bring relevant advances back to the team and apply them thoughtfully.

Requirements

• Deep hands-on experience building and shipping LLM-powered systems, including retrieval-augmented generation, tool use, and agent orchestration frameworks.
• Strong technical depth in system design, including choosing the right architecture, identifying failure modes early, and making tradeoffs that hold up across the product lifecycle.
• Experience owning technical quality beyond your own features, including setting standards, catching problems in review, and improving shared infrastructure and tooling.
• Strong command of model evaluation, including designing evaluation suites, reasoning about overfitting and bias-variance tradeoffs, and systematically detecting and mitigating hallucinations.
• Solid understanding of modern model architectures, including transformers and diffusion models, with the judgment to decide when and how to apply them.
• Production experience in deploying AI experience, including model deployment, monitoring pipelines, and latency, cost, and reliability optimization in a live environment.
• Strong full-stack fundamentals with the ability to work across backend and frontend systems to ship complete, user-facing AI products.
• Exceptional communication skills with the ability to explain complex technical decisions clearly to engineers, product managers, and executives.
• Demonstrated product thinking, including the ability to ask whether something should be built before deciding how to build it.

Qualifications

• Must have deep hands-on experience building and shipping LLM-powered systems, including retrieval-augmented generation, tool use, and agent orchestration frameworks.
• Must have strong technical depth in system design, including choosing the right architecture, identifying failure modes early, and making tradeoffs that hold up across the product lifecycle.
• Must have experience owning technical quality beyond your own features, including setting standards, catching problems in review, and improving shared infrastructure and tooling.
• Must have strong command of model evaluation, including designing evaluation suites, reasoning about overfitting and bias-variance tradeoffs, and systematically detecting and mitigating hallucinations.
• Must have solid understanding of modern model architectures, including transformers and diffusion models, with the judgment to decide when and how to apply them.
• Must have production experience in deploying AI experience, including model deployment, monitoring pipelines, and latency, cost, and reliability optimization in a live environment.
• Must have strong full-stack fundamentals with the ability to work across backend and frontend systems to ship complete, user-facing AI products.
• Must have exceptional communication skills with the ability to explain complex technical decisions clearly to engineers, product managers, and executives.
• Must have demonstrated product thinking, including the ability to ask whether something should be built before deciding how to build it.

Skills

• Experience fine-tuning foundation models and a clear point of view on when fine-tuning outperforms prompting approaches.
• Familiarity with AI safety considerations, guardrail frameworks, and responsible deployment practices.
• Experience building agentic or multi-step reasoning systems using tools such as LangChain, LlamaIndex, or custom orchestration frameworks.
• Background in a SaaS or product analytics environment where user behavior data informs AI design.
• Prior experience contributing to or launching a net-new team or product area.

Benefits

Highly competitive, employer-heavy coverage, including $0 premium options, strong 401(k) match, equity, and flexible time off.

Pay

The expected salary range for this role to be performed in New York, NY is $209,000 - $235,000.

Schedule

Pendo is a hybrid culture. In-office 3 days per week unless designated remote.