Staff Product Engineer (Hybrid)

About the role

Fiddler is an AI observability company focused on enabling organizations to deploy trustworthy and transparent AI solutions. Our mission is to build trust into AI by providing tools and services that help organizations understand, monitor, and improve their AI applications.

Responsibilities

• Design and build core services and components of a world-class cloud platform to help enterprises develop, monitor and improve their full suite of AI based applications (covering predictive models, LLMs, GenAI models and agentic applications)
• Lead the design and implementation of distributed systems, microservices and applications that compute, persist, and expose new ML + agentic observability metrics (e.g., response relevancy, hallucination scores) from raw trace data
• Spearhead the development of new types of metrics and evaluation capabilities to satisfy evolving customer needs around agentic applications
• Take part in conversations with customers around discovery and support
• Develop in-house AI Agents and GenAI capabilities to augment the Fiddler observability products
• Define and evolve the operational maturity (reliability, observability, SLOs, observability) of core services and components, establish best practices and champion improvements across the team
• Team & Culture Building: take an active role in building a world-class engineering team and actively participate in the talent acquisition process through interviewing, candidate evaluation and coaching

Requirements

• Masters or Bachelors degree in Computer Science or related field, combined with 7+ years of industry experience, with demonstrated solid foundation in software development
• Deep proficiency with Python
• Prior experience building and operating highly complex SaaS platforms and systems
• Work closely with product, design, and customer engineering teams to improve and expand our product offerings

Qualifications

• Practical working knowledge of machine learning and data science
• Familiarity with frameworks like Langchain, LangGraph, Google ADK, Amazon Strands, OpenAI, etc.
• Experience building and integrating MCP Servers
• Hands-on experience designing, implementing, or operating AI/ML observability or evaluation systems

Skills

• Strong problem-solving skills
• Excellent communication and collaboration abilities
• Ability to work independently and as part of a team

Benefits

• Unlimited PTO
• Competitive pay + equity
• Premium health, dental & vision – for you, 100% premiums covered with buy-up options
• 401(k) plan
• Monthly fitness reimbursement
• Paid parental leave
• Fasttrak reimbursement
• Free lunch Mon–Thurs
• Monthly in-office massages
• Free annual Caltrain pass
• Vibes at our Palo Alto HQ