Staff AI Scientist

Job Description

Lead applied research and development for the models and datasets at the core of Fiddler's Trust Service and suite of guardrail classifiers and evaluators. The role involves:

• Partnering with engineering, Product, and Customer Success teams to ensure customers realize measurable value.
• Designing, training, and shipping production classifiers for safety, security, and quality detection (e.g., prompt injection, jailbreaks, PII, hallucination).
• Leading the development of synthetic and adversarial dataset pipelines.
• Driving the technical direction of generative insights (LLM- and agent-powered analysis).
• Collaborating with Backend and Platform engineers to deploy research prototypes to scaled services.
• Mentoring AI Scientists and representing Fiddler externally through publications or talks.

Requirements

• 7+ years of applied AI experience with a strong track record of taking models from research to production.
• Experience in LLM or Agentic Evals and Guardrailing.
• Deep expertise in training and fine-tuning classifier models (BERT-family, ModernBERT, LLM-as-classifier).
• Hands-on experience with dataset development: sourcing, labeling, synthetic generation, adversarial augmentation, and quality control.
• Strong applied experience with LLMs and agentic systems (prompting, fine-tuning, evaluation).
• Proficiency in Python and the modern ML stack (PyTorch, Hugging Face).
• Excellent written and verbal communication skills.

Preferred Qualifications (Nice to Have)

• M.S. or Ph.D. in Computer Science, Machine Learning, Statistics, Physics, or related field.
• Published research at top ML/NLP venues (NeurIPS, ICML, ICLR, ACL, EMNLP, etc.).
• Experience with reinforcement learning, RLHF, RLAIF, or preference-based fine-tuning.
• Experience with AI safety, red-teaming, or adversarial ML.
• Experience working with enterprise customers in regulated industries.

Compensation

$190,000 - $300,000 (Bay Area Base Salary)

Benefits & Perks

• Unlimited PTO
• Competitive pay + equity
• Premium health, dental & vision (100% premiums covered for employee)
• 401(k) plan
• Monthly fitness reimbursement
• Paid parental leave
• Free annual Caltrain pass and Fastrak reimbursement
• Free lunch Mon-Thu
• Monthly in-office massages

Job Details

Location: Remote, Palo Alto, CA
Job Type: remote
Posted: May 8, 2026
Categories: Research, Software Engineering