Jobs · Engineering · New York

Applied AI Researcher, Benchmarking

Distyl · New York, NY · 1 wk ago
HybridEngineering$150k–$250k/yrFull-time

Key Responsibilities

  • Design and run evaluations for model or system performance.
  • Create fair, reproducible experiments and interpret empirical results.
  • Develop intelligent systems using models rather than training or fine-tuning them.
  • Show the power of AI in practice, not just discuss theoretical ideas.
  • Build prototypes of ideas and conduct experiments to prove their effectiveness.

Who You Are

  • Have experience designing and running evaluations.
  • Have statistical and analytical rigor in your work.
  • Have expertise in compound AI systems, agentic collaboration, and related techniques.
  • Have a proven track record of research results.
  • Use AI tools like ChatGPT, Cursor, and Perplexity every day.
  • Have strong programming and data analysis skills.

What We Offer

  • A base salary range of $150K – $250K, depending on experience, location, and level.
  • Meaningful equity and a comprehensive benefits package.
  • 100% coverage of medical, dental, and vision insurance for employees and dependents.
  • Flexible time off and retirement and financial planning benefits.
  • Comprehensive wellness benefits, including physical fitness, mental well-being, and fertility and family-building support.
  • Access to state-of-the-art AI models and modern AI tools.
  • Ownership of high-impact projects across top enterprises.
  • A mission-driven, fast-moving culture that values curiosity, pragmatism, and excellence.

Similar jobs