Jobs · Engineering · New York

Software Engineer, Agents

Harvey · New York, United States · 1 wk ago
HybridEngineering$161k–$242k/yrFull-time

Role Overview

The Software Engineer, Agents at Harvey will build systems that make our AI agents indispensable to legal professionals. Key responsibilities include:

  • Partner with customers and PMs to understand legal workflows, design practical evaluations, and ship agents that get the job done.
  • Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
  • Work with the model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
  • Improve observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
  • Stay current on new developments in agentic systems and bring those learnings back to the products we build.

What You'll Do

Key tasks include:

  • Designing environments and actions for agentic professional work.
  • Managing context windows and creating optimal tools.
  • Developing evals that enable faster iteration loops to unlock new capabilities.
  • Participating in representative projects such as automating information requests and diligence checks, improving contract processing, optimizing litigation case preparation, and enabling PowerPoint generation.

Requirements

Qualifications include:

  • Passion for building effective domain-specific agents.
  • An iterative mindset: developing proof of concepts, making decisions quickly, and shipping versions.
  • Comfortable using evaluations to drive quality.
  • A humble and adaptable approach to code and frameworks.

What You Have

  • 2-5 years (post-BS/MS) of software engineering experience.
  • Proficiency in Python and experience working with LLM APIs and agent frameworks.
  • Experience with shipping user-facing products, either on the backend or full-stack.

Pay

Compensation Range: $161,300 - $241,900 USD Depending on your location.

Schedule

Not specified.

Benefits

Not specified.

Skills

Not specified.

Benefits

Not specified.

Pay

Not specified.

Schedule

Not specified.

Application Instructions

Not specified.

Similar jobs