Software Engineer, Agents
Harvey · New York, United States · 1 wk ago
HybridEngineering$161k–$242k/yrFull-time
Role Overview
The Software Engineer, Agents at Harvey will build systems that make our AI agents indispensable to legal professionals. Key responsibilities include:
- Partner with customers and PMs to understand legal workflows, design practical evaluations, and ship agents that get the job done.
- Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
- Work with the model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
- Improve observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
- Stay current on new developments in agentic systems and bring those learnings back to the products we build.
What You'll Do
Key tasks include:
- Designing environments and actions for agentic professional work.
- Managing context windows and creating optimal tools.
- Developing evals that enable faster iteration loops to unlock new capabilities.
- Participating in representative projects such as automating information requests and diligence checks, improving contract processing, optimizing litigation case preparation, and enabling PowerPoint generation.
Requirements
Qualifications include:
- Passion for building effective domain-specific agents.
- An iterative mindset: developing proof of concepts, making decisions quickly, and shipping versions.
- Comfortable using evaluations to drive quality.
- A humble and adaptable approach to code and frameworks.
What You Have
- 2-5 years (post-BS/MS) of software engineering experience.
- Proficiency in Python and experience working with LLM APIs and agent frameworks.
- Experience with shipping user-facing products, either on the backend or full-stack.
Pay
Compensation Range: $161,300 - $241,900 USD Depending on your location.
Schedule
Not specified.
Benefits
Not specified.
Skills
Not specified.
Benefits
Not specified.
Pay
Not specified.
Schedule
Not specified.
Application Instructions
Not specified.