AI Software Engineer (Fullstack)
Clearstory · Walnut Creek, CA · 5 days ago
On-siteEngineeringFull-time
About the role
AI agents are core to Clearstory's value delivery, handling tasks like surfacing change order insights, automating cost workflows, and enhancing construction teams' capabilities. This role involves owning AI agents end-to-end, from scoping workflows with product to designing prompts and tools, building evaluation harnesses, and shipping surfaces where agents appear.
Responsibilities
- Own AI agents and workflows end-to-end — from scoping the workflow with product and design, through prompt and tool design, to production deployment and continuous iteration
- Build across the full stack — agent orchestration backends, tool/API integrations, evaluation pipelines, observability, and the product surfaces where agents show up
- Design and run evals — golden sets, LLM-as-judge frameworks, regression evals — so we ship agents that work, not demos that don't
- Integrate with the construction tech ecosystem — accounting systems, project management tools, document repositories — and our own BigQuery-backed data platform
- Partner closely with product, design, and other engineers to translate messy real-world workflows into reliable agent behaviors
- Shape the future of our agent platform — surface unmet needs, prototype new patterns, and influence how AI shows up across Clearstory's product
- Move fast in a SOC 2-compliant environment, using modern AI development workflows
Requirements
- 2-3+ years of professional software engineering experience, including production work on AI/LLM systems
- Strong proficiency in Python and TypeScript, including async programming
- Fullstack production experience — React/TypeScript on the frontend, modern backend services, REST APIs, Postgres
- Hands-on experience with modern LLM tooling: prompt engineering, function/tool calling, RAG patterns, vector stores, and at least one major model provider (Anthropic, OpenAI, Google)
- Experience designing and running evaluation frameworks for LLM systems
- Comfort with cloud infrastructure (GCP preferred; AWS or Azure acceptable), Docker, and CI/CD
- Strong written and verbal communication — you can scope an agent with product, explain tradeoffs to an exec, and write docs your teammates actually want to read
Nice to Have
- Experience with agent orchestration frameworks (LangGraph, CrewAI, Claude Agent SDK) and observability tooling (Braintrust, LangSmith, Datadog, or equivalent)
- Familiarity with MCP (Model Context Protocol) and building MCP servers or skills
- Experience with BigQuery, ClickHouse, or similar analytics warehouses
- Previous work in ConTech, FinTech, or other regulated enterprise verticals
Benefits
- Competitive salary and equity
- Subsidized healthcare, vision, and dental coverage
- Access to frontier AI tools and internal AI tooling to accelerate your work
- Absence of cookie/navigation/legal/EEO/scam-warning boilerplate
Pay
Competitive salary and equity
Schedule
Hybrid work model: 3 days per week in the office, with the option to work 2 days per week from home if desired.