Software Engineer, Agentic AI Infrastructure

About the role

We are seeking an experienced engineer who can bridge the gap between distributed systems and AI/LLM-powered agent systems. Your role will involve designing and building the infrastructure that powers Anrok's AI agent capabilities, ensuring that our systems are scalable, resilient, and fault-tolerant.

Responsibilities

• Design and build the distributed, fault-tolerant infrastructure that powers Anrok's AI agent capabilities—covering memory, state management, and execution for autonomous systems.
• Own technical architecture decisions for new agent infrastructure services end-to-end, from initial design through production deployment and iteration.
• Build the evaluation, observability, and reliability tooling that lets the rest of the team ship agents confidently on top of your infrastructure.
• Collaborate closely with product engineers and our tax data team to translate real compliance workflows into reliable, scalable agent primitives.
• Drive engineering best practices across the team: code quality, testing discipline, system design, and operational health.
• Identify and fix performance, reliability, and scalability bottlenecks as our agent systems grow.
• Help grow the team—mentoring engineers, contributing to technical culture, and raising the bar on how we build.

Requirements

• A strong systems engineering background with 3+ years of experience building and operating distributed, production-grade systems.
• Experience designing services that are scalable, resilient, and fault-tolerant.
• Hands-on experience building and deploying AI agents or LLM-powered systems in production.
• Familiarity with the modern AI stack, including prompt engineering, eval frameworks, RAG pipelines, tool calling, and agent orchestration.
• Able to think critically about architecture and tradeoffs, and lead technical decisions without a complete playbook.
• Experience with the full software development lifecycle: design, code review, testing, deployment, and on-call ownership.
• An eagerness to tackle ambiguous problems, break them down, and ship something real.
• A curiosity and motivation to learn new tools, especially in the context of AI and distributed systems.

Qualifications

• Master's degree in Computer Science, Engineering, or a related field.
• Proven track record of delivering high-quality, scalable, and reliable systems.
• Experience with distributed systems, microservices, and cloud-native technologies.
• Strong understanding of computer architecture, algorithms, and data structures.
• Experience with NoSQL databases, containerization, and orchestration tools.
• Knowledge of programming languages such as Python, Java, or Go.
• Experience with monitoring, logging, and observability tools.

Skills

• Experience with distributed systems, microservices, and cloud-native technologies.
• Strong understanding of computer architecture, algorithms, and data structures.
• Experience with NoSQL databases, containerization, and orchestration tools.
• Knowledge of programming languages such as Python, Java, or Go.
• Experience with monitoring, logging, and observability tools.

Benefits

• Daily lunch and snacks for those working out of our San Francisco office.
• Medical, dental, and vision insurance covered 100%.
• One Medical membership covered, flexible sick benefits and more.
• Annual learning and development stipend for books, online courses, and conferences, as well as a curious team to share your learnings with.
• Annual team offsites and in-person opportunities around our growing Anrok hubs.
• Home office setup stipend to ensure you have the equipment you need to thrive at work.

Pay

Competitive salary and equity package.

Schedule

Hybrid work environment based out of our growing office hubs - San Francisco, New York City, and Salt Lake City. For employees located outside of these hub cities, we offer a fully remote setup U.S only.