Senior Software Engineer

Coinbase’s AI Platform Team is looking for a Senior Software Engineer to help build the infrastructure that powers large language models (LLMs) and drives economic freedom through technology.

About the role

This full-time position offers the chance to work on advanced AI applications in the finance sector, crafting and managing the infrastructure that supports LLMs for teams across Coinbase. The role operates in a remote-first culture with quarterly in-person “surges” to foster collaboration and innovation.

Responsibilities

• Lead the architectural design and delivery of core platform systems, including the LLM Gateway (integrating over 60 models) with features like auth, PII redaction, and cost optimization.
• Drive the design of a Knowledge Base infrastructure that connects data sources to auto-provisioned databases, making them easily queryable by AI agents.
• Oversee AI FinOps capabilities, focusing on spend attribution, governance, and cost optimization for AI workloads across the organization.
• Develop cross-functional partnerships with engineering, security, legal, and product teams, as well as external partners in frontier labs and cloud providers.
• Build evaluation and observability tools to measure model performance and enable continuous improvement of AI agents.
• Contribute to the applied AI strategy by embedding with teams building production agents, leveraging fine-tuning and traditional machine learning techniques.

Requirements

• Minimum of 5 years of software engineering experience, specifically in ML/AI infrastructure, LLM systems, or distributed platform services at scale.
• Proven leadership in technical initiatives, from conception to deployment, with measurable impact across platforms.
• Deep knowledge of LLM orchestration patterns, agent frameworks, and vector databases, along with experience in model serving architectures.
• Strong cross-functional collaboration skills, with a track record of working with security, legal, and product teams to deliver production-grade AI systems.
• Fluency in Python and at least one systems programming language (Go, Rust, or C++), with experience designing APIs, microservices, and managing runtime environments.
• Understanding of responsible generative AI usage, ensuring human oversight for business-ready outputs.

Pay

Base salary range: $186,065 – $218,900 USD (location-dependent). Total compensation may include equity, performance-based bonuses, and benefits such as medical, dental, vision, and a 401(k) plan.