Jobs · Engineering · California

Manager, Solutions Architect

Baseten · San Francisco, CA · 3 wk ago
HybridEngineering$165k–$330k/yrFull-time

Responsibilities

  • Lead, mentor, and grow a team of Solution Architects, providing guidance on technical direction, project execution, and professional development.
  • Set clear goals and ensure timely, high-quality delivery across multiple customer-facing projects involving LLM deployment and inference optimization.
  • Collaborate with leadership to align team priorities with company and customer goals, balancing short-term delivery, widely varying customer priorities, and long-term technical initiatives.
  • Player-coach – While much of this role will be leading the team, you will also be expected to be a key driver on strategic product initiatives and customer engagements.
  • The best managers derive credibility from being able to be hands-on when needed.
  • Team Management - Lead a team of Solution Architects who will:
    • Partner with sales on customer discovery calls (most often second calls, occasionally first calls for large accounts).
    • Lead demos and technical scoping to align on success criteria, architecture, and deployment approach.
    • Own benchmarking and repeatable deployments, including handling standard deployment patterns and configurations across many modalities – LLMs, embeddings, image and video generation, VoiceAI, etc.
    • Advising on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups.
    • Driving consistent “playbook” style deployments for common models and use cases.
    • Become a power user of different runtimes such as vllm, sglang, and TRT-LMM and all the common configurations and tradeoffs between them.
    • Drive POC and project execution, including:
      • Scoping POCs and keeping stakeholders aligned on timeline, deliverables, and next steps.
      • Acting as the “ringleader” or project manager for POCs.
      • Pulling in Forward Deployed Engineering (FDE) support when deeper or more complex technical work is needed.

    Requirements

    • AI/ML background and the ability to credibly discuss AI/ML topics with technical stakeholders.
    • 4+ years of professional Solution Architecture/Solutions Engineering experience, including 1+ year in a leadership or mentorship capacity.
    • Strong customer-facing communication skills, including the ability to run structured discovery and clarify ambiguous requirements.
    • Technical depth to scope solutions, without needing to write production code.
    • Ability to script and prototype as needed, including comfort “vibe coding” to move quickly in technical workflows.

    Nice to Have

    • Experience running or supporting benchmarks for ML inference deployments.
    • Familiarity with infrastructure tradeoffs relevant to inference performance and cost (for example GPU selection and latency versus throughput tuning).
    • Experience serving as a cross-functional technical lead for customer POCs, including coordination across Sales and Engineering.

    Benefits

    • Competitive compensation, including meaningful equity.
    • 100% coverage of medical, dental, and vision insurance for employee and dependents.
    • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
    • Paid parental leave.
    • Fertility and family-building stipend through Carrot.
    • Company-facilitated 401(k).
    • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Similar jobs