Jobs · Engineering · California

Senior Product Manager - Software

Efficient Computer · San Jose, CA · 2 days ago
HybridEngineering$160k–$210k/yrFull-time

Key Responsibilities

  • Define the product roadmap for the compiler, SDK, runtime, model conversion and enablement tooling, and developer platform.
    • Set priorities based on customer requirements, competitive positioning, and strategic platform needs.
    • Lead framework and model enablement strategy across PyTorch, ONNX, ExecuTorch, LiteRT, and future runtimes, including compatibility, validation coverage, performance expectations, and support commitments.
    • Drive reduction in time-to-first-working-application (TTFWA) across customer segments. Define the metric, baseline it, track it, and own the roadmap items that move it.
  • Establish SDK governance: surface area, versioning, API stability commitments, and deprecation policy. Define release quality criteria, validation expectations, and backward compatibility standards.
  • Drive developer confidence through reproducible benchmarking, deterministic tooling behavior, clear diagnostics, and strong documentation.
  • Participate in customer engagements to understand workflow friction, deployment blockers, and framework requirements. Represent software platform strategy in technical customer discussions and ecosystem partnerships.
  • Gather and prioritize developer feedback across evaluation, onboarding, optimization, and deployment phases. Maintain structured mechanisms to feed this directly into roadmap decisions.
  • Partner with Applications Engineering to define the software platform capabilities necessary for production-quality reference applications and customer evaluation flows, including AI inference, vision, audio, and sensor-processing pipelines.
  • Define requirements for profiling, debugging, and performance analysis workflows that allow developers to understand and optimize application behavior on Efficient hardware.
  • Balance long-term platform investments against near-term customer enablement and revenue-driving requirements. Understand when the right call is shipping a polished narrow capability vs. a rough broad one.
  • Influence silicon decisions based on software needs and constraints. Partner with the Hardware PM and architecture team when compiler or runtime requirements have silicon implications.
  • Establish and own developer success metrics and developer workflow metrics and diagnostics: build success rates, TTFWA, workflow completion rate, and friction points.
  • Define and own the SDK release cadence, packaging, distribution, and support lifecycle.

Required Qualifications

  • 7+ years of product management experience for developer-facing software platforms - SDKs, compilers, runtimes, APIs, ML tooling, or embedded developer ecosystems.
  • Experience shipping tools and platforms used directly by external developers, including operating through the customer-zero phase.
  • Demonstrated ownership of developer adoption, onboarding success, workflow completion, or related developer productivity metrics.
  • Strong understanding of modern ML inference and deployment pipelines (PyTorch, ONNX, ExecuTorch, LiteRT (formerly TensorFlow Lite), TensorRT, or equivalent).
  • Experience translating customer workflows and technical constraints into actionable product requirements that engineering can build from without ambiguity.
  • Familiarity with software performance tradeoffs involving memory, latency, throughput, power, and hardware utilization.
  • Ability to work effectively with compiler, runtime, systems software, and silicon architecture teams and to influence without authority across all of them.
  • Ability to establish credibility with highly technical developers, compiler engineers, and ML practitioners through clear thinking, technical depth, and strong customer empathy.

Preferred Qualifications

  • Experience with compiler toolchains, IRs, and deployment flows (LLVM, MLIR, TOSA, XLA, or equivalent).
  • Experience with embedded AI deployment pipelines and edge inference workflows.
  • Experience at a semiconductor or AI hardware company building developer tools for a novel architecture.
  • Familiarity with embedded software ecosystems (FreeRTOS, CMSIS-NN, MCU SDK patterns) and Linux-based embedded development environments and cross-compilation workflows.
  • Experience with performance profiling tools, compiler traces, and benchmark-driven optimization workflows.
  • Experience with benchmarking methodologies (MLPerf or equivalent) - including designing, running, and publishing credible results.
  • Experience operating in early-stage environments with incomplete requirements and rapidly evolving architectures.
  • Experience in startup environments with hybrid PM + DevRel responsibilities.

Similar jobs

Senior Product Manager

Divisions Maintenance GroupSeattle, WA· 1 wk ago
RemoteInformation Technologyapply on app.jobvite.com

Senior Product Manager

NovogradacDover, DE· 1 wk ago
Marketing$132k–$178k/yrapply on novoco.wd108.myworkdayjobs.com