Principal Software Engineer, AI Compute Platform

As a Principal Software Engineer on the AI Compute Platform team, you will design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, working closely with compute infrastructure teams, AI engineers, and internal users to improve reliability, scalability, and developer productivity across Arm's AI workloads.

Responsibilities

• Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
• Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles.
• Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.
• Improve platform scalability, observability, reliability, and developer workflows.
• Partner across teams to deliver distributed training, evaluation, and inference capabilities while strengthening engineering quality.

Essential Skills And Experience

• 8+ years of experience building distributed systems, cloud platforms, or production backend services.
• Experience with distributed ML training or inference systems.
• Strong programming skills in Go, Python, or similar systems languages.
• Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
• Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
• Clear communication and a collaborative approach to problem-solving.

Desired Skills And Experience

• Experience with Kubernetes operators, schedulers, resource management, or GitOps or equivalent experience.
• Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus and Grafana.
• Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM.
• Experience delivering developer tools or platform capabilities from early build through production.
• Technical leadership, mentoring experience, or an advanced degree or equivalent experience in a related field.

In Return

You will have the opportunity to work on important technical challenges in AI and platform engineering as part of a growing team in Seattle. This position offers a chance to contribute to core platform capabilities. You'll work alongside skilled colleagues from various subject areas and help invent the way new AI services are built and scaled at Arm. In addition to meaningful technical work, Arm offers an environment that values thoughtful engineering, collaboration, and continuous learning. This opportunity suits someone who enjoys solving complex systems problems, working across teams, and contributing to technology important to the future of AI at Arm.

Additional Information

Please note that a relocation package (including visa sponsorship assistance) is offered for this role, for candidates who need it.

Pay

Salary Range: $262,700–$355,400 per year.

We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.