GPU Cluster Architect

Responsibilities

• Architect scalable GPU cluster topologies including compute nodes, interconnect (InfiniBand, Ethernet), storage, and control planes.
• Analyze AI/ML workloads (e.g. LLM training, inference) to inform design tradeoffs across latency, bandwidth, and GPU density.
• Align with network architect relevant design and validate low-latency, high-throughput interconnects (e.g., InfiniBand HDR/NDR, RoCEv2) at POD and DC scale.
• Work with storage teams to optimize performance for training datasets, checkpointing, and others.
• Understand and analyze signal from monitoring systems to detect flows in design.
• Partner with site reliability, networking, storage, and DC engineering teams to operationalize and scale your architecture.

Requirements

• 5+ years of experience designing clusters.
• Deep understanding of modern GPU architecture (NVIDIA, AMD, etc.).
• Experience with HPC interconnects (InfiniBand & RoCE).
• Solid background in systems architecture, networking, and hardware reliability.
• Experience in scripting for automation and telemetry pipelines (Python, Go, etc.).

Qualifications

• Bachelor’s degree in Computer Science, Electrical Engineering, or related field.
• Hands-on experience with GPU cluster design and management.
• Strong analytical and problem-solving skills.
• Ability to work effectively in a fast-paced, dynamic environment.

Skills

• Proficiency in Python, Go, or similar scripting languages.
• Experience with Kubernetes, Docker, and container orchestration tools.
• Knowledge of cloud infrastructure and services (AWS, Azure, GCP).
• Experience with big data technologies (Hadoop, Spark).

Benefits

• Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families.
• 401(k) plan: Up to 4% company match with immediate vesting.
• Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
• Remote work reimbursement: Up to $85/month for mobile and internet.
• Disability & life insurance: Company-paid short-term, long-term and life insurance coverage.

Pay

• Competitive salaries ranging from $184K to $318K OTE, which includes base salary and performance bonus.
• Equity in the form of RSUs may be available at certain salary grades.

Schedule

• Hybrid working arrangements.