Principal Storage Architect & Team Lead (Research & HPC Data Platforms)

Primary Responsibilities

• Lead and mentor a specialized team of systems engineers, balancing high-level architectural design with hands-on operations and escalation support.
• Oversee the integration of Lustre HSM on the Elm platform, managing data movement policies between parallel filesystems and MinIO object storage.
• Drive the scaling, reliability, security, compliance, operations, and lifecycle management of our primary research computing storage platforms, including for high-risk data.
• Tune I/O for large-scale High Performance Computing and AI workloads.
• Represent Stanford within the Lustre community and other key community groups, contributing to the upstream roadmap and maintaining a vendor-neutral storage strategy.

Qualifications

• Education: Bachelor’s degree and ten years on increasingly technical work experience or a combination of education and relevant experience.
• Expertise at Scale: 10+ years of hands-on experience architecting, building, and managing Lustre and ZFS or similar filesystems at the 20PB+ scale.
• Management: Proven experience leading technical teams in a High-Performance Computing (HPC) or Research Computing environment.
• Object Storage & HSM: Deep technical fluency in MinIO and Lustre HSM (copytools, policy engines like RobinHood) or similar tools.
• Kernel & Network Mastery: Expert-level knowledge of the Linux kernel and large-scale InfiniBand/Ethernet fabric tuning.
• "Hands-On" Requirement: Must be comfortable in the "weeds"—capable of debugging issues such as kernel panics, LNet congestion, and metadata bottlenecks alongside the team.