Senior HPC AI Cluster Engineer
Ladders · United States · 1 mo ago
RemoteRemoteEngineering$176k–$334k/yrFull-time
Responsibilities
- Design, implement, and maintain large-scale HPC and AI clusters with comprehensive monitoring solutions
- Manage Linux job schedules and utilize orchestration tools for workload efficiency
- Develop and sustain continuous integration and delivery pipelines for software deployment
- Automate deployment and management of large-scale infrastructure environments
- Deploy monitoring solutions for servers, networks, and storage systems
- Troubleshoot systems from the bare metal level to application software
- Document and define standard methodologies for team-wide knowledge sharing
- Support R&D initiatives and engage in POCs/POVs for innovative improvements
Qualifications
- Degree in Computer Science, Engineering, or a related field with 8+ years of experience
- Expertise in HPC and AI technologies encompassing CPUs, GPUs, and fast interconnects
- Proficiency with job scheduling and orchestration tools, especially Slurm and K8s
- Advanced knowledge of Windows and Linux networking and security protocols
- Experience with diverse storage solutions such as Lustre and GPFS
- Strong programming skills in Python and bash scripting
- Familiarity with automation tools such as Jenkins, Ansible, Puppet, and Chef
- Deep understanding of networking protocols such as InfiniBand and Ethernet