Lead HPC/Cloud Systems Administrator

About the role

RedLine Performance Solutions (RedLine) has been in the HPC solutions engineering services business for 26 years, delivering services ranging from full life-cycle HPC systems engineering to remote managed services and HPC program analysis. This position supports customers who deliver mission-critical programs, providing life-changing and economy-shaping services. By ensuring the success of their technical programs, you will directly contribute to efforts that protect the public, drive the economy, and improve people's lives. US citizenship and the ability to obtain a Public Trust clearance is required. This is a remote, full-time position.

Responsibilities

• Lead a team to administer resources from the operating system and above within on-premise and cloud-based HPC environments, including:
  • Integration and configuration of compute resources and service nodes
  • All software installations on compute resources, service nodes, and parallel filesystems
  • Development and implementation of system and performance monitoring and benchmarking
  • Maintenance of system documentation
  • Evaluation of performance impacts of planned operating system changes
  • Leadership of resource optimization and job scheduling software and policies
• Provide technical support to researchers using HPC resources, troubleshoot problems, and develop appropriate computational strategies
• Provide emergency support on a 24x7 basis
• Provide technical leadership and direction for other team members, maintaining team focus on production uptime and model performance
• Review and present all change management requests to customer management
• Prepare for and attend the daily 9:00 am (Eastern) Operations call with customer staff and other operational stakeholders

Requirements

• Minimum of 10 years of RedHat, Rocky, and/or CentOS Linux system administration experience
• Technical leadership experience in a large, production environment—leadership for both the technical solution and the system administration team
• Demonstrated ability to configure, deploy, and manage major system areas such as batch systems, networks, data storage, backup systems, databases, or distributed computing
• Experience with configuration management tools (e.g., Ansible)
• Ability to work both independently and as part of a team; flexibility in handling assignments and working on several projects simultaneously
• Ability to effectively communicate with people of diverse backgrounds and computer knowledge

Preferred Skills

• HPC system administration experience
• Experience with batch systems (e.g., SLURM)
• Experience managing parallel and cluster file systems (e.g., Lustre)
• Network management experience, including in an HPC context (e.g., InfiniBand)
• Experience with cloud HPC environments (e.g., GCP)

Benefits

• Paid time off
• 401k match
• Health care benefits