Jobs · North Carolina

Senior HPC and LSF Operations Engineer

NVIDIA AI · Durham, NC · 3 days ago
HybridFull-time

About the role

Manage, scale, and optimize job scheduling systems (LSF, Slurm, etc.) in a large-scale, multi-site environment supporting EDA and other compute-intensive workloads.

Analyze scheduler and infrastructure performance data to identify systemic bottlenecks and drive measurable improvements in utilization, throughput, and turnaround time.

Lead problem solving across scheduler, OS, and workload layers, ensuring timely resolution of service-impacting issues.

Identify recurring operational challenges and implement targeted automation or process improvements to reduce manual effort and prevent repeat incidents.

Help define and track reliable metrics and SLOs for service performance and reliability, partnering with customers to ensure expectations are realistic and measurable.

Contribute to operational standards, documentation, and best practices to improve consistency across sites.

Partner directly with customer teams to clarify requirements, translate technical tradeoffs, and drive issues to closure.

Responsibilities

  • Manage, scale, and optimize job scheduling systems (LSF, Slurm, etc.) in a large-scale, multi-site environment supporting EDA and other compute-intensive workloads
  • Analyze scheduler and infrastructure performance data to identify systemic bottlenecks and drive measurable improvements in utilization, throughput, and turnaround time
  • Lead problem solving across scheduler, OS, and workload layers, ensuring timely resolution of service-impacting issues
  • Identify recurring operational challenges and implement targeted automation or process improvements to reduce manual effort and prevent repeat incidents
  • Help define and track reliable metrics and SLOs for service performance and reliability, partnering with customers to ensure expectations are realistic and measurable
  • Contribute to operational standards, documentation, and best practices to improve consistency across sites
  • Partner directly with customer teams to clarify requirements, translate technical tradeoffs, and drive issues to closure

Requirements

  • Bachelor’s degree in Computer Science or related field, or equivalent experience
  • Minimum 5+ years of experience operating and supporting large-scale Linux-based compute infrastructure
  • Strong hands-on experience supporting and tuning job scheduling systems (LSF, Slurm, etc.) in HPC or silicon design environments
  • Proficiency in Linux systems administration (CentOS/RHEL)
  • Strong problem solving skills and the ability to independently analyze complex system behavior under load
  • Clear and effective communication skills, including the ability to articulate technical tradeoffs and reliability metrics to engineering stakeholders

Qualifications

  • Experience implementing reliability engineering practices within HPC scheduling environments
  • Deep knowledge of job scheduling systems (LSF, Slurm, etc.) configuration tuning, scheduler internals, and advanced troubleshooting techniques
  • Experience building or enhancing observability systems, including metrics collection, monitoring pipelines, alerting strategies, and performance dashboards
  • Background with container technologies such as Docker, Singularity, or Podman in HPC environments
  • Experience influencing adoption of new infrastructure standards across multiple teams or sites

Skills

  • Experience with LSF, Slurm, and other job scheduling systems
  • Linux systems administration expertise
  • Problem-solving and analytical skills
  • Effective communication and stakeholder engagement
  • Observability and reliability engineering experience
  • Container technology proficiency
  • Collaboration and influence across teams

Benefits

  • NVIDIA offers highly competitive salaries and a comprehensive benefits package.
  • We have some of the most forward-thinking and hardworking people in the world on our team and our collaborative talent continues to drive NVIDIA's growth.

Pay

  • The base salary range is $152,000 - $241,500 for Level 3, and $184,000 - $287,500 for Level 4.

Schedule

  • This posting is for an existing vacancy.

Similar jobs

Senior Operations Engineer

Consensus Cloud SolutionsUnited States· 1 mo ago
RemoteEngineering$118k–$170k/yrapply on consensus.com

Senior Operations Engineer

Modern Technology Solutions, Inc. (MTSI)El Segundo, CA· 3 wk ago
Engineering$140k–$180k/yrapply on mtsi-va.eightfold.ai