Senior Network Engineer

Nscale is the GPU cloud engineered for AI, providing cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. We enable AI-focused companies to achieve superior results by reducing the complexity of AI development, supporting strategic business outcomes such as cost management, rapid innovation, and environmental responsibility.

About the role

The Network Engineering Team is responsible for the design, validation, and ongoing operation of all networking services that underpin both the internal management platform and the customer-facing cloud infrastructure. This includes high-performance Ethernet fabrics, InfiniBand, WAN connectivity, and data center networking. The team acts as a 3rd/4th line escalation point for the support organization.

As a Senior Network Engineer, you will own the design, automation, and in-service operation of our AI-optimized network fabrics — low-latency, high-bandwidth InfiniBand and Ethernet networks supporting large-scale training and inference workloads. You will take end-to-end ownership of technical areas, act as a senior escalation point, and help raise the bar on automation, documentation, and network operations.

Responsibilities

• Design, validate, and operate large-scale InfiniBand/RoCE and Ethernet fabric architectures at rack, row, and data center scale, tightly integrated with bare-metal provisioning and cluster management systems.
• Apply deep expertise in high-performance Ethernet fabrics (BGP, EVPN, VxLAN, LACP, QoS) and contribute to reference architectures and standards implemented consistently across sites.
• Design and engineer perimeter and security infrastructure — firewalls, NAT, VPN, and security policy architecture — across WAN and data center edge environments.
• Build and maintain network automation in a GitOps model: Python/Ansible tooling for provisioning, configuration validation, and compliance, with version-controlled configuration and CI/CD-driven change across multi-vendor environments.
• Drive operational excellence: resolve complex escalations, lead root-cause analysis for performance and stability issues, and reduce reactive toil through runbooks, automation, and measurable SLOs.
• Improve network observability — telemetry, monitoring, and alerting that provide clear visibility into fabric health and traffic patterns.
• Maintain the accuracy of source-of-truth network inventory and configuration data, with all changes flowing through structured change management.
• Collaborate with deployment, data center operations, platform engineering, and vendors on new site delivery, and mentor engineers across the team through reviews and knowledge sharing.

Requirements

• 8+ years of network engineering experience, with depth in HPC, AI, or hyperscale data center environments.
• Extensive hands-on experience with RDMA-aware networking (InfiniBand, RoCE) for AI/HPC workloads, including subnet managers (OpenSM, UFM) and fabric orchestration.
• Expert-level knowledge of modern data center routing and control planes (BGP, EVPN-VxLAN, Clos/spine-leaf), with production experience on platforms such as Cumulus, Nokia, or Arista EOS.
• Strong automation skills: Python and Ansible, Git-based workflows, and familiarity with modern IaC and pipeline tooling (Terraform, GitLab CI/GitHub Actions); you treat the network as code rather than managing devices by hand.
• Strong design and engineering experience with firewall platforms — Juniper SRX and/or Palo Alto — including security policy architecture, HA design, and multi-tenant segmentation.
• Experience designing network telemetry and observability for high-throughput environments.
• Proven ability to work cross-functionally with systems, storage, and HPC/AI workload teams, and comfortable leading incident response at senior escalation levels.
• Hands-on, adaptable, and comfortable in a fast-paced environment building next-generation infrastructure for ML scale-out.

Pay

Salary Range: $150,000 USD - $210,000 USD. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs.

Benefits

• Medical, dental, and vision coverage
• Flexible paid time off
• Parental leave
• Retirement plan participation