Senior Manager, System Test

About the role

The Senior Manager, System Test works with cross-functional teams of design engineers, customers, supply chain and project managers to rigorously test and validate rack-level, system solutions and ensure new product release readiness. This position manages engineers responsible for System Integration Testing and Reliability, owns the test system setup and validation for complex, high-end servers and hyperscale compute & network racks, and develops guidance on Celestica Storage/GPU/network system integration and reliability verification plans, test cases and coverage.

Responsibilities

• Design and execute comprehensive validation and integration of all components within advanced AI compute racks to ensure cohesive and optimal hardware/software function, compatibility, connectivity, performance, security, reliability, cost effectiveness and resilience.
• Lead the development and implementation of system integration test solutions and participate in project planning, scheduling, and reporting.
• Review and interpret product/system requirements/specifications and define system integration and validation plans.
• Lead reliability analysis and validation for new products/systems and components.
• Provide technical leadership and direction to engineers; serve as a recognized expert in system integration testing and reliability analysis/testing.
• Oversee test system setup and execution to guarantee products and systems meet or exceed stringent performance, reliability, and efficiency standards.
• Own qualification and seamless integration of rack components such as servers, accelerators, switches, power shelves, and cooling solutions.
• Oversee integration and configuration of smart PDUs to manage power distribution within the rack and ensure compatibility with rack-level power management functions.
• Maintain proficiency in rack-level management functions, including real-time monitoring, control, and automation of critical rack components.
• Oversee hands-on lab racking and stacking procedures, including assembly and setup of intricate, high-touch rack configurations.
• Oversee creation and maintenance of thorough documentation for setup, testing/analysis, and summarization of results, including installation procedures, test plans, analysis/testing results, performance metrics, and identified issues.
• Own team collaborations with design engineers, program managers, customers, and vendors to ensure seamless integration, optimal and reliable operation, and successful delivery of rack-level solutions.
• Identify and automate procedures and testing to reduce development time, increase quality, and reduce errors; identify and use AI tools to streamline planning, execution, analysis, and reporting.
• Oversee troubleshooting, debugging, and root-cause analysis on hardware, network, and software-related issues.

Requirements

• Proficiency in managing teams of 8+ persons with experience in continuous improvement initiatives and establishing new processes for system test and reliability.
• Proficiency in defining test plans, creating and executing tests, and generating test reports for internal and external uses.
• Proven experience with test tools such as JIRA, Jenkins (CI/CD), and similar tools; proven success implementing and maintaining processes for task/defect tracking and reporting.
• Experience troubleshooting with oscilloscopes, logic analyzers, and specialized test equipment such as PCI protocol analyzers and traffic generators (Keysight/Ixia or Spirent).
• Proficiency in project management of system integration testing; ability to manage simultaneous projects, predict workloads/execution, and deliver per plan.
• Self-motivated and able to work independently in a fast-paced, multi-tasking environment.
• Experience with stress testing utilities such as stressapp, stress-ng, iperf3, FIO, memtester, etc.
• Experience with Linux distributions including RHEL, Ubuntu, and CentOS; understanding of x86/firmware/Linux.
• Proficiency in scripting languages including Python, Perl, VBA, REST API, shell scripting, Ansible, Terraform, etc.
• Proficiency collaborating with cross-functional teams involved in specification, planning, design, development, and test of hardware.
• System/software/firmware integration and verification experience.
• Rack-Level System Integration Expertise: 5+ years required; experience should include servers, accelerators, switches, CDU (Cooling Distribution Unit) systems, and high-power shelves; understanding of AI compute rack configurations and integrated component functionality; strong understanding of rack-level management functions and integration best practices.
• Proven experience testing and qualifying rack-level solutions to ensure they meet or exceed performance and reliability benchmarks.
• Proficiency in the management and use of AI tools and test automation.
• Exceptional verbal and written communication skills.
• Exceptional problem-solving skills and attention to detail.

Qualifications

• BS degree or higher in Electrical Engineering, Computer Engineering, or Computer Science.
• 11+ years of relevant experience.

Physical Demands

Duties are performed in a normal office environment and may require extended periods of sitting and sustained visual concentration on a computer monitor or detailed data. Repetitive manual movements are frequently required. Occasional travel may be required.