Senior Server Operations & Maintenance Engineer

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make an impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users.

Responsibilities

• Responsible for the operation management of server new product introduction and the construction of an adaptation system. This includes formulating server operation and maintenance standard baselines, server hardware monitoring and formulation, planning, designing, and iteratively optimizing the maintainability, ease of maintenance, and stability solutions for new products. Identify and evaluate operation risks during new product introduction, and construct and adapt new product operation and maintenance solutions.
• Deeply involved in formulating hardware monitoring plans and verifying and launching monitoring rules for new online models, new hardware, and new scenarios. Precisely define and continuously improve various hardware failure judgment criteria, enhance the accuracy and recall rate of hardware monitoring, and ensure the stable operation of servers.
• For complex hardware troubleshooting of online servers, conduct in-depth analysis based on server-level black-box logs (such as BMC logs, IPMI/SMBIOS data, operating system kernel logs, hardware event logs, etc.). Collaborate with internal and external software and hardware R&D experts to accurately locate the root causes of difficult problems. Continuously improve the clarity rate of hardware failure monitoring and diagnosis and the consistency rate between repair reports and actual repairs, effectively reducing the failure return rate.
• Build a hardware failure knowledge base, accumulate typical cases and troubleshooting methodologies, promote the upgrade of monitoring automation and intelligence (such as the implementation of AIOps anomaly detection), participate in the construction of the hardware monitoring system and the standardization of hardware operation and maintenance processes, and write and maintain technical documents and operation manuals.
• Online quality operation: Establish unified quality standards, clarify the basis for batch quality determination, define the collaborative interface for batch quality issue repair, accumulate historical batch issue experience, implement risk management in advance, and control risks from the source.
• International travel requirement: up to four times per year, including but not limited to China, Europe, and South Asia. Candidates must have a valid passport and be able to obtain the necessary visas.

Requirements

• Bachelor’s degree or higher in Computer Engineering, Computer Science or related majors.
• Rich experience in the operation and maintenance of large-scale servers in the Internet industry, familiarity with the Internet operation and maintenance process system, and experience in the operation management of the server throughout its life cycle. Possess the concept of service expansion and innovation and experience in operation service expansion.
• Familiar with the development and delivery processes of server hardware products, as well as product development lifecycle management, including product line planning, product phase management, and product document management. Acquainted with server operation and maintenance scenarios, proficient in identifying risks related to server maintainability, ease of maintenance, and stability, and possess the experience and ability to adapt to the operation of new server product introductions.
• Familiar with server hardware architecture, covering x86/ARM architecture, PCIe/NVMe protocols, as well as key components such as CPU, Disk, Memory, GPU/NPU, NIC, and AOC. Familiar with BMC/IPMI protocol, Redfish, Sensor, SEL log, BMC OneKeyLog, GPU stress test diagnosis, and capable of proficiently applying relevant technologies for hardware status monitoring and fault detection.
• Proficient in the Linux system, skilled in setting server hardware configurations and troubleshooting under the Linux system. Proficient in one of the commonly used computer languages such as Shell scripting, Python, PHP, Perl, or Lua, and able to enhance work efficiency through language tools.

Preferred Qualifications

• Familiar with the full life cycle management process of servers. Candidates with 3+ years of experience in hardware research and development and testing are preferred.
• Familiar with server quality management work. 3+ years of experience in online quality management is preferred.
• Familiar with server hardware monitoring work. Candidates with 3+ years of experience in server hardware index collection, reporting, and monitoring strategy threshold operation are preferred.

Pay

The base salary range for this position is $115,200 - $288,000 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies, and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work; this role may be eligible for additional discretionary bonuses/incentives and restricted stock units.

Benefits

• Day one access to medical, dental, and vision insurance.
• 401(k) savings plan with company match.
• Paid parental leave.
• Short-term and long-term disability coverage.
• Life insurance.
• Wellbeing benefits.
• 10 paid holidays per year.
• 10 paid sick days per year.
• 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).