Distributed Systems Engineer

About the role

Design and engineer systems that handle the compute, scheduling, and orchestration of complex ML + ETL pipelines that need to run quickly, reliably, and cost-effectively on large sums of video.

Responsibilities

• Optimize for system uptime
• Work with cloud technologies
• Design and maintain pipelines that process petabytes of data
• Develop robust CI/CD pipelines tailored for ML-focused teams
• Write strong code in Go and Python; experience with Rust is a plus
• Lead by example as an individual contributor (IC)
• Have experience with large-scale video data systems

Requirements

• 3+ years of experience building foundational data infrastructure
• Proficient in working across diverse cloud architectures
• Developed robust CI/CD pipelines tailored for ML-focused teams
• Strong coding experience with Go and Python
• Experience with large-scale video data systems

Qualifications

• In-person at our SF HQ

Skills

• Optimizing for system uptime
• Working with cloud technologies
• Designing and maintaining pipelines that process petabytes of data
• Developing robust CI/CD pipelines tailored for ML-focused teams
• Coding in Go and Python
• Experience with large-scale video data systems

Benefits

• 401k + Full Health Insurance
• Breakfast, Lunch, and Dinner covered
• Ubers covered home

Pay

$150K - $300K

Schedule

Full-time