Senior Backend Engineer
DataRobot · Seattle, WA · 2 mo ago
EngineeringFull-time
Key Responsibilities
- Develop, test, and support features of DataRobot.
- Create and maintain automated unit tests and functional tests.
- Design infrastructure for new features with the input of peers.
- Build a system that ensures micro-services are secure, performant, reliable, and can go from idea to production in hours.
- Build a system that continuously provides recommendations to right-size computing resources for Kubernetes to ensure efficient cloud spending for ourselves and our customers.
- Design and architect automated quality platforms to go from Enterprise-Grade releases from once-a-quarter to once-a-week to once-per-day to once-per-hour without sacrificing performance, security, or reliability.
- Work with Product, Legal and Security to ensure the continuous delivery processes you build are compliant and secure.
- Work with the team to ensure pipelines have clear playbooks and can operate 24/7 without you.
- Work with a diverse group of architects and platform engineers across our R&D department to set continuous delivery and performance requirements for all production services.
- Work with internal product managers to set roadmaps and define milestones to deliver innovative and simple solutions to our many teams’ continuous delivery and platform engineering issues.
- Manage individual projects and milestones with abundant communication of progress.
Knowledge, Skills and Abilities
- Expert proficiency in Kubernetes architecture and operations including resource management/scheduling, auto-scaling, Gateway API/Ingress, Prometheus, and OpenTelemetry or experience with other orchestrators like nomad/slurm.
- Experience with gpu clusters, either as a user or administrator or experience in multi-node AI/ML.
- Passionate about developing products for your fellow internal developers.
- Strong Computer Science fundamentals in object-oriented design, data structures, algorithm design, problem-solving, and complexity analysis.
- An understanding of design for scalability, performance, and reliability.
- Deep experience with automated testing and test-driven development.
- Demonstrable knowledge of software architecture for large systems.
- Self-motivated and proactive, able to take ownership and deliver results.
- Able and willing to learn about new technologies.
- Personal drive to get things finished.
- Effective communication.
- Operational excellency to continuously define and improve SLA (Service Level Agreement) working backward from customer experience for all the software components this team manages.
Requisite Education and Experience / Minimum Qualifications
- 5+ years of experience.
- Expert in developing a wide variety of software with Python (4+ years).
- Experience designing and operating diverse CI/CD pipelines with Harness.io.
- Experience designing and innovating large-scale horizontal and vertically-scaled build, testing, and deployment systems for Kubernetes environments and familiarity with Helm charts.
Nice to Have
- Direct experience with modern distributed compute frameworks (e.g., Ray, Dask) and large-scale job schedulers (e.g., Slurm, Kueue).
- CKAD (Certified Kubernetes Application Developer) certification.
- Publicly reviewable contributions to interesting development projects.
- Agentic AI experience.
- Experience working with NVIDIA infrastructure in managing (NIM Operator, NVIDIA Dynamo Operator).