Senior Data Platform Engineer - Weights & Biases

About the role

The Data group at Weights & Biases works across the full range of data-related topics: We help business partners set goals, make decisions, and understand the levers to achieve their goals. We build reporting to keep the business attuned and aligned. We build datasets and pipelines to support self-service analysis. We train models to understand our customer growth, churn risk, and detect spam and abuse. We’re exploring novel benchmarks and recs for model training. We build and maintain a massive data platform to power it all.

Responsibilities

• Partner with other Data Platform Engineers and Data Scientists to expand and maintain our data platform.
• Partner with core engineering to improve our product telemetry.
• Eventually, join our on-call rotation for the data platform.

Strategic Goals

• Migrate data build tools to improve efficiency and performance
• Build a robust internal data catalog and semantic layer to support self-service analytics.
• Build an internal AI agent for addressing common data workflows.
• Lay the foundations for internal AI applications built on top of our operational data.

Requirements

Deep knowledge (practical and theoretical) of data engineering and the accompanying workflows.
History of writing easy-to-follow code and effective documentation for your projects.
Expert knowledge of data orchestration/data pipeline tools (dbt, dagster, airflow, etc).
Experience working with large and high-demand data warehouses/platforms, multi-PB scale, and extreme business demand for the systems.
Expert knowledge and understanding of web apps and best practices for logging and event instrumentation.
Ability to clearly communicate your ideas to folks across a range of backgrounds and levels of technical knowledge.

Qualifications

• Preferred if you work well in a self-directed environment and proactively find ways to improve processes and collaborate with team members or engaged users.
• You'll love this role if you enjoy connecting with real users daily, helping them solve issues, and understanding good patterns for using our tools.
• Theoretical or practical knowledge of machine learning workflows and terminology.

Skills

Deep knowledge (practical and theoretical) of data engineering and the accompanying workflows.
History of writing easy-to-follow code and effective documentation for your projects.
Expert knowledge of data orchestration/data pipeline tools (dbt, dagster, airflow, etc).
Experience working with large and high-demand data warehouses/platforms, multi-PB scale, and extreme business demand for the systems.
Expert knowledge and understanding of web apps and best practices for logging and event instrumentation.
Ability to clearly communicate your ideas to folks across a range of backgrounds and levels of technical knowledge.

Benefits

We offer a variety of benefits to support your needs. These include: Medical, dental, and vision insurance - 100% paid for by CoreWeave
Company-paid Life Insurance
Voluntary supplemental life insurance
Short and long-term disability insurance
Flexible Spending Account
Health Savings Account
Tuition Reimbursement
Ability to Participate in Employee Stock Purchase Program (ESPP)
Mental Wellness Benefits through Spring Health
Family-Forming support provided by Carrot
Paid Parental Leave
Flexible, full-service childcare support with Kinside
401(k) with a generous employer match
Flexible PTO
Catered lunch each day in our office and data center locations
A casual work environment
A work culture focused on innovative disruption

Pay

The base salary range for this role is $165,000 to $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation.

Schedule

In addition to a competitive salary, we offer a variety of benefits to support your needs. These include: Medical, dental, and vision insurance - 100% paid for by CoreWeave
Company-paid Life Insurance
Voluntary supplemental life insurance
Short and long-term disability insurance
Flexible Spending Account
Health Savings Account
Tuition Reimbursement
Ability to Participate in Employee Stock Purchase Program (ESPP)
Mental Wellness Benefits through Spring Health
Family-Forming support provided by Carrot
Paid Parental Leave
Flexible, full-service childcare support with Kinside
401(k) with a generous employer match
Flexible PTO
Catered lunch each day in our office and data center locations
A casual work environment
A work culture focused on innovative disruption