Senior Data Platform Engineer- Weights & Biases

About the role

The Data group at Weights & Biases works across the full range of data-related topics: We help business partners set goals, make decisions, and understand the levers to achieve their goals. We build reporting to keep the business attuned and aligned. We build datasets and pipelines to support self-service analysis. We train models to understand our customer growth, churn risk, and detect spam and abuse. We’re exploring novel benchmarks and recs for model training. We build and maintain a massive data platform to power it all.

Responsibilities

• Partner with other Data Platform Engineers and Data Scientists to expand and maintain our data platform.
• Partner with core engineering to improve our product telemetry.
• Eventually, join our on-call rotation for the data platform.

Strategic Goals

• Migrate data build tools to improve efficiency and performance
• Build a robust internal data catalog and semantic layer to support self-service analytics
• Build an internal AI agent for addressing common data workflows
• Lay the foundations for internal AI applications built on top of our operational data

Requirements

• Deep knowledge (practical and theoretical) of data engineering and the accompanying workflows.
• History of writing easy-to-follow code and effective documentation for your projects.
• Expert knowledge of data orchestration/data pipeline tools (dbt, dagster, airflow, etc).
• Experience working with large and high-demand data warehouses/platforms, multi-PB scale, and extreme business demand for the systems.
• Expert knowledge and understanding of web apps and best practices for logging and event instrumentation.
• Ability to clearly communicate your ideas to folks across a range of backgrounds and levels of technical knowledge.

Qualifications

• Theoretical or practical knowledge of machine learning workflows and terminology.

Skills

• Strong programming skills in Python, SQL, and other relevant languages.
• Experience with data warehousing technologies like Snowflake, Redshift, or BigQuery.
• Knowledge of data modeling and database design principles.
• Experience with data visualization tools like Tableau, Power BI, or similar.
• Experience with data security and compliance standards.

Benefits

Base salary range: $165,000 to $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

Pay

The base salary range for this role is $165,000 to $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation.

Schedule

Not specified.