Software Engineer - X Data
Maven · Palo Alto, CA · Yesterday
Engineering$125k–$400k/yrFull-time
About the role
You'll help build and operate a distributed data platform that powers hundreds of realtime and batch pipelines processing billions of events per day. The team runs like an internal startup — we own problems end to end, from raw event streams to the datasets, tooling, and metrics that product, growth, safety, and business teams depend on daily.
Responsibilities
- Design, build, and operate production-grade realtime and batch pipelines that ingest, process, validate, and deliver data powering user-behavior insights and product decisions.
- Create shared datasets, fact tables, and internal data products that let other teams analyze, debug, and improve product performance.
- Prototype and build tooling that automates and accelerates internal data workflows — backfills, dashboards, report generation, and self-serve access to data.
- Own data correctness end to end: validate with output invariants, denominator reconciliation, and independent recomputation, and lead root-cause investigations when key metrics move unexpectedly.
- Move fluidly across query engines and frameworks (e.g., BigQuery, Trino, Clickhouse for analytics; Flink, Kafka, Spark/Scalding for streaming and batch), choosing the right tool and adapting quickly to new infrastructure and environments.
- Partner across product and business teams to surface where data gaps exist and prioritize the highest-impact opportunities for new data acquisition and improvement.
- Iterate quickly on feedback, shipping the smallest useful increment with a strong bias toward efficient, accurate, and reliable solutions.
Requirements
- 3+ years of professional software engineering experience, ideally in data engineering or distributed systems.
- Hands-on expertise in Python, Rust, Scala, Go or Java, and data pipeline toolings and distributed systems.
- Knowledge of realtime and batch data processing tools such as Spark/Kafka/Flink/SQL and various storage systems in RMDBs/NoSQL.
- Experience solving large scale problems and comfortable doing incremental quality work while building brand new systems to enable future quality improvements.
- Proven records of interpreting product requirements into engineering implementation plans, and effectively communicating with different groups (AI, product, marketing/sales and engineering).
Qualifications
- BS/MS in Computer Science, Statistics, Mathematics, or related field.
- Strong understanding of distributed systems, data structures, algorithms, and database management systems.
- Experience with cloud platforms (AWS, GCP, Azure) and containerization technologies (Docker, Kubernetes).
- Excellent problem-solving skills and ability to work independently and collaboratively.
- Ability to communicate complex technical concepts to non-technical stakeholders.
Skills
- Python, Rust, Scala, Go, or Java
- Data pipeline toolings (Spark, Flink, Kafka)
- Distributed systems
- Cloud platforms (AWS, GCP, Azure)
- Containerization technologies (Docker, Kubernetes)
Benefits
Compensation And Benefits: $125,000 - $400,000 USD Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
Pay
$125,000 - $400,000 USD
Schedule
N/A