Senior Software Engineer, Data Engineering
Ripple · San Francisco, CA · 3 wk ago
HybridEngineeringFull-time
About the role
Join us as a Senior Software Engineer on the Data Engineering team. You will be a core builder of the Caspian Data Platform, Ripple's centralized lakehouse that powers analytics, financial reporting, product intelligence, and data-driven operations across every business unit.
Responsibilities
- Design, build, and operate production ETL pipelines on Databricks using Delta Live Tables and Spark, applying medallion architecture patterns across Finance, Payments, Product, and GTM domains.
- Own data modeling in different layers — defining governed, reusable table structures that serve as reliable sources of truth for business metrics and downstream consumption.
- Drive technical design for projects spanning multiple teams, writing clear design documents that articulate architecture, tradeoffs, and rollout plans.
- Build pipeline observability into your work — failure detection, alerting, retry logic, and the operational hygiene that keeps oncall burden low.
- Integrate AI tooling into data workflows: agentic systems for pipeline triage, automated code generation for transformations, and natural language interfaces for data access.
- Mentor engineers, reviewing their code and designs and helping them grow into more complex ownership.
- Contribute to platform infrastructure through Terraform, and work with Unity Catalog to establish data contracts, access controls, and lineage.
Requirements
- 5–8 years of hands-on data engineering experience building and maintaining production pipelines and data models.
- Deep proficiency with Databricks or similar platforms — Delta Live Tables, Unity Catalog, Delta Lake, and PySpark or Spark SQL as primary tools.
- Strong SQL skills: complex transformations, incremental materialization, schema evolution, and data quality validation.
- Solid AWS experience relevant to building and operating data systems at scale.
- Proficiency in Python for data engineering — ingestion, transformation, testing, and utility tooling.
- Experience with CI/CD tooling such as GitLab and infrastructure-as-code with Terraform.
- Exposure to AI tooling in a data context — whether building agents, using LLMs for code generation, or enabling self-serve analytics workflows.
- The ability to take ambiguous requirements, define the right data model and pipeline design, and deliver with minimal oversight.
- Familiarity with financial, payments, or blockchain data.
- Experience with Fivetran or similar ingestion tools and their operational patterns.
Qualifications
- BS/MS in Computer Science, Statistics, Mathematics, or related field.
- Experience with data warehousing and analytics tools.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.
Skills
- Python
- Databricks/Delta Live Tables/Unity Catalog/Delta Lake
- SQL
- AWS
- Terraform
- CI/CD
- AI/ML
- Financial, Payments, or Blockchain Data
Benefits
- Competitive salary, bonuses, and equity
- Competitive benefits that cover physical and mental healthcare, retirement, family forming, and family support
- Employee giving match
- Mobile phone stipend
- R&R days
- Generous wellness reimbursement and weekly onsite & virtual programming
- Generous vacation policy
- Industry-leading parental leave policies. Family planning benefits.
- Catered lunches, fully-stocked kitchens with premium snacks/beverages, and plenty of fun events
Pay
- Competitive compensation package
Schedule
- Full-time