Software Engineer - Data Movement Platform
About the Data Movement Team
The Data Movement team is looking to hire a Software Engineer who is excited to solve large scale data platform and efficiency challenges. Reddit's community of users generates over 100B events per day, each of which is ingested into a data warehouse that sees 55,000+ daily queries. We utilize this data to enable both batch and streaming based ML and BI workloads at the company. Critical teams such as ads, feed generation, and ML experimentation rely on the Data Platform to generate revenue for Reddit. The Data Movement team within this group is specifically responsible for empowering the business to more efficiently process data and orchestrate these data workloads.
What you'll do
- Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users.
- Own the Data Movement Platform used to enable batch and stream data processing at Reddit.
- Invest in building new infrastructure for Spark, Flink, and Airflow technologies at Reddit, including contributing to the open source community as needed.
- Build automated solutions to minimize toilsome work for data users at Reddit and provide a declarative, self-service experience for working with data.
- Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of Reddit's Data Platform.
Who you might be
- 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code
- Proficient in object-oriented programming languages like Python, Scala, Go, or Java.
- Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects.
- Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure.
- Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context.
Benefits
- Comprehensive Healthcare Benefits and Income Replacement Programs
- 401k with Employer Match
- Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
- Family Planning Support
- Gender-Affirming Care
- Mental Health & Coaching Benefits
- Flexible Vacation & Paid Volunteer Time Off
- Generous Paid Parental Leave
Pay
The base salary range for this position is: $164,200—$229,900 USD. In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission.