Staff Software Engineer - Data Platform

About the role

The ideal candidate will be responsible for designing, developing, and maintaining our data pipelines and infrastructure. They will work closely with cross-functional teams to understand data requirements, implement solutions, and ensure data quality and reliability.

Responsibilities

• Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, processing, and storage.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions to meet business needs.
• Implement data quality checks and ensure data integrity and reliability throughout the data lifecycle.
• Optimize and tune data pipelines for performance and efficiency.
• Troubleshoot and debug data-related issues, and provide timely resolution.
• Stay updated with the latest technologies and best practices in data engineering and apply them to improve existing systems.
• Document data architecture, processes, and workflows.
• Provide support and guidance to junior members of the team.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
• 9+ years of proven experience as a data engineer or similar role, with a strong background in data warehousing, ETL/ELT processes, and data modeling.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with big data technologies such as BigQuery, Spark, Kafka, DBT, SQLMesh etc.
• Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Strong SQL skills and experience working with relational and NoSQL databases.
• Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Preferred Experience

• Experience with containerization and orchestration tools such as Docker and Kubernetes.
• Knowledge of machine learning techniques and frameworks.
• Experience with DevOps practices and tools for CI/CD.

Benefits

• Competitive salary
• Comprehensive healthcare benefits
• Flexible Spending Account (FSA)
• Flexible work schedule
• Employee Assistance Program (EAP)
• Flexible Time Off and Parental Leave
• Monthly, quarterly, and annual social and team building events
• Monthly internet reimbursement