Senior Data Engineer - Data Engineering

Responsibilities

• Understanding different aspects of the Plaid product and strategy to inform golden dataset choices, design and data usage principles.
• Leading key data engineering projects that drive collaboration across the company.
• Advocating for adopting industry tools and practices at the right time.
• Owning core SQL and python data pipelines that power our data lake and data warehouse.
• Well-documented data with defined dataset quality, uptime, and usefulness.

Qualifications

• 4+ years of dedicated data engineering experience, solving complex data pipelines issues at scale.
• Experience building data models and data pipelines on top of large datasets (in the order of 500TB to petabytes).
• Experience working with different performant warehouses and data lakes; Redshift, Snowflake, Databricks.
• Experience building and maintaining batch and realtime pipelines using technologies like Spark, Kafka.
• Experience with schema design, evolving an analytics schema on top of unstructured data.
• Excitement to try out new technologies.
• Interest in producing proof-of-concepts that balance technical advancement and user experience and adoption.
• Desire to get deep in the weeds to manage, deploy, and improve low level data infrastructure.
• Empathy towards stakeholders, listening to them, asking the right questions, and collaboratively coming up with the best solutions for their needs while balancing infra and business needs.
• Commitment to data privacy and integrity, acting in the best interest of consumers.