Sr. Data Engineer

About the role

As a member of the Product and Engineering team at PitchBook, you will be part of a team of big thinkers, innovators, and problem solvers who strive to deepen the positive impact we have on our customers and our company every day. We value curiosity and the drive to find better ways of doing things. We thrive on customer empathy, which remains our focus when creating excellent customer experiences through product innovation.

Primary Job Responsibilities

• Expert at building unified data technologies to support advanced and automated business analytics
• Design, develop, document, and maintain database and reporting structures used to compile insights
• Define, develop, and review extract, load, and transform (ELT) processes and data modeling solutions
• Consistently evolve data processes and techniques following industry best practices
• Establish and help define reports and dashboards used to translate business data into insights, identify and prioritize operational improvement opportunities, and measure business KPIs against objectives
• Contribute to the ongoing improvement of quality assurance standards and procedures
• Mentor and guide less experienced data engineers, contributing to their professional development
• Stay updated with the latest data engineering technologies and trends and share your insights with the team
• Support the vision and values of the company through role modeling and encouraging desired behaviors
• Participate in various company initiatives and projects as requested

Skills and Qualifications

• Bachelor's degree in a related field (Computer Science, Engineering, etc.)
• 5+ years of experience in data engineering roles, including creating and maintaining data pipelines, data modeling, and data architecture
• 5+ years of experience in data cleansing, governance, and quality/integrity
• 5+ years of experience in advanced SQL, including expert-level skills in querying large datasets from multiple sources and developing automated reporting
• 5+ years of experience in Python, with skills for diverse components of data pipelines, including scripting, data manipulation, custom extract, transform and loads, and statistical/regression analysis
• Expertise in extract, transform, and load (ETL) and extract, load, transform (ELT) processes and pipelines, platforms (e.g. Airflow), and distributed messaging (e.g. Kafka)
• Experience with tools that capture and control data modeling change management (e.g. SQLMesh)
• Experience building data alerting & notifications (e.g. on deviations, thresholds, etc.)
• Experience building and managing tools for data observability and documentation (e.g. DataLab)
• Proficiency in data storage solutions, data warehousing, and cloud-based data platforms (e.g. Snowflake)
• Proficiency in deploying data pipelines to a cloud-native, containerized deployment/delivery environment (e.g. Kubernetes)
• Knowledge and applicable working experience establishing and ensuring data governance, data quality, and compliance standards
• Exceptional problem-solving skills and a track record of designing and optimizing data pipelines
• Excellent communication and collaboration skills with the ability to engage with non-technical stakeholders
• Experience working with enterprise technologies (CRM, ERP, Marketing Automation Platforms, Financial Systems, etc.) is a plus

Benefits + Compensation at PitchBook

• Physical Health: Comprehensive health benefits, additional medical wellness incentives, STD, LTD, AD&D, and life insurance
• Emotional Health: Paid sabbatical program after four years, paid family and paternity leave, annual educational stipend, ability to apply for tuition reimbursement, CFA exam stipend, robust training programs on industry and soft skills, employee assistance program, generous allotment of vacation days, sick days, and volunteer days
• Social Health: Matching gifts program, employee resource groups, subsidized emergency childcare, dependent Care FSA, company-wide events, employee referral bonus program, quarterly team building events
• Financial Health: 401k match, shared ownership employee stock program, monthly transportation stipend

Compensation

Annual base salary: $140,000-$170,000
Target annual bonus percentage: 10%

Working Conditions

The job conditions for this position are in a standard office setting. Employees in this position use PC and phone on an on-going basis throughout the day. Limited corporate travel may be required to remote offices or other business meetings and events.