Sr. Data Engineer
About the role
We are seeking a Senior Data Engineer to join our Data Platform product team. This role is part of a strategic initiative to build best-in-class infrastructure for data management across the Eclipse Platform and Data Marketplace.
Responsibilities
Design, build, and own core data models and key infrastructure to manage data and usage across the Eclipse Platform and Data Marketplace.
Implement a data quality monitoring system, including source-to-target data validations and anomaly detection.
Collaborate with Engineering, Product Management, and IT teams to inform product decisions with data and identify system improvement opportunities.
Develop dashboards for leadership to monitor platform performance, availability, and user behavior.
Provide insights and recommendations for information architecture and customer-focused data insights.
Collaborate with Engineering, IT, and Security teams to meet data governance requirements.
Think creatively to solve complex, often unstructured problems.
Requirements
Data Expertise: Proficient in data modeling, analysis, and relational database design. Financial setting experience is preferred.
Large Datasets: Skilled in processing and extracting value from large, disconnected datasets.
Data Pipelines: Experienced in designing and optimizing data pipelines and architectures.
Python Proficiency: Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages.
Machine Learning: Proficient in Machine Learning, NLP, or deep learning using Python.
PySpark: Experienced in working with PySpark.
ETL/ELT: Experienced in ELT/ETL development and handling unstructured datasets.
Data Warehousing: Knowledgeable in data warehousing and multidimensional data models.
Rapid Prototyping: Experienced in rapid prototyping and fast solution delivery processes.
Analytics: Skilled in working with large datasets to generate complex analytics for actionable insights.
Collaboration: Effective in collaborating across disciplines, departments, and segments.
Documentation: Experienced in developing and maintaining ETL-related artifacts such as schemas, data dictionaries, and transforms.
Desirable Skills
ETL/ELT Development: Proficient in ELT/ETL development.
Machine Learning: Experienced in Machine Learning, NLP, or deep learning using Python.
Unstructured Data: Skilled in handling unstructured datasets.
Benefits
The base salary range for this role is $120,000 to $160,000 annually. Additionally, employees may be eligible for a discretionary bonus and/or equity awards based on individual and company performance. The company offers a comprehensive total rewards package including medical, dental, and vision coverage; a 401(k) plan with company match; paid time off, holidays, and parental leave; and professional development reimbursement opportunity.