Senior Data Engineer

About the role

Senior Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as monitoring, troubleshooting and performance tuning data flows used in the collection, integration, and provisioning of data. This role requires experience building data pipelines and optimizing entire data systems as well as greenfield opportunities. This role works alongside other software development teams, database architects, data analysts and end users on complex data initiatives, and ensures our data delivery architecture is consistent with best practices. A Senior Data Engineer oversees the development of junior team members through mentorship, training, guidance, and direct management. A Senior Data Engineer contributes to data architecture and technology roadmaps to support strategic growth and team development.

Responsibilities

• Design, implement and maintain a robust, efficient and compliant data pipeline architecture
• Oversee and review the work of other engineers through peer reviews, code reviews and process reviews
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
• Research and analyze new technologies, methodologies and architectures for viability
• Build and maintain a service-based architecture for the publication of consumable data and information objects
• Work with data architects and data analysts to enhance and evolve the data environment
• Work with Business and IT stakeholders to assist with data-related technical issues and support their data and information requirements
• Define and develop frameworks, guidelines, best practices and examples to ensure data structures and integration processes are accurate, compliant and secure
• Facilitate the development and implementation of data quality standards, data protection standards and adoption requirements across the enterprise
• Define indicators of performance and quality metrics and ensure compliance with data related policies, standards, roles and responsibilities, and adoption requirements

Qualifications

• 7 or more years of Data Engineering experience in an oversight capacity
• Extensive domain-specific experience in the Financial Services industry
• Experience with Microsoft cloud-based technologies in a hybrid architecture
• Advanced working TSQL knowledge and experience working with relational databases, query authoring, stored procedure development, end-to-end data pipeline development
• Experience performing operational analysis on internal and external data and processes to uncover failure points and identify opportunities for improvement
• Strong analytic skills related to working with complex, multi-layered data pipelines and dependent datasets
• Holistic awareness of processes supporting data preparation, metadata, dependencies, lineages, compliance and workload management
• Understanding of data modeling concepts like:
  • Conceptual data modeling
  • Logical data modeling
  • Relational data modeling
  • Dimensional and multi-dimensional data modeling
• Understanding of meta-model and metadata management requirements
• Specific skills include:
  • Extensive experience with SQL-based syntax
  • Extensive experience designing and implementing data structures and interfaces for applications and business processes
  • Experience with relational database platforms: preferably MS SQL Server
  • Experience with data pipeline tools such as: SSIS
  • Experience using orchestration tools such as: ActiveBatch
  • Experience with web services and API integrations
  • Experience with scripting languages such as: Python and PowerShell
  • Experience with Agile, DevOps and DataOps methods and technologies: Source Code Control, Versioning, Test Automation, Continuous Integration, Automated Deployment, Recoverability, Telemetry, etc
  • Familiarity with data visualization technologies such as: Tableau, Power BI

Benefits

• Medical, Dental and Vision
• Company 401(k) and ESOP contribution
• Generous sick, vacation, and maternity/parental leave
• Paid holidays
• Professional Development Opportunities
• Tuition Reimbursement ($15,000 lifetime cap)
• Discounted personal insurance including home, auto and recreational vehicles
• Charitable gift-matching program
• Davidson Day of Giving – Our tradition of positively impacting communities in which we live and work

Pay

The potential pay range for this role is $110,000 – 150,000. The compensation offered will be determined on a case-by-case basis considering a variety of factors including, but not limited to, the skills, relevant work experience, and geographic location of each specific candidate. Additional incentive compensation may be earned based on performance.