Sr. Data Engineer

About the role

This is an opportunity to join a high-growth business as a Senior Data Engineer within the Analytics & Insights team at Allworth Financial. The role focuses on optimizing the company’s existing data infrastructure to support a robust data analytics and reporting structure. You will help modernize legacy SQL-based processes into scalable, maintainable cloud data pipelines while identifying architectural gaps, improving engineering standards, and maturing data governance practices.

The ideal candidate has broad hands-on experience across data engineering, cloud data platforms, ETL/ELT design, data modeling, orchestration, performance tuning, data quality, and governance. This role requires both building production-quality pipelines and advising on best practices, risks, and opportunities. You will play a key role in transitioning from legacy stored procedures and fragmented reporting toward a reliable, transparent, and well-governed modern data architecture.

This is a full-time exempt position. The ideal candidate will work on a hybrid schedule from our Addison office.

Responsibilities

• Design, build, and optimize data pipelines using PySpark, Delta Lake, SQL, and cloud-based data engineering tools.
• Improve data pipeline reliability, observability, logging, error handling, and restartability.
• Review existing notebooks, SQL scripts, data models, and orchestration workflows for maintainability and performance.
• Guide best practices for Azure Synapse, Spark, Delta Lake, data lake storage, and related cloud data services.
• Identify architectural gaps, technical debt, and modernization risks.
• Help design and implement data quality checks, reconciliation processes, and validation frameworks.
• Support development of canonical IDs, master data patterns, and entity resolution processes.
• Assist with data cataloging, lineage, metadata management, and governance practices.
• Partner with business stakeholders to understand reporting, analytics, and data product requirements.
• Help structure scalable data models for BI tools such as ThoughtSpot, Power BI, or similar platforms.
• Mentor data team members and help raise the overall engineering maturity of the team.
• Provide guidance on security, performance, cost, governance, orchestration, testing, and long-term maintainability.

Requirements

• 5+ years of professional experience in data engineering, analytics engineering, data architecture, or a closely related role.
• Strong SQL skills, including stored procedures, joins, window functions, CTEs, merge logic, and performance tuning.
• Hands-on experience with PySpark or distributed data processing frameworks.
• Experience designing and maintaining ETL/ELT pipelines in a cloud environment.
• Experience with data lake or lakehouse architecture, including Delta Lake or similar table formats.
• Strong understanding of data modeling concepts, including dimensional modeling, staging layers, curated layers, and semantic/reporting models.
• Experience with pipeline orchestration, scheduling, dependency management, and failure recovery.
• Ability to troubleshoot data quality issues, pipeline failures, schema drift, performance bottlenecks, and source system inconsistencies.
• Familiarity with modern data governance concepts, including cataloging, lineage, ownership, access control, data definitions, and data quality monitoring.
• Ability to communicate clearly with both technical and non-technical stakeholders.
• Experience reviewing existing systems and recommending practical, incremental improvements.
• Experience with Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Azure Data Factory, or related Azure data services.

Benefits

• Medical: Blue Shield (PPOs and HDHP with HSA) plans and Kaiser (HMO) plans for California associates
• Dental insurance with MetLife
• Vision insurance with VSP
• Optional supplemental benefits
• Healthcare savings accounts with company contribution
• Flexible spending accounts
• Flexible working arrangements
• Generous 401K contributions
• Exempt associates qualify for flexible paid time off policy
• Non-exempt associates receive 15 days of paid time off annually during the first three years of employment
• 11 paid holidays
• Option to participate in our Equity Purchase Program (contract, intern, and part-time employees are not eligible)
• Future growth opportunities within the company

Benefits are available to full-time associates who work more than 30 hours a week.