Senior Data Engineer
About the role
Develop ETL and ELT processes to source and curate data from various enterprise systems, ensuring speed and quality of delivery.
Develop tabular and dimensional data models to support analytical and operational use cases.
Build and maintain data processing jobs to refresh data on a regular cadence.
Guide the identification, investigation, and resolution of data quality issues, ensuring data is secure and reliable.
Utilize advanced debugging techniques to troubleshoot complex data pipeline and processing issues.
Lead code review sessions with a focus on performance, scalability, and maintainability.
Develop and maintain data processing jobs to refresh data on a regular cadence.
Build and maintain data processing jobs to refresh data on a regular cadence.
Develop relational and non-relational data models to meet user and business needs.
Proactively identify upstream and downstream dependencies that may impact pipeline performance or reliability.
Monitor and address performance and scalability issues across large-scale data platforms.
Participate in on-call rotations for incident management and production support.
Responsibilities
- Develop ETL and ELT processes to source and curate data from various enterprise systems, ensuring speed and quality of delivery
- Develop tabular and dimensional data models to support analytical and operational use cases
- Build and maintain data processing jobs to refresh data on a regular cadence
- Guide the identification, investigation, and resolution of data quality issues, ensuring data is secure and reliable
- Utilize advanced debugging techniques to troubleshoot complex data pipeline and processing issues
- Lead code review sessions with a focus on performance, scalability, and maintainability
- Develop and maintain data processing jobs to refresh data on a regular cadence
- Develop relational and non-relational data models to meet user and business needs
- Proactively identify upstream and downstream dependencies that may impact pipeline performance or reliability
- Monitor and address performance and scalability issues across large-scale data platforms
- Participate in on-call rotations for incident management and production support
Requirements
- 7 years of experience building data solutions, including relational and non-relational databases and batch/real-time data pipelines using cloud services
- 5 years of experience with dimensional or tabular data modeling
- 5 years of experience with CI/CD and automated deployments
- Expertise writing complex queries (SQL/NoSQL)
- Expertise in performance tuning, debugging, and troubleshooting data processing jobs, including ETLs
- 5 years of experience in Python development, including AWS Lambda functions
- Proficiency in a functional or object-oriented programming language
- Strong understanding of database and server internals
- Knowledge of Linux system administration, shell scripting, and basic networking
- Experience developing and consuming REST APIs
Qualifications
- Degree (or equivalent experience) in computer science, information technology, or a related field
- Knowledge of disaster recovery and backup strategies for data systems
- Experience mentoring and developing other engineers
Skills
- Advanced debugging techniques
- Data modeling
- Data processing
- ETL/ELT processes
- Performance tuning
- Python development
- Relational and non-relational databases
- System administration
- Tabular and dimensional data models
- Testing and debugging
- Unix/Linux
- Web development
Benefits
Our team members fuel our strategy, innovation and growth, so we ensure the health and well-being of not just you, but your family, too! We go above and beyond to give you the support you need on an individual level and offer all sorts of ways to help you live your best life. We are proud to offer eligible team members perks and health benefits that will help you have peace of mind. Simply put: We’ve got your back.