Principal Data Engineer

About the role

The successful candidate will be self-motivated and have a strong drive for learning and self-improvement while working within an engineering focused delivery team with cross-team departmental collaboration.

Responsibilities

• Understand the users’ needs and solve problems like database and schema design and engineering, ETL pipelines, APIs, and microservice design and engineering.
• Accountable for the design, engineering and ongoing operations of robust, secure, and maintainable data architectures, pipelines, and services.
• Collaborate with data stewards, database administrators, platform engineers, developers, and site reliability engineers to develop and launch solutions for data ingestion, validation, quality control, integration, storage, management, and delivery.
• Independently work with clients to transform business objectives into technical designs, applications, and solutions.
• Participate in and contribute to the design of agile teams and ceremonies.
• Stay current on technology trends by learning and evaluating modern technologies.
• Advise business clients on technical capabilities as a data service provider / expert.
• Participate in code reviews and contribute to making continuous improvements to the team’s dev ops processes.
• Provide mentorship to junior team members and provide strategic input to senior management across various business and technology units.

Requirements

• Deep expertise in designing and implementing various stages of Data lifecycle (from ingestion to distribution) using Snowflake as the core platform.
• 10+ years of experience with implementation of ETL/ELT pipelines, data governance, data quality controls, data version control, meta data management, and reporting analytics using cloud data technologies.
• Experience with messaging and streaming platforms such as Kafka, RabbitMQ, or cloud-based messaging technologies.
• Experience with Python or equivalent dynamic languages.
• Experience with C#, Java, Typescript, or equivalent static languages.
• Experience with Relational and Non-Relational databases and related schema design and development.
• Working knowledge of Observability and DevOps concepts, tools, and continuous delivery pipelines.
• A deep understanding of cybersecurity best practices and a demonstrated ability to integrate best practices into development activities.

Qualifications

• Bachelor’s degree in a technical field or equivalent practical experience.

Preferred Competencies

• Interest and ability to learn other coding languages as needed.
• Ability to write in English fluently and idiomatically.
• Advanced degree in a technical field or equivalent experience in engineering or practical experience.
• Experience with agile/scrum methodologies.
• Financial services industry experience.
• Testing competencies with Test Driven Development, Behavioral Driven Development.
• Experience With Any Of The Following: Redis, PostgreSQL, MongoDB, SQL Server, DBT, FiveTran, Numpy, Scipy, Pandas, Airflow, Kafka, AWS, serverless/microservice architecture.

Benefits

Dimensional offers a variety of programs to help take care of you, your family, and your career, including comprehensive benefits, educational initiatives, and special celebrations of our history, culture, and growth.

Pay

N/A

Schedule

N/A