Data Engineer - Senior
HighCloud Solutions · Raleigh, NC · Yesterday
HybridFull-time
Key Responsibilities
- Implement and maintain data quality to ensure the accuracy and reliability of data throughout the ETL process.
- Design, develop, and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake.
- Ensure seamless data integration into data platform, enabling efficient consumption by downstream applications and reporting tools.
- Address data quality challenges, including inconsistencies in source data that do not meet ingestion requirements, which can lead to load failures or data backouts.
- Work closely with business owners, data analysts, business intelligence teams, and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Maintain and monitor pipelines, identify issues, and implement solutions to preserve data flow and integrity.
Qualifications
- Demonstrated mid-level+ experience in data engineering, with a emphasis on data quality assurance and ETL processes.
- Expertise in Python, PyPI, and SQL.
- Expert analytical and problem-solving skills.
- Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity.
- Understanding of fundamental public-cloud capabilities.
- Proven capacity to comprehend business needs and convert them into technical requirements.
- Proven capacity to define success, deliver, and operate in an agile setting.
Pay
The salary range for this position is $80,000 - $100,000 per year, depending on experience and qualifications.
Schedule
This role is a hybrid position, combining remote work with in-person meetings and collaboration.