Data Engineer 2 - Reston, VA - Freewheel
Comcast · Reston, VA · 3 wk ago
On-siteAnalystFull-time
Responsibilities
- Developing data structures and pipelines to collect, standardize, and transform data for insight generation and reporting
- Ensuring data quality throughout ingestion, processing, and loading to target tables, with a focus on standardization and transformation rules
- Creating ingestion frameworks for various data types and establishing methods for data consumption through views, extracts, and APIs
- Maintaining data warehouses and lakes, including API development for data access, while managing solutions on Snowflake, and Databricks platforms
- Understanding data lineage and transformation to enable efficient troubleshooting and impact analysis during system changes
- Collaborating with technology partners to optimize data sourcing, processing rules, and ensure process optimization and data quality
- Handling data migrations and conversions in response to evolving platforms and new standards, while recognizing and resolving technical issues
- Designing and monitoring ETL processes to support efficient data flow and collaborating with analytics teams for model deployments
- Participating in code reviews and contributing to data governance and compliance efforts in adherence to industry regulations
Qualifications
- Proven exposure to at-least one of the major programming languages - Python, Golang, Java
- Strong analytical and problem-solving skills
- Exposure to modern data stack (dbt, airflow, snowflake) but not required
- Exposure to highly collaborative environments