Sr. Data Engineer - Reston, VA - Freewheel
Comcast · Reston, VA · 3 wk ago
On-siteBusiness DevelopmentFull-time
Responsibilities
- Developing data structures and pipelines to standardize and transform data, ensuring insights generation and reporting needs are met
- Ensuring data quality throughout ingestion, processing, and loading to target tables, maintaining high standards
- Creating ingestion frameworks for structured/unstructured data, implementing quality checks and reporting mechanisms
- Establishing methods for data consumption by end users and downstream applications, including database views and APIs
- Implementing data solutions on platforms like Kubernetes, Teradata, and Databricks, ensuring alignment with architectural standards
- Determining appropriate data storage on platforms based on privacy, access, and sensitivity requirements
- Understanding data lineage and transformation rules for efficient troubleshooting and impact analysis during changes
- Collaborating with management partners to optimize data sourcing and processing, enhancing data quality and process efficiency
- Mentoring junior data engineers, fostering skill development and knowledge sharing within the team
- Contributing to the creation and refinement of internal data engineering tools and frameworks to improve efficiency and scalability
Qualifications
- Advanced SQL skills
- Proficiency in a programming language (Python preferred)
- Experience with distributed computing frameworks (e.g., Apache Spark)
- Proficiency in Cloud data warehouse management workflow orchestration & automation
- Experience working on at least one cloud provider (AWS, GCP, or Azure)
- Experience with data pipeline design patterns, data modeling & data observability
- Ability to independently own modules and communicate & review technical designs
- Exposure to Ad-Tech platforms highly preferred but not required
- Prior experience or exposure to delivery customer facing data products and understanding of modern data stack - dbt, airflow, embedded analytics is highly preferred (not required)
- Enjoy working in challenging Analytics use cases and hard data shaping challenges
- Experience in collaborating with multiple teams delivering impactful work