Data Engineer II

About The Role

The Data Engineer II at Sparklight plays a critical role in designing, building, and maintaining robust data pipelines and infrastructure. This position involves managing data from diverse sources, ensuring its quality, security, and availability for business intelligence and analytics. The candidate will work across the full data lifecycle—from onboarding new data sources to curating data into trusted layers that support strategic decision-making. The role requires a proactive approach to monitoring data delivery, diagnosing pipeline issues, and implementing improvements to enhance system performance and reliability. The Data Engineer II collaborates closely with analytics teams, data architects, and developers to develop scalable data solutions aligned with business objectives.

Qualifications

• Bachelor's degree (B.S.) in Science, Technology, Engineering, Mathematics, or related field, or equivalent practical experience
• 5+ years of professional experience in data engineering or related roles
• Proficiency in SQL (ANSI-SQL)
• Experience with cloud data ecosystems, preferably Microsoft Azure
• Knowledge of data warehouse concepts, ER modeling, and multi-dimensional modeling
• Hands-on experience with ETL, ELT, and data pipeline development
• Experience with DevOps platforms such as Azure DevOps, GitHub
• Experience migrating data from on-premise to cloud environments
• Familiarity with Agile/Scrum methodologies
• Strong programming skills in Python; knowledge of C# or similar languages is a plus
• Understanding of data governance, data quality, and master data management principles
• Knowledge of Microsoft Azure services like Data Lake, Data Factory, Databricks, and Delta Lake
• Excellent communication and interpersonal skills
• Ability to work effectively in virtual, remote, and on-premise settings

Responsibilities

• Design, develop, and optimize complex queries, ETL packages, and data objects to support analysis and reporting needs
• Collaborate with analytics and business teams to enhance data models for BI tools, promoting data accessibility and data-driven decision-making
• Ensure the health, reliability, and security of the data platform by implementing monitoring and proactive maintenance processes
• Diagnose and resolve complex data pipeline failures, communicating root causes and resolutions clearly to stakeholders
• Aid in developing data solutions, including pipelines, APIs, and other data management structures
• Identify opportunities for process automation, performance improvements, and code refactoring
• Build and maintain scalable data pipelines for extracting, transforming, and loading data from various sources
• Provide strategic guidance on data management best practices to BI leadership and teams
• Collaborate with cross-functional teams such as database administrators, data architects, and developers on data projects
• Support the organization’s purpose and values through proactive contributions and continuous improvement initiatives

Benefits

• Medical, dental, and vision insurance plans available from day one
• Life insurance coverage for self, spouse, and children
• Paid time off including vacation, holidays, and personal/sick days
• 401(k) plan with 100% company match up to 5% of eligible compensation, starting from day one
• Group legal plan with identity theft protection
• Tuition reimbursement up to $5,250 in the first year
• Annual community support initiatives across the U.S.
• Recognition and awards programs for employees
• Opportunities for career advancement within the organization
• Collaborative and inclusive work environment
• Free Cable One services for associates residing in serviceable areas
• Remote access to select premium channels and services

Equal Opportunity

We are an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, disability, or any other characteristic protected by law. We believe that our individual and collective talents, backgrounds, and perspectives are essential to our success and growth. We welcome applicants from all backgrounds to join our team and contribute to our mission of connecting communities and empowering individuals through reliable connectivity solutions.