Data Engineer I

About the role

The Data Engineer is responsible for development and support of data products on a modern cloud-based data lake, leveraging expertise and knowledge of multiple technologies & data domains to help build a robust, scalable, and reliable data engineering platform. Additionally, a Data Engineer is responsible for providing data services for enterprise-grade analytical environments, utilizing automated data pipelines at scale, and streamlining efficient data transformations for priority use cases. This role can be involved hands-on in development of the codebase and partners with business units and peer technology groups to support analytics execution.

Responsibilities

• Partner across the organization to architect, implement, deploy, and maintain data-driven systems solutions
• Build, maintain and simplify enterprise data pipelines with emphasis on security, reusability & data quality
• Perform debugging and fixing application issues, root cause analysis, and help in proactive/preventive maintenance
• Help in technical debt reduction and follow clean code principles
• Development experience in one or more languages (e.g. Python, SQL, PySpark)
• Experience in the use of Infrastructure as Code tools (Databricks Asset Bundled, Terraform)
• Engagement in data governance council to define, develop, and review standards, guidelines, and data models to promote data quality and best practices
• Leverage DevOps tools to automate deployment and validation/test automation of data engineering pipelines
• writes and executes complete testing plans, protocols, and documentation for assigned portion of data system or component; identifies defects and creates solutions for issues with code and integration into data system architecture
• Effectively plan and collaborate with technical and non-technical teams on business initiatives

Qualifications

• To perform this job successfully, an individual must be able to perform each essential duty mentioned satisfactorily.
• The requirements listed below are representative of the knowledge, skill, and/or ability required:
• Technical knowledge of BI systems design
• Big data architecture and technology landscape
• ETL orchestrations
• Strong communications skills
• Comfort working in a fast-paced, multi-task environment

Education And Experience

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or an equivalent combination of education and relevant experience.
• Demonstrated understanding of core technology disciplines, including but not limited to software development, database administration, systems architecture, cloud technologies, infrastructure, and related technical domains.
• 1-2 years of relevant experience in data engineering, data analytics, software development, database administration, or a related technical field.