Data Infrastructure Engineer

About the role

Kennesaw State University is one of the 50 largest public institutions in the country. With growing enrollment and global reach, we continue to expand our institutional influence and prominence beyond the state of Georgia. We offer more than 190 undergraduate, graduate, and doctoral degrees to empower over 50,000 students to become thought leaders, lifelong learners, and informed global citizens. Our entrepreneurial spirit, high-impact research, and Division I athletics draw students from throughout the region and from more than 100 countries across the globe. Our university's vibrant culture, career opportunities, rich benefits, and values of respect, integrity, collaboration, inclusivity, and accountability make us an employer of choice.

Responsibilities

• Develops, tests, and implements data pipelines to efficiently, securely, and reliably ingest data from various data sources into the enterprise data lake or data warehouse
• Collaborates with data architects and data source SMEs to understand requirements and designs data pipelines accordingly
• Develops and maintains robust data integrity checks, ensuring data accuracy, timeliness, and consistency
• Utilizes cloud tools and custom scripts for validation, set up automated anomaly detection, and collaborates with stakeholders to align quality checks with data requirements
• Enables integration of data from various data sources, such as databases, cloud services and APIs, to facilitate seamless data flow for enterprise and self-service reporting and analytics
• Maintains compliance with data security policies and regulations in the data infrastructure
• Manages the storage structure within the data lake or data warehouse, optimizing resource utilization and ensuring efficient integration with data transformation and modeling processes
• Supports senior technical staff in project planning and the development of standard operating procedures
• Creates and regularly updates technical documentation for data pipeline processes

Qualifications

• Five (5) years of related IT experience
• Familiarity with data protection and privacy laws and regulations (i.e., FERPA, HIPAA, etc.)
• Knowledge of various file formats used in data storage, like parquet, avro, csv, etc., and their implications on performance and storage
• Understanding of cloud storage services, such as blob storage, data lakes, data lakehouses, and data warehouses
• Understanding of data warehouse architecture patterns, such as star schema, One Big Table (OBT), materialized view architecture, etc.
• Knowledge of data warehousing principles, including data quality, data enrichment and standardization, and data modeling
• Knowledge of best practices in data pipelines orchestration
• Knowledge of data security practices, including encryption/decryption, and compliance with data governance policies and guidelines