Analyst - Data Engineering
Marsh · Louisville, KY · Yesterday
HybridFull-time
About the role
We are seeking a Data Engineer to join our Applications Development team at Marsh. This is a hybrid role that has a requirement of working at least three days a week in the office. As a Data Engineer at Marsh, you will conceptualize and implement the setup and management of the data platform built Databricks services across different regions.
Responsibilities
- Collaborate with stakeholders to understand data requirements and translate them into technical specifications
- Design, develop, and implement data pipelines and ETL processes, ensuring thorough unit testing to validate functionality and performance
- Implement data quality checks and validation processes to ensure the accuracy and integrity of data throughout the pipeline
- Coordinate with cross-functional teams to ensure alignment on project goals, timelines, and deliverables
- Continuously monitor data workflows and pipelines for performance, reliability, and efficiency, implementing improvements as necessary
- Create and maintain comprehensive documentation for data processes, architecture, and workflows to ensure knowledge sharing and compliance
Requirements
- Bachelor's degree in computer science, Data Science, Information Technology, or a related field
- Proficiency in programming languages such as Python and SQL, along with experience in data modeling and database design
- 5+ years of experience working as a Data Engineer and possess a strong understanding of ETL and ELT concepts
- Experience with API integration and Data ingestion from various sources, ensuring seamless data flow between systems
- Experience with data testing (functional and automated) including proper documentation procedures and automation principles
Preferred qualifications
- Familiarity with data processing frameworks, particularly Apache Spark
- Experience working with cloud platforms such as AWS or Azure
- Experience with AI integration on test environments
- Ability to manage QA Engineers and guide through SCRUM calls
- Familiarity with data warehousing solutions and technologies, including Databricks and Snowflake
Benefits
- Professional development opportunities, interesting work and supportive leaders
- Vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have impact for colleagues, clients and communities
- Range of career opportunities, as well as benefits and rewards to enhance your well-being