Data Engineer
Metropolitan Management Group · Wyomissing, PA · 1 mo ago
On-siteInformation TechnologyFull-time
About the role
A Data Engineer position is available within our growing data analytics team. The ideal candidate will be responsible for designing, implementing, and maintaining large-scale data pipelines using technologies such as Apache Hadoop, Spark, and Kafka.
Responsibilities
- Design and implement scalable data processing pipelines using big data technologies.
- Collaborate with data scientists and analysts to understand their data needs and translate those into technical solutions.
- Optimize data pipelines for performance and reliability.
- Develop and maintain data quality checks and monitoring systems.
- Work closely with other engineers and data scientists to ensure seamless integration of data pipelines into existing systems.
Requirements
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- At least 2 years of professional experience in data engineering or a related field.
- Experience with big data technologies such as Hadoop, Spark, and Kafka.
- Strong understanding of SQL and NoSQL databases.
- Proficiency in Python, Java, or Scala.
- Excellent problem-solving skills and ability to work independently and as part of a team.
Qualifications
- Experience with cloud platforms like AWS, Google Cloud, or Azure.
- Knowledge of data warehousing concepts and tools such as Redshift, BigQuery, or Snowflake.
- Experience with data modeling and ETL processes.
- Good understanding of data security best practices.
Skills
- Strong analytical and problem-solving skills.
- Ability to work under pressure and meet deadlines.
- Excellent communication and collaboration skills.
Benefits
- Competitive salary commensurate with experience.
- Flexible working hours.
- Professional development opportunities.
- Health insurance coverage.
- Employee discounts on technology products.
Pay
Salary is competitive and commensurate with experience.
Schedule
The role is full-time and based in our office in [City].