Staff Data Engineer- Data Lake
H1 · New York, United States · 3 wk ago
HybridInformation TechnologyFull-time
About the role
Join our dynamic team of data engineers where you will be responsible for designing, building, and maintaining data lakes. You will work closely with data scientists, analysts, and other engineers to ensure that our data infrastructure supports our business objectives.
Responsibilities
- Design and implement scalable data pipelines using technologies like Apache Hadoop, Apache Spark, and AWS S3.
- Develop and maintain data models to support data warehousing and analytics.
- Collaborate with cross-functional teams to understand business needs and translate them into technical solutions.
- Optimize data processing workflows to improve performance and reduce costs.
- Ensure data quality and integrity through automated testing and validation processes.
- Stay up-to-date with the latest trends and best practices in data engineering and AI.
Requirements
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- At least 5 years of professional experience in data engineering.
- Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
- Strong understanding of SQL and experience with data modeling.
- Proficiency in Python, Java, or Scala.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Excellent problem-solving skills and ability to work independently and as part of a team.
- Ability to communicate complex technical concepts to non-technical stakeholders.
Qualifications
- Experience with machine learning and AI tools is a plus.
- Knowledge of data governance principles and practices.
- Experience with data visualization tools such as Tableau or Power BI.
- Experience with data security and compliance standards.
Skills
- Technical proficiency in data engineering tools and technologies.
- Strong analytical and problem-solving skills.
- Effective communication and collaboration skills.
- Ability to manage multiple projects simultaneously.
Benefits
- Competitive salary commensurate with experience.
- Flexible work schedule with options for remote work.
- Health insurance coverage.
- Retirement savings plan.
- Professional development opportunities.
- Employee recognition program.
Pay
Salary range: $100,000 - $150,000 per year, depending on experience.
Schedule
Hybrid schedule with a mix of remote and in-office work.