Jobs · Information Technology · New York

Staff Data Engineer- Data Lake

H1 · New York, United States · 3 wk ago
HybridInformation TechnologyFull-time

About the role

Join our dynamic team of data engineers where you will be responsible for designing, building, and maintaining data lakes. You will work closely with data scientists, analysts, and other engineers to ensure that our data infrastructure supports our business objectives.

Responsibilities

  • Design and implement scalable data pipelines using technologies like Apache Hadoop, Apache Spark, and AWS S3.
  • Develop and maintain data models to support data warehousing and analytics.
  • Collaborate with cross-functional teams to understand business needs and translate them into technical solutions.
  • Optimize data processing workflows to improve performance and reduce costs.
  • Ensure data quality and integrity through automated testing and validation processes.
  • Stay up-to-date with the latest trends and best practices in data engineering and AI.

Requirements

  • Bachelor's degree in Computer Science, Information Systems, or a related field.
  • At least 5 years of professional experience in data engineering.
  • Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
  • Strong understanding of SQL and experience with data modeling.
  • Proficiency in Python, Java, or Scala.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Excellent problem-solving skills and ability to work independently and as part of a team.
  • Ability to communicate complex technical concepts to non-technical stakeholders.

Qualifications

  • Experience with machine learning and AI tools is a plus.
  • Knowledge of data governance principles and practices.
  • Experience with data visualization tools such as Tableau or Power BI.
  • Experience with data security and compliance standards.

Skills

  • Technical proficiency in data engineering tools and technologies.
  • Strong analytical and problem-solving skills.
  • Effective communication and collaboration skills.
  • Ability to manage multiple projects simultaneously.

Benefits

  • Competitive salary commensurate with experience.
  • Flexible work schedule with options for remote work.
  • Health insurance coverage.
  • Retirement savings plan.
  • Professional development opportunities.
  • Employee recognition program.

Pay

Salary range: $100,000 - $150,000 per year, depending on experience.

Schedule

Hybrid schedule with a mix of remote and in-office work.

Similar jobs

Staff Data Engineer

HCA HealthcareNashville, TN· 2 wk ago
Healthcareapply on careers.hcahealthcare.com

Staff Data Engineer

VisaAustin, TX· 3 wk ago
Information Technology$132k–$210k/yrapply on visa.wd5.myworkdayjobs.com

Staff Data Engineer

hackajobNew York, NY· 2 wk ago
Information Technology$138/hrapply on hackajob.com

Staff Data Engineer

Choice Hotels InternationalScottsdale, AZ· Yesterday
apply on choicehotels.wd5.myworkdayjobs.com

Staff Data Engineer

Awetomaton LtdSt Louis, MO· 1 wk ago
Information Technology$25k/yrapply on grnh.se

Staff Data Engineer

Self Financial, Inc.Austin, TX· 1 mo ago
Information Technology$160k–$195k/yrapply on grnh.se