Senior Data Engineer in AWS
Accord Technologies Inc · Piscataway, NJ · 1 mo ago
On-siteInformation TechnologyFull-time
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes using AWS services like S3, EMR, and Redshift.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and translate them into technical solutions.
- Optimize data workflows and ensure data quality, integrity, and security.
- Manage and monitor cloud data infrastructure, troubleshoot issues, and implement necessary improvements.
- Implement data models and architecture best practices.
- Automate data workflows and develop scripts using Python.
Requirements
- Proven experience as a Data Engineer, in AWS cloud environment.
- Hands-on experience with S3, EMR, Redshift, and RDS (PostgreSQL).
- Strong coding skills in Python.
- Ability to design and implement scalable data solutions.
- Excellent problem-solving and communication skills.
- Bachelor's degree in Computer Science, Data Engineering, or related field.
Skills
- Strong proficiency in AWS services: S3, EMR, Redshift, RDS (PostgreSQL).
- Extensive experience in Python programming for data processing and automation.
- Knowledge of SQL and experience working with relational databases.
- Familiarity with data warehousing, big data processing, and analytics.
- Strong understanding of ETL/ELT processes.
- Experience with Linux/Unix environments.
- Knowledge of data governance, security, and compliance best practices.