AWS Senior Data Engineer
UNICON International Inc. · Torrance, CA · 1 mo ago
On-siteInformation Technology$140/hrContract
About the role
This position is based in Torrance, CA, with a work model of 4 days onsite and 1 day work from home; the candidate should be able to come work all five days if required.
Responsibilities
- Develop and maintain data integration solutions by designing and implementing data integration workflows using AWS Glue/EMR, AWS MWAA (Airflow), Lambda, and Redshift.
- Demonstrate proficiency in PySpark, Apache Spark, and Python for data processing of large datasets.
- Ensure data is accurately and efficiently extracted, transformed, and loaded into target systems.
- Validate and cleanse data to maintain high data quality.
- Ensure data quality and integrity by implementing monitoring, validation, and error handling mechanisms within data pipelines.
- Enhance the performance and optimization of data workflows to meet SLAs, scalability of data integration processes, and cost-efficiency on AWS cloud infrastructure.
- Identify and resolve performance bottlenecks, fine-tune queries, and optimize data processing to enhance Redshift's performance.
- Regularly review and refine integration processes to improve efficiency.
- Translate business requirements to technical specifications and coded data pipelines.
- Ensure timely availability of integrated data for business intelligence and analytics.
- Collaborate with data analysts and business stakeholders to meet their data requirements.
- Document all data integration processes, workflows, and technical and system specifications.
- Ensure compliance with data governance policies, industry standards, and regulatory requirements.
Requirements
- 5+ years of experience in data engineering, database design, ETL processes, and data warehousing.
- 3+ years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift, RDS, Spectrum, and Airflow).
- 2+ years of experience with CI/CD tools.
- Strong knowledge of data storage and processing technologies, including databases and data lakes based on distributed computing frameworks (e.g., Hadoop, Spark).
- 3+ years in programming languages such as Python, Java, or Scala.
- Primary skills: AWS EMR, Glue, Airflow, Iceberg, Redshift, RDS, IDMC, Amazon Kiro, and CI/CD.
- Candidate should design and develop data pipelines and support them.
Nice to have
- Informatica Cloud tool experience (IDMC).
- Agentic AI experience with Amazon Kiro.
Compensation & Benefits
- $140–145k
- Medical, dental, and vision insurance
- 401(k)
- Other standard benefits as applicable
About Unicon
UNICON is a workforce solutions provider with over 35 years of experience supporting organizations across a variety of industries. We partner with our clients to deliver skilled professionals while maintaining a strong focus on quality, compliance, and long-term relationships.