Senior Associate Big Data Engineering - Atlanta, Chicago, Hybrid (4 days) Atlanta
Publicis Sapient · Atlanta, GA · 3 wk ago
$123k–$175k/yrFull-time
About the Role
This is a hybrid role requiring 4 days in the office (Atlanta or Chicago). As a Senior Associate in Data Engineering, you will translate client requirements into technical design and implement components for data engineering solutions. You will utilize a deep understanding of data integration and big data design principles to create custom solutions or implement package solutions. You will independently drive design discussions to ensure the overall health of the solution.
Responsibilities
- Build functionality for data ingestion from multiple heterogeneous sources in batch and real-time.
- Develop functionality for data analytics, search, and aggregation.
- Design and implement data storage and computation frameworks with performance optimizations.
- Work with analytics and visualization tools to deliver insights.
- Leverage infrastructure and cloud computing for scalable data solutions.
- Implement data management platforms and ensure their efficiency.
Requirements
- Overall experience of 5.5 years with a minimum of 4 years in Big Data technologies.
- Hands-on experience with the Hadoop stack: HDFS, Sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, Hive, Oozie, Airflow, and other components required for building end-to-end data pipelines.
- Working knowledge of real-time data pipelines is an added advantage.
- Strong experience in at least one of the programming languages: Java (preferable), Scala, or Python.
- Hands-on working knowledge of NoSQL and MPP data platforms like HBase, MongoDB, Cassandra, AWS Redshift, Azure SQL DW, GCP BigQuery, etc.
- Well-versed and working knowledge of data platform-related services on AWS.
- Bachelor’s degree and 6 to 8 years of work experience, or any combination of education, training, and/or experience that demonstrates the ability to perform the duties of the position.
Skills
- Good knowledge of traditional ETL tools (Informatica, Talend, etc.) and database technologies (Oracle, MySQL, SQL Server, Postgres) with hands-on experience.
- Knowledge of data governance processes (security, lineage, catalog) and tools like Collibra, Alation, etc.
- Knowledge of distributed messaging frameworks like ActiveMQ, RabbitMQ, Solace, search and indexing, and microservices architectures.
- Performance tuning and optimization of data pipelines.
- Cloud data specialty and other related Big Data technology certifications.
Benefits
- An inclusive workplace that promotes diversity and collaboration.
- Access to ongoing learning and development opportunities.
- Competitive compensation and benefits package.
- Flexibility to support work-life balance.
- Comprehensive health benefits for you and your family.
- Generous paid leave and holidays.
- Wellness program and employee assistance.
Pay
Salary Range: $123,000 - $175,000. The range shown represents a grouping of relevant ranges currently in use at Publicis Sapient. Actual range for this position may differ, depending on location and specific skillset required for the work.