Sr ETL Developer, AVP

About the role

Barclays Services Corp. seeks Senior ETL Developers, AVP in Whippany, NJ (multiple positions available).

Responsibilities

• Design, develop and operate a data lake platform using Python, Apache Spark, Hadoop, Sqoop, Hive, PIG and SQL to build various ETL analytics and data quality and risk control components.
• Create high level design documents and exhaustive data maps to translate requirements to AbInitio Graph or Plan.
• Partner with business users, business analysts and technology teams to comprehend data onboarding requirements to load data in Market Risk Strategic Platforms.
• Develop AbInitio Graph, Plan and Unix shell scripts.
• Support system integration testing, user acceptance testing and troubleshoot various problems/errors encountered during various phases for project development life cycles.
• Utilize an in-depth knowledge of AbInitio products such as Continuous Flow, Express It, Query It, Metadata Hub, Control Center etc., as well as concepts of Hadoop, Kafka and Messaging Queue.
• Engage with users explaining existing functionality and offering potential solutions.
• Manage a team of three (3) junior and mid-level software developers.

Requirements

Minimum Salary: $189,592 per year Maximum Salary: $195,000 per year

Qualifications

• Minimum 7 years of relevant experience in ETL development and data management.
• Proven experience in designing and implementing data lakes and ETL processes.
• Strong proficiency in Python, Apache Spark, Hadoop, Sqoop, Hive, PIG and SQL.
• In-depth knowledge of AbInitio products and concepts of Hadoop, Kafka and Messaging Queue.
• Experience with Unix shell scripting and system integration testing.
• Excellent communication and collaboration skills.
• Ability to manage a team of developers.

Skills

• Programming languages: Python, Java, C#
• Frameworks: Apache Spark, Hadoop, Sqoop, Hive, PIG
• Tools: AbInitio, Continuous Flow, Express It, Query It, Metadata Hub, Control Center
• Concepts: Hadoop, Kafka, Messaging Queue
• Shell scripting
• System integration testing
• Team management

Benefits

• Competitive and generous employee benefits, including medical, dental and vision coverage, 401(k), life insurance, and other paid leave for qualifying circumstances.
• May telecommute.

Pay

Minimum Salary: $189,592 per year Maximum Salary: $195,000 per year

Schedule

Full-time

Benefits

• Employee benefits package including medical, dental and vision coverage, 401(k), life insurance, and other paid leave for qualifying circumstances.
• May telecommute.