Hadoop Developer || Jersey City, NJ/Phoenix, AZ/Seattle, WA/Dallas, TX (Onsite) || FTE with TCS

Location: Phoenix, AZ / Seattle, WA / Jersey City, NJ / Dallas, TX

Responsibilities

• Design and govern enterprise, regulatory-facing data platforms
• Design data lakes, ELT/ETL pipelines, and batch/real-time data processing solutions
• Develop and optimize PySpark applications, including performance tuning
• Build and maintain large-scale distributed systems using Python
• Work with Hadoop ecosystem components (HDFS, Hive/Impala, YARN)
• Implement solutions using Java, Scala, and SQL
• Address non-functional requirements and production support models
• Communicate effectively and influence across organizations

Requirements

• Deep expertise in PySpark, including performance tuning and optimization
• Strong Python development experience in large-scale distributed environments
• Solid knowledge of the Hadoop ecosystem (HDFS, Hive/Impala, YARN)
• Proven experience designing and governing enterprise, regulatory-facing data platforms
• Proficiency in Java, Scala, and SQL
• Strong understanding of non-functional requirements and production support models
• Clear written and verbal communication skills with the ability to influence stakeholders