Big Data Application Developer

Accountabilities

• Design, develop, and maintain scalable data applications and processing pipelines.
• Build and maintain data ingestion, transformation, and analytics workflows supporting enterprise applications.
• Develop high-performance processing solutions using Apache Spark with Scala, Python, or Java.
• Work with Hadoop technologies including Hive, HDFS, Sqoop, HBase, and related distributed data platforms.
• Implement and support streaming data solutions using technologies such as Kafka, Spark Streaming, or Flink.
• Optimize data processing performance through effective use of distributed computing concepts, including partitioning, replication, and fault tolerance.
• Create scripts and automation tools using Python or Shell to improve operational efficiency.
• Troubleshoot complex data platform issues, perform debugging, and maintain technical documentation.
• Support cloud-based big data environments and contribute to modernization initiatives when required.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of professional experience designing and operating big data pipelines.
• Strong hands-on experience with Apache Spark in production environments using Scala, Python, or Java.
• Solid expertise with Hadoop ecosystem technologies, including Hive, HDFS, Sqoop, and HBase.
• Experience with streaming platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills and experience working with relational and NoSQL databases.
• Experience with workflow orchestration tools such as Airflow or Oozie.
• Strong understanding of distributed systems architecture and data processing principles.
• Proficiency in Python or Shell scripting.
• Excellent troubleshooting, debugging, analytical, and documentation skills.
• Preferred experience with cloud-based Hadoop platforms such as AWS EMR, Azure HDInsight, or Databricks.
• Familiarity with modern lakehouse technologies including Delta Lake, Iceberg, or Hudi.
• Exposure to data governance tools such as Apache Atlas or Collibra.
• Experience with Kubernetes-based data platforms, CI/CD practices, and infrastructure-as-code solutions.

Benefits

• Competitive annual salary range of $100,000-$150,000, depending on experience and qualifications.
• Full-time direct employment opportunity.
• Opportunity to work on large-scale data engineering and analytics initiatives.
• Exposure to modern big data technologies and enterprise data platforms.
• Career growth opportunities within a technology-focused environment.
• Opportunity to collaborate with experienced engineers and technical teams.
• Inclusive workplace committed to equal employment opportunities.