Hadoop Big Data Developer

About the role

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a 100% remote (U.S.) full-time, Direct W2 position. U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply; note that the company is unable to sponsor new H-1B visa petitions for this role.

Responsibilities

• Design, build, and operate large‑scale data processing pipelines and analytics platforms on Hadoop and related big‑data ecosystems.
• Ingest, transform, and analyze massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of professional experience designing and operating big‑data pipelines on Hadoop.
• Strong hands‑on expertise with Apache Spark (Scala, Python, or Java) in production environments.
• Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
• Hands‑on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills and experience working with both relational and NoSQL data stores.
• Experience with workflow orchestration tools such as Airflow or Oozie.
• Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
• Strong scripting skills in Python or Shell.
• Excellent troubleshooting, debugging, and documentation skills.

Qualifications

• Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.
• Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).
• Exposure to data governance tooling such as Apache Atlas or Collibra.
• Experience with Kubernetes‑based data platforms (Spark‑on‑K8s, Trino).
• Hands‑on experience with CI/CD and infrastructure‑as‑code in data engineering workflows.

Pay

Salary range: $86,000–$103,000 annually.

Schedule

Full‑time position.