Principal Engineer I - Principal Data Platform Engineer

About the role

The Network Engineering team is responsible for the implementation of approved network architecture and designs. This Principal Engineer position leads the architecture, engineering, administration, and strategic evolution of our Hadoop-based big data platform. This role defines the technical direction of the enterprise data ecosystem, ensures platform scalability, reliability, security, and operational excellence.

Responsibilities

• Owns the architecture, design, and lifecycle management of enterprise Hadoop clusters and supporting data platform services.
• Leads administration of Hadoop ecosystem components such as HDFS, YARN, Hive, HBase, Spark, Kafka, Oozie, ZooKeeper, Impala, and related tooling.
• Defines platform standards for availability, performance, capacity planning, disaster recovery, backup, monitoring, and security.
• Drives infrastructure optimization across storage, compute, workload management, and job scheduling.
• Establishes best practices for cluster provisioning, configuration management, patching, upgrades, and decommissioning.
• Partner with data engineering, analytics, security, and infrastructure teams to support data ingestion, processing, governance, and access patterns.
• Troubleshoot complex platform, performance, and production stability issues across distributed systems.
• Lead root cause analysis and implement preventive measures to improve resiliency and service quality.
• Evaluate and guide migration or coexistence strategies involving cloud data platforms and hybrid architectures.
• Mentor engineers and administrators, providing technical leadership across platform operations and engineering initiatives.
• Create and maintain platform documentation, operational runbooks, and architecture standards.
• Create and maintain data views, data exports and automated data processing.

Requirements

• Master’s or bachelor's degree in Engineering or related field or related work experience.
• 5+ years engineering work experience.
• 5+ years project management work experience.

Qualifications

• Basic knowledge of related industry specifications and standards.
• Basic knowledge in network design, network architecture, protocols and network topology.
• Basic knowledge in TCP/IP and the OSI Model.
• Basic knowledge in using ticketing and software tools to support the current operations.
• Basic knowledge of network devices and basic network appliances.
• Basic knowledge of network designing software, such as Visio.
• Ability to perform duties in a very fast-paced environment and ability to learn new technology quickly.
• Ability to use personal computer and software applications.

Skills

• Ability to read, write, speak and understand English.
• Experience with Python / Typescript.
• Experience with Django/Flask/FastAPI.
• Experience with Shell scripting, TCP/IP and networking concepts, system security best practices and system monitoring.
• Experience working in DevOps practices and tools.
• Experience with Hadoop and other database technologies, like Postgresql/MySQL, Splunk.
• Experience with container technologies such as Docker, Kubernetes, etc.
• Advanced knowledge of network automation platforms and techniques.
• Advanced knowledge of concurrent, parallel and asynchronous programming design and techniques.
• Advanced knowledge of restful API design, operation and interaction.
• Working knowledge of PEP8 programming practices.
• Knowledge of RFC and IEEE standards and concepts.

Benefits

This job posting will remain open until 2026-07-27 04:00 AM (UTC) and will be extended if necessary. The base pay for this position generally is between $110,800.00 and $196,400.00. The actual compensation offered will carefully consider a wide range of factors, including your skills, qualifications, experience, and location. We comply with local wage minimums and also, certain positions are eligible for additional forms of other incentive-based compensation such as bonuses.