Lead Data Engineer

This is a Fully Remote Job About Our Client:This organization operates within the Search AI industry, addressing the challenge of enabling real-time access to comprehensive data at scale. Their platform integrates search precision with AI intelligence to help businesses and individuals accelerate valuable outcomes. Serving over half of the Fortune 500, the company offers cloud-based solutions focused on search, security, and observability, emphasizing effective data use while securing private information. About the Opportunity:The LEAD DATA ENGINEER will play a key role in developing and enhancing the Data Platform to enable teams across the organization to work with data confidently and efficiently. This position supports business objectives by ensuring data pipelines are reliable and data outputs are trustworthy and actionable. The role combines technical expertise in data engineering with collaboration and knowledge sharing to maximize platform utilization. Responsibilities:Design, maintain, and improve data pipelines and infrastructure across the full data lifecycleWork with technologies such as Apache Airflow, Spark, Iceberg, Kafka, Flink, and dbt LabsCollaborate with stakeholders to define data flow requirements and co-create data contractsDocument processes clearly and guide teammates in platform useMonitor pipeline performance and refine processes for smooth operationsUse Terraform for provisioning and managing Google Cloud Platform resourcesReview code and enforce best practices and standardsProcess access requests and support compliance with platform policies Requirements:At least 8 years of experience in data engineering or related rolesProficiency with Apache Airflow for data workflow orchestrationExperience with Spark, Flink, Kafka, and dbt Labs for data processing and transformationUnderstanding of Apache Iceberg data formats and warehouse/lakehouse strategiesSkilled in Terraform for infrastructure-as-code deploymentsProficient in Bash, Python, and SQL programming languagesKnowledge of OLAP, OLTP, Document, and Vector database systemsExperience with Google Cloud Platform resource managementBonus: Experience with data security and access controls for SOX ComplianceBonus: Familiarity with the Elastic stack Pay Range and Compensation Package:The typical starting salary range for this role is $113,100 to $178,900 USDIn select locations (Seattle WA, Los Angeles CA, San Francisco Bay Area CA, New York City Metro Area), the range is $135,900 to $215,100 USDThis role offers base salary without variable compensationEligible to participate in the company’s stock programIncludes company-matched 401(k) plan with dollar-for-dollar matching up to 6% of eligible earnings Benefits & Perks:Health coverage for employees and families in many locationsFlexible scheduling and location options for many rolesGenerous vacation allowanceMatching donation program up to $2000 or local equivalentUp to 40 hours annually for volunteer projectsMinimum 16 weeks of parental leave Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin. Note:TalentHop is a recruitment partner of this role. Please note that all employment decisions, including candidate assessment, interviews, hiring, compensation, and employment terms, are made exclusively by the hiring employer.