Lead Cloud Data Platform Engineer - NC, AZ, MN, TX

About the role

This contingent resource assignment involves consulting on complex initiatives with broad impact and large-scale planning for Software Engineering. The Lead Cloud Data Platform Engineer will build next-generation data products and AI-enabled automation capabilities supporting the Cyber Security Data Ecosystem.

Responsibilities

• Design, develop, and operationalize cloud-native data platforms on Google Cloud.
• Build scalable data ingestion, transformation, and distribution pipelines using Spark-based technologies.
• Develop AI-enabled data products and automation capabilities.
• Leverage Agentic AI frameworks including LangChain, LangGraph, ADK, MCP, RAG, and GraphRAG.
• Implement AI-driven solutions for Data Governance, Data Quality, Metadata Management, Data Compliance, and Data Discovery.
• Design and support Data Lakehouse architecture and cloud analytics platforms.
• Collaborate with principal engineers, product managers, and data engineering teams to define and deliver strategic data capabilities.
• Support cloud migration initiatives and modernization efforts.
• Promote engineering best practices and mentor team members on modern cloud and AI technologies.

Requirements

• Experience: 5+ years of Software Engineering experience, or equivalent through work or consulting experience, training, military experience, or education.
• Technical Skills: Strong experience with Cloud Data Engineering on Google Cloud Platform (GCP) including BigQuery, DataProc, Cloud Storage, and Cloud Composer. Hands-on experience with AI/Agentic frameworks including LangChain, LangGraph, ADK, RAG, GraphRAG, MCP, and agent-based architectures. Experience building and supporting large-scale data pipelines using Python, PySpark, Kafka, Spark Streaming, Flink, and Airflow.

Preferred Qualifications

• Experience developing AI-powered data products and automation frameworks.
• Experience with Data Lakehouse architecture and large-scale analytics platforms.
• Cybersecurity data or security analytics experience.
• Experience leading cloud migration initiatives.