AI Native Lead Data Engineer

About the role

The successful candidate will be responsible for leading the development and implementation of advanced data engineering solutions, focusing on generative and agentic AI, large language models (LLMs), and AI/ML workloads using cloud-native platforms.

Responsibilities

• Build robust RAG pipelines, embeddings, semantic/vector search, and vector databases for enterprise AI applications.
• Develop and optimize data pipelines using Databricks, PySpark, and other relevant tools.
• Work with Azure AI, AWS Bedrock, and LLMOps to integrate and manage AI/ML models.
• Orchestrate AI agents and LLMs using frameworks like LangChain, LangGraph, and LlamaIndex.
• Collaborate with cross-functional teams to design and implement scalable AI solutions.

Requirements

• Strong experience in Data Engineering, Generative AI, Agentic AI, LLMs, and AI/ML workloads with cloud-native platforms.
• Hands-on expertise in building RAG pipelines, embeddings, semantic/vector search, and vector databases for enterprise AI applications.
• Experience with LangChain, LangGraph, LlamaIndex, or similar frameworks for AI agents and LLM orchestration.
• Proficiency in Databricks, PySpark, and data pipelines.
• Experience with Azure AI, AWS Bedrock, LLMOps, and MLOps.

Qualifications

• PhD or Master's degree in Computer Science, Data Science, or a related field.
• At least 12 years of relevant experience in data engineering and AI/ML.
• Proven track record of delivering high-quality AI solutions in complex environments.

Skills

• Data Engineering
• Generative AI
• Agentic AI
• Large Language Models (LLMs)
• AI/ML Workloads
• Cloud-Native Platforms
• RAG Pipelines
• Embeddings
• Semantic/Vector Search
• Vector Databases
• Databricks
• PySpark
• Data Pipelines
• Azure AI
• AWS Bedrock
• LLMOps
• MLOps
• LangChain
• LangGraph
• LlamaIndex

Benefits

• Competitive compensation package
• Flexible working hours
• Professional development opportunities
• Health and wellness programs

Pay

Compensation is commensurate with experience.

Schedule

The position is full-time, onsite in St. Louis, MO.