AI Data Engineer – Langchain | AWS | SQL | Onsite (Quad Cities)

Key Responsibilities

• Data Engineering: Design, develop, and manage efficient data pipelines for large datasets, with a focus on scalability and performance.
• Langchain Integration: Leverage Langchain to automate workflows, enhance AI models, and streamline data-driven processes.
• Cloud Infrastructure (AWS): Build and scale cloud data environments using AWS services such as S3, EC2, Lambda, Redshift, and more.
• SQL & Databases: Write advanced SQL queries for data extraction, transformation, and analysis. Ensure database performance and integrity.
• Collaboration: Partner with Data Scientists, AI Engineers, and cross-functional teams to ensure data readiness for machine learning and analytics use cases.
• Data Quality & Governance: Monitor and maintain data quality, implement error-handling procedures, and ensure adherence to privacy and compliance standards.
• Performance Optimization: Continuously improve and fine-tune data pipelines and queries for better performance and scalability.
• Documentation: Create and maintain thorough documentation of data architecture, workflows, and processes for knowledge sharing and collaboration.

Experience

• 3+ years as a Data Engineer, with a focus on AI or machine learning pipelines
• Proven experience using Langchain to develop AI workflows and automation
• Strong experience with large-scale data and distributed systems
• Proficiency in SQL and hands-on experience with both relational (e.g., PostgreSQL, MySQL, SQL Server) and NoSQL databases
• Deep familiarity with AWS services such as S3, EC2, Lambda, Redshift, and RDS
• Technical Skills: Proficient in Python
• Solid understanding of database design, data modeling, and query optimization
• Familiar with data warehousing concepts and tools
• Experience with data pipeline orchestration tools like Apache Airflow (or similar)
• Strong knowledge of AI/ML data workflows, including preprocessing and feature engineering

Education

• Bachelor's or Master's degree in Computer Science, Data Engineering, Artificial Intelligence, or a related field

Soft Skills

• Excellent analytical and problem-solving abilities
• Strong communication skills, especially in explaining complex concepts to non-technical audiences
• Able to manage multiple priorities in a fast-paced environment
• Collaborative and team-oriented work ethic

Preferred Qualifications

• Experience with Apache Spark, Kafka, or other big data tools
• Familiarity with Docker and Kubernetes for deploying scalable data solutions
• Knowledge of AI-specific workflows, such as data preparation for natural language processing (NLP), computer vision, or other AI domains