Consultant, Data & AI Engineer
IBM · Bloomington, IN · 2 wk ago
HybridFull-time
About the role
A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences. This job can be performed from anywhere in the US.
Responsibilities
- Data Pipeline Development: Design, build, and operate ETL / ELT ingestion pipelines and data warehouse / lakehouse models on Snowflake, including structured and unstructured sources feeding downstream analytics and AI use cases.
- AI Solution Development: Build, evaluate, and deploy LLM-based applications (RAG, agents, document intelligence, conversational interfaces) and classical ML models that solve concrete client business problems.
- AI-Ready Data Engineering: Prepare, chunk, embed, and govern data for AI consumption, including vector search, feature pipelines, and semantic layers, with attention to data quality, lineage, and access control.
- Snowflake AI Platform: Implement solutions using Snowflake Cortex (LLM functions, Cortex Search, Cortex Analyst, Cortex Agents), Snowpark, and related services, and integrate with external model providers and cloud AI services where appropriate.
- Evaluation and Reliability: Define evaluation datasets and metrics for AI outputs, implement testing, observability, and guardrails, and iterate on prompts, retrieval, and model selection based on measured results.
- Implementation and Deployment: Deploy solutions to cloud environments (AWS, Azure, GCP, Snowflake) with CI/CD, version control, and infrastructure-as-code practices, ensuring scalability, cost efficiency, and performance.
- Client Engagement: Understand client requirements, present technical options and trade-offs, and work with client teams to integrate data and AI solutions into their business processes.
- Governance and Security: Apply data governance, privacy, and responsible AI practices, including PII handling, role-based access, and auditability, across both data and AI components.
- Documentation and Knowledge Transfer: Produce clear documentation for pipelines, models, prompts, and architectures to enable client handoff and internal reuse.
- Continuous Learning: Track developments in the Snowflake and AI ecosystems and bring practical recommendations to engagements and to the practice.
Requirements
- Spanning data engineering (data management, database development, ETL / ELT, data warehousing) and applied AI or machine learning; consulting or professional services experience is highly desirable.
- Strong SQL and Python; experience with dbt, Spark, or Snowpark for transformation.
- Experience building ETL / ELT ingestion pipelines and developing data warehouses on a cloud data platform (Snowflake preferred; Redshift, BigQuery, Databricks also relevant).
- Hands-on experience building LLM-based applications: prompt engineering, retrieval-augmented generation, vector stores and embeddings, and orchestration frameworks (for example LangChain, LlamaIndex, or equivalent).
- Working knowledge of ML fundamentals (supervised and unsupervised learning, model evaluation) and of the trade-offs between LLM, classical ML, and rules-based approaches.
- Proficiency with cloud platform services for data and AI workloads (AWS, Azure, or GCP), including managed database and data processing services.
- Experience with software engineering practices: Git-based version control, automated testing, CI/CD, and code review.
- Understanding of data governance, security, and compliance best practices as applied to both data pipelines and AI systems.
- Strong communication skills