AI PIPELINE ENGINEER

Responsibilities

• Design and implement AI pipelines for data ingestion, processing, and model deployment using frameworks like LangChain and Open WebUI.
• Develop and manage embeddings databases to support semantic search, recommendation systems, and other AI-driven applications.
• Integrate AI solutions with cloud platforms such as Azure Foundry to ensure scalability, reliability, and security.
• Collaborate with cross-functional teams to identify requirements and deliver AI solutions tailored to business needs.
• Optimize AI workflows for performance and efficiency, ensuring seamless integration with existing systems.
• Stay updated on the latest advancements in AI tools, frameworks, and methodologies to continuously improve pipeline performance.
• Document processes, workflows, and best practices for AI pipeline development and maintenance.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related STEM field.
• 3-5 years of experience working on AI pipelines, including data processing, model deployment, and integration.
• Proficiency in frameworks such as LangChain, Open WebUI, and embeddings databases.
• Experience with cloud platforms like Azure Foundry for AI solution deployment.
• Strong programming skills in Python or similar languages, with a focus on AI and data processing libraries.
• Ability to work independently while collaborating effectively with team members.
• Excellent problem-solving skills and attention to detail.

Desired Qualifications

• Familiarity with semantic search and recommendation systems.
• Knowledge of distributed systems and scalable architectures for AI pipelines.
• Experience with containerization tools like Docker and orchestration platforms like Kubernetes.
• Understanding of MLOps practices for continuous integration and deployment of AI models.
• Strong written and verbal communication skills to document and present technical solutions.