AI Engineer

About the role

This role involves developing and integrating AI solutions, focusing on GPU-accelerated inference services. It also includes building robust data pipelines for processing large volumes of documents and files, optimizing GPU configurations for efficient inference, implementing parallel and concurrent processing, and contributing to a dynamic team pushing the boundaries of AI technology.

Responsibilities

• Develop and integrate AI solutions, focusing on GPU-accelerated inference services
• Build robust data pipelines for processing large volumes of documents and files
• Optimize GPU configurations for efficient inference, considering memory, batch size, and concurrency
• Utilise containerisation (Docker) and orchestration (Kubernetes) for scalable deployments, including GPU scheduling
• Implement parallel and concurrent processing to ensure high-throughput pipelines
• Contribute to a dynamic team pushing the boundaries of AI technology

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Strong proficiency in Python for development and integration
• Hands-on experience deploying GPU-accelerated inference services, ideally with NVIDIA NIM
• Proven ability to build data pipelines and process large datasets (e.g., OCR, document AI)
• Solid understanding of GPU configurations (memory, batch size, concurrency, MIG/MPS)
• Experience with Docker and Kubernetes for containerisation and orchestration, particularly with GPU scheduling

Qualifications

Commensurate with experience.

Skills

• Python programming
• GPU-accelerated inference services
• Data pipeline development
• Containerization and orchestration (Docker, Kubernetes)
• GPU configurations (memory, batch size, concurrency, MIG/MPS)

Benefits

Opportunity to work on cutting-edge AI and GPU acceleration technologies, engage in challenging and impactful projects, and collaborate in a collaborative and innovative work environment. Significant contributions to a leading tech firm's success.

Pay

TBD

Schedule

TBD

Benefits

TBD

Apply via Haystack today!