AI Operations Platform Consultant
About the role
The AI Operations Platform Consultant will be responsible for operating large-scale GPU-accelerated AI platforms, deploying and managing LLM inference systems on Kubernetes with strong expertise in Triton Inference Server and TensorRT-LLM.
Responsibilities
- Built and optimized production-grade LLM pipelines with GPU-aware scheduling, load balancing, and real-time performance tuning across multi-node clusters.
- Led end-to-end LLMOps processes involving model versioning, engine builds, automated rollouts, and secure runtime controls.
- Developed comprehensive observability for inference systems, using telemetry and custom dashboards to track GPU health, latency, throughput, and service availability.
- Incorporated advanced optimization methods such as mixed precision, quantization, sharding, and batching to improve efficiency.
Requirements
- Extensive experience operating large-scale GPU-accelerated AI platforms.
- Strong expertise in Triton Inference Server and TensorRT-LLM.
- Experience with deploying, configuring, and tuning LLMs using TensorRT-LLM and Triton Inference server.
- Experience with MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production.
- Experience with setting up and operating AI inference service monitoring for performance and availability.
- Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.
- Experience with standard processes for operation of a mission critical system – incident management, change management, event management, etc.
- Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.
- Experience with standard processes for operation of a mission critical system – incident management, change management, event management, etc.
- Experience with deploying and managing LLMs in production environments, including containerization, microservices, and API design.
- Experience with Triton Inference Server, including its architecture, configuration, and deployment.
- Experience with model optimization techniques using Triton with TRTLLM.
- Experience with model optimization techniques, including pruning, quantization, and knowledge distillation.
Qualifications
- US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, L2-EAD, GC-EAD.
Skills
- Platform Engineering
- AI Infrastructure
- Operational Experience
- High-Performance LLM Systems
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)
Schedule
Not specified.
Benefits
Not specified.
Pay
Depending on Experience (DOE)