AI Infrastructure Engineer
Huxley · San Mateo County, CA · 3 mo ago
HybridEngineering$350k–$450k/yrFull-time
Key Responsibilities
- Design, build, and maintain cloud infrastructure, model-serving platforms, and ML pipelines.
- Optimize AI workloads for low-latency inference, high throughput, and cost efficiency.
- Develop and manage CI/CD pipelines for model deployment, monitoring, and versioning.
- Implement auto-scaling, failover, disaster recovery, and high-availability solutions.
- Manage observability through monitoring, logging, alerting, and incident response processes.
- Ensure security, compliance, and best practices across AI infrastructure.
- Partner with engineering teams to enable rapid and safe deployment of AI features.
Requirements
- 8+ years of experience in Infrastructure Engineering, DevOps, SRE, or related fields.
- Strong experience with cloud platforms and large-scale production systems.
- Hands-on experience with CI/CD, automation, and infrastructure as code.
- Expertise with PostgreSQL, Redis, and distributed systems.
- Experience supporting LLM deployments, model-serving infrastructure, and vector databases.
- Strong knowledge of GPU optimization.
Compensation
Compensation: $200k - $250k on Base + Equity + Bonus + Benefits (Up to $350k-450k)
Work Environment
Hybrid (Tue/Wed/Thu in office)