Senior Voice Infrastructure Engineer
AethexAI · Indiana, United States · 1 wk ago
Information TechnologyFull-time
About the role
Every voice conversation on our platform is a race against a latency budget: speech in, transcription, a language model, speech back out, all on GPUs, all in the time before a human starts to feel the lag. We run that pipeline across Africa and the Middle East, over noisy lines and real dialects, under infrastructure constraints most companies never have to design around. You'll own the systems that make it fast, reliable, and affordable at scale.
Responsibilities
- Serving STT, LLM, and TTS models on GPU under hard latency budgets, and the fleet behind them
- Cost-per-minute as a first-class metric you're accountable for driving down
- Reliability, observability, and on-call posture across the whole platform
- Security and compliance for a multi-tenant system handling voice and PII across regions
- The major architectural calls, made independently and fast
Requirements
- 5+ years running infrastructure in production, not just building it
- Hands-on GPU inference serving at low latency, and managing GPU fleets and their cost
- Fluency with Kubernetes, cloud infra (AWS ideally), and infra-as-code
- Familiarity with the inference serving ecosystem (vLLM, Triton, TensorRT-LLM or similar)
- A track record of owning complex systems end to end, and shipping from zero with little guidance
Nice to have
- Real-time or low-latency background: telephony, streaming, audio, or voice
- First infra hire or founding-era engineer at an early-stage startup
- FinOps instincts at scale
- Genuine interest in emerging markets or speech tech
Schedule
London-based, in-office.