Founding Engineer - LLM Infra & Platform

Responsibilities

• Own the system for sending requests to multiple AI providers and receiving reliable responses.
• Ensure that 37+ models on the platform reliably handle 30 billion+ monthly tokens.
• Reduce costs and latency for 60k+ daily active users.
• Work on provider reliability, structured outputs, caching, routing, and monitoring.

Requirements

• Obsessed with detail and data-oriented.
• Able to verify everything and be a fast learner with strong fundamentals.
• No prior experience in this exact role is expected, but a strong foundation is required.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Experience with distributed systems and microservices architecture.
• Strong understanding of cloud services and infrastructure (AWS, GCP).
• Proficiency in Python, Go, or similar languages.
• Experience with machine learning and natural language processing.
• Knowledge of API design and integration.

Skills

• Problem-solving skills.
• Attention to detail.
• Ability to learn new technologies quickly.
• Experience with monitoring and logging tools.

Benefits

• Competitive salary including meaningful equity.
• Flexible working hours.
• Opportunity to work in-person in San Francisco, 5+ days/week.
• Sponsorship of visas.

Pay

Compensation will include meaningful equity to reflect your responsibility as a founding engineer.

Schedule

We work in-person in San Francisco, 5+ days/week.