Member of Technical Staff, Infrastructure ($120K – $250K + Equity) at The Token Company

The Token Company is a $12M seed-stage startup backed by First Round Capital, NEA, and YC, building specialized machine learning models to compress LLM inputs. By identifying and removing unimportant data before it hits expensive models, they drastically reduce inference costs for high-scale enterprises and tech companies integrating LLMs into their production workflows.

About the role

You will own the end-to-end cloud infrastructure for a high-performance compression API. This role involves building global, low-latency GPU ML inference systems that sit directly in the critical path of customer traffic. As a core member of a 5-person team, you will drive reliability, scalability, and cost-efficiency for a revolutionary AI product.

Responsibilities

• Architect and manage global, high-throughput GPU inference infrastructure using AWS, Terraform, and Docker to ensure maximum performance and uptime.
• Own the entire infrastructure stack from initial deployment and CI/CD pipelines to long-term reliability and cost-efficiency research.
• Collaborate closely with research and product teams to integrate and scale compression models into a high-traffic production API.

Requirements

• Demonstrated experience building and operating production-grade cloud infrastructure at scale using tools like AWS and Terraform.
• Strong background in managing containerized environments with Docker and establishing robust CI/CD pipelines for high-reliability systems.
• Proven ability to take end-to-end ownership of an infrastructure stack, ideally within a fast-paced startup or high-growth engineering environment.

Qualifications

• Bachelor’s degree in Computer Science, Electrical Engineering, or a related field.
• Experience with Kubernetes, Istio, and other microservices architectures.
• Knowledge of cloud platforms such as AWS, Azure, and Google Cloud.
• Experience with CI/CD pipelines and automation tools.
• Strong problem-solving skills and ability to work independently and in a team.

Skills

• Proficient in Python, Go, or other relevant programming languages.
• Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or ONNX.
• Experience with data compression algorithms and techniques.
• Excellent communication and collaboration skills.

Benefits

• Competitive salary range of $120K – $250K + equity.
• Unparalleled San Francisco living experience with provided housing, food, laundry, and cleaning services.
• Full visa sponsorship.

Pay

$120K – $250K + equity

Schedule

Full-time

Company Description

The Token Company is a $12M seed-stage startup backed by First Round Capital, NEA, and YC, building specialized machine learning models to compress LLM inputs. By identifying and removing unimportant data before it hits expensive models, they drastically reduce inference costs for high-scale enterprises and tech companies integrating LLMs into their production workflows.

Why this role is remarkable

• Join an elite 5-person team backed by $12M from top-tier investors like First Round Capital and founders of Dropbox, Slack, and Supercell.
• Solve critical infrastructure challenges for LLM efficiency, building the low-latency systems that enable enterprises to scale AI cost-effectively.
• Benefit from an unparalleled San Francisco living experience with provided housing, food, laundry, and cleaning services, plus full visa sponsorship.

Jack & Jill

Jack is an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then he helps you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.

Jill is the AI recruiter working for the company. She recruits from Jack's network, making an introduction when she spots an excellent candidate. If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives. We never post fake jobs. This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network. Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description. We appreciate this can make them look a bit suspect, but there isn't much we can do about it. Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.