Senior MLOps Engineer, LLMOps

About the role

As a Senior MLOps Engineer With a Focus In LLMOps, you'll be at the core of building and scaling the technical infrastructure for AI/ML systems. You will build reusable CI/CD workflows for model training, evaluation, and deployment, automate model versioning, approval workflows, and compliance checks across environments. You will build out a modular and scalable AI infrastructure stack, including vector databases, feature stores, model registries, and observability tooling. You will partner with engineering and data science to embed AI models and agents into real-time applications and workflows. You will continuously evaluate and integrate state-of-the-art AI tools, drive AI reliability and governance, and enable researchers to iterate quickly by providing sandboxes, dashboards, and reproducible environments.

What We’re Looking For

• Write high-quality, maintainable software — primarily in Python, but we value engineering ability over language familiarity.
• Have a strong background in scalable infrastructure, including: Containerization and orchestration (e.g. Docker, Kubernetes), Infrastructure-as-code and deployment (e.g. Terraform, CI/CD pipelines), Monitoring and logging frameworks (e.g. Datadog, Prometheus, OpenTelemetry).
• Understand and implement ML Ops best practices, including: Model versioning and rollback strategies, Automated evaluation and drift detection, Scalable model and agent serving infrastructure (e.g. vLLM, Triton, BentoML).
• Deploy and maintain LLM and agentic workflows in production, including: Monitoring cost, latency, and performance, Capturing traces for analysis and debugging, Optimizing prompt/response flows with real-time data access.
• Show strong ownership and pragmatism, balancing infrastructure elegance with iterative delivery and measurable impact.

Compensation

The estimated base salary range for this role is $200,000 - $275,000. Additionally, this role may be eligible to participate in TRM’s equity plan.

Life at TRM

• We move quickly. We are a high velocity, high ownership team that expects clarity, follow-through, and impact.
• We thrive in situations that are not always fully defined. We are energized by hard problems, experimentation, and continuous feedback.
• We are a mission-driven team that builds a safer world for billions of people.

Literature on TRM's Engineering Levels

• Engineer: Responsible for helping to define project milestones and executing small decisions independently with the appropriate tradeoffs between simplicity, readability, and performance. Provides mentorship to junior engineers, and enhances operational excellence through tech debt reduction and knowledge sharing.
• Sr. Engineer: Successfully designs and documents system improvements and features for an OKR/project from the ground up. Consistently delivers efficient and reusable systems, optimizes team throughput with appropriate tradeoffs, mentors team members, and enhances cross-team collaboration through documentation and knowledge sharing.
• Staff Engineer: Drives scoping and execution of one or more OKRs/projects that impact multiple teams. Partners with stakeholders to set the team vision and technical roadmaps for one or more products. Is a role model and mentor to the entire engineering organization. Ensures system health and quality with operational reviews, testing strategies, and monitoring rigor.

Additional Information

By submitting your application, you agree to allow TRM Labs to process your personal information in accordance with our Privacy Policy. We collect the information you provide (such as your resume, work history, and contact details) solely for the purpose of evaluating your candidacy for current and future roles at TRM. Because our hiring cycles for certain positions may span 24 to 36 months, we retain your personal information for up to 36 months from the date of your application. After that period, your data is deleted unless a different retention period is required or permitted by law. If you are located in the European Economic Area, the United Kingdom, or another jurisdiction with applicable data protection laws, you have the right to access, correct, or request deletion of your personal data at any time before that period ends. To exercise any of these rights, contact us at privacy@trmlabs.com.