Staff Inference Engineer - AI

About the role

Thomson Reuters is seeking a Staff Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI workloads and work with Product, Data Science, Architecture, and Enterprise AI teams to onboard new research models into production. Within Platform Engineering and Enterprise AI Services, an AI Inference Engineer is responsible for productionizing, optimizing, and scaling AI and LLM workloads that power TR's AI driven products. This role ensures that trained models—from classical ML to generative AI—run efficiently across TR's multi cloud footprint (AWS, Azure, GCP, OCI), meet strict enterprise reliability requirements, and integrate seamlessly with the data backbone (Snowflake, OpenSearch vector search, API managed model routing). The successful candidate will help build the next generation of TR's AI infrastructure, working alongside cloud engineering, data engineering, product teams, and AI Services.

This position is open due to an existing vacancy to support evolving business needs.

Responsibilities

• Optimize LLMs and ML models for high-performance inference using techniques such as quantization, pruning, distillation, and hardware specific tuning
• Deploy and scale inference workloads on GPUs across AWS, Azure, GCP and internal Kubernetes clusters, ensuring predictable performance during peak traffic hours, especially during business hours
• Implement routing and failover strategies for OpenAI/Anthropic/Vertex AI traffic
• Integrate models into production grade APIs supporting TR products and enterprise workflows
• Develop highly optimized environment and eliminate performance bottlenecks to reduce latency
• Collaborate with Platform Engineering teams (Landing Zones, Network, Storage, Compute, AI) to ensure inference workloads align with TR's cloud native patterns (AWS, Azure, GCP, OCI)
• Build and optimize containerized inference pipelines using Kubernetes for large-scale distributed workloads
• Ensure compliance with TR's AI standards for deployment, monitoring, governance, and drift detection
• Profile inference performance, identify GPU/CPU bottlenecks, and optimize compute utilization across heterogeneous hardware
• Implement observability and health monitoring for inference pipelines, ensuring reliability of enterprise AI services
• Collaborate closely with AI engineers to invent new quantization techniques, improve numerical precision, and explore non‑standard architectures, and support the scale out of AI infrastructure during critical releases and global product rollouts
• Partner with Cloud Engineers (Azure, AWS, GCP) to develop guardrails and automation that support inference workloads

Requirements

• 7+ years of relevant experience
• Strong understanding of ML/LLM fundamentals and inference optimization techniques
• Hands-on experience with GPU programming (CUDA preferred), inference runtimes (TensorRT, ONNXRuntime), and deep learning frameworks (PyTorch/TensorFlow)
• Proficiency in Python and at least one systems language (C++ strongly preferred for performance‑critical inference paths)
• Experience deploying AI workloads to AWS/GCP/Azure and Kubernetes

Preferred qualifications

• Familiarity with vector search systems (OpenSearch vectors) and retrieval augmented generation pipelines
• Knowledge of distributed systems, microservices, CI/CD, and cloud native architecture

Benefits

Thomson Reuters offers a flexible hybrid working environment for office‑based roles, with a seamless experience that is digitally and physically connected. Flex My Way policies support work‑life balance, including work from anywhere for up to 8 weeks per year. Career development is fostered through continuous learning, the Grow My Way program, and a skills‑first approach.

• Comprehensive benefit plans including flexible vacation, two company‑wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing
• Globally recognized, award‑winning culture for inclusion and belonging, flexibility, work‑life balance, and values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, Stronger Together
• Social Impact Institute: two paid volunteer days off annually, pro‑bono consulting projects, and Environmental, Social, and Governance (ESG) initiatives
• Market competitive health, dental, vision, disability, and life insurance programs
• Competitive 401k plan with company match
• Competitive vacation, sick and safe paid time off, paid holidays (including two company mental health days off), parental leave, sabbatical leave
• Optional hospital, accident and sickness insurance (employee paid); optional life and AD&D insurance (employee paid)
• Flexible Spending and Health Savings Accounts; fitness reimbursement; Employee Assistance Program
• Group Legal Identity Theft Protection benefit (employee paid); access to 529 Plan; commuter benefits
• Adoption & Surrogacy Assistance; Tuition Reimbursement; Employee Stock Purchase Plan

Pay

For eligible US locations, the base compensation range for this role is $127,400 USD – $236,600 USD. For Ontario, Canada, the base compensation range is $140,000 CAD – $175,000 CAD. Base pay is positioned within the range based on knowledge, skills, experience, and internal equity. Base pay is one part of a comprehensive Total Reward program which also includes flexible and supportive benefits and other wellbeing programs. This role may also be eligible for an Annual Bonus based on a combination of enterprise and individual performance.

About us

Thomson Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the right decisions. We serve professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and to help institutions in their pursuit of justice, truth, and transparency. Reuters, part of Thomson Reuters, is a world leading provider of trusted journalism and news. We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them.