LLM-инженер в Финтех

About the Company

Yandex Fintech creates complex services to simplify payments and savings for individuals and implements features for businesses. We combine advanced technologies with a sense of humor and revolutionary features with parties.

Responsibilities

• Development of agent systems: Full-cycle development from scenario design and architecture selection to deployment, monitoring, and quality iterations. You will create a working product with tool calling, fallback logic, and measurable results—not just write prompts.
• RAG (Retrieval-Augmented Generation): Handle generation from understanding user data needs to building a pipeline that reliably finds information, generates answers, and includes an evaluation system to validate results.
• Infrastructure and quality: Deploy and operate LLM models within banking infrastructure, monitor and ensure observability of agents, automate experiments, and conduct offline evaluations.

Learn more about ML at Yandex in the Yandex for ML channel.

Requirements

• Built RAG systems, including experimentation, operation, quality evaluation, and knowledge of multiple ways to modify standard RAG pipelines for improved performance.
• Worked with vLLM or other inference engines, understanding the nuances of multi-GPU model parallelization.
• Can write production-grade Python code: know how to write agent code, wrap it in a service, and correctly use different types of parallelism.
• Understand LLM application architecture and modern approaches to building agent systems.
• Proficient in one of the agent frameworks: LangGraph, LangChain, Crew AI, Pydantic AI, or equivalents.
• Understand how LLM-based systems are evaluated and measured, and are familiar with observability tools.
• Know how to work with Docker, Bash, and Zsh.
• Actively use AI in your work, understand its applications, and leverage modern LLM systems for coding and other tasks.
• Stay updated on developments in AI agents and LLMs, and experiment with new approaches in work or pet projects.

Benefits

• Comprehensive health insurance starting from the first month, including:
  • Dental care
  • Annual check-ups
  • Emergency care abroad
  • Treatment for critical illnesses, including oncology
  • Accident insurance
  • Psychotherapy (in-office or online)
  • Laser vision correction after one year of employment
  • Pregnancy and childbirth coverage after two years of employment
• Family health insurance: We cover 80% of the cost of health insurance for children and spouses; you cover the remaining 20%.