Staff, Software Engineer - Python/GenAI

Position Summary

The Enterprise People Technology team supports the successful deployment and adoption of new People technology across the enterprise. As a Fortune #1 company, our work impacts millions of associates globally. We strive to continuously improve people technology and products to help managers and associates so they can focus on what matters most—supporting our customers and members.

About Team

Walmart’s Associate Experience Platform team is seeking an exceptional Staff Software Engineer to strengthen our GenAI experience platform. You will be hands-on developing critical platform capabilities with cutting-edge GenAI technologies, building reusable and extensible platform services, and ultimately bringing GenAI to the day-to-day of 2.2M Walmart associates worldwide.

What you'll do

• Design and develop platform features enabling advanced semantic routing for GenAI-powered services, ensuring requests are intelligently directed to the most appropriate models or agents based on context and intent.
• Build and maintain evaluation pipelines for semantic router data, including the development of metrics, dashboards, and automated tests to assess routing accuracy, system performance, and user satisfaction.
• Collaborate with applied researchers and data scientists to continuously improve semantic routing algorithms and integrate the latest advancements in natural language understanding.
• Develop and implement agent-to-agent (A2A) communication protocols to enable seamless orchestration and collaboration between multiple GenAI agents and services within the platform.
• Contribute to the design and development of platform features using microservices (FastAPI) and event-driven architecture (Kafka, SSE, WebSocket)—all in Python.
• Uphold engineering and operational excellence standards, embracing automation and the DRY (Don’t Repeat Yourself) principle.
• Support operational excellence for semantic routing and agent communication systems, including monitoring, troubleshooting, and participating in on-call rotations for production support.
• Stay current with GenAI and multi-agent system best practices, adopting new solutions to enhance platform intelligence, reliability, and scalability.
• Be an active member of a dynamic team, contributing to code reviews, design discussions, and collaborative problem-solving.
• Support production operations by participating in on-call rotations

What you'll bring

• Essential skills:
  • Python guru with a proven track record of writing high-performing, production-quality code.
  • Hands-on experience designing and building Python-based web services in a production setting (FastAPI experience preferred).
  • Deep familiarity with version control using Git in collaborative team environments.
  • Comfortable working with Linux environments and containerization technologies such as Docker.
  • 4+ years of industry experience with demonstrated ownership and delivery of software products.
• GenAI & Semantic Routing Skills (Preferred):
  • Hands-on experience developing or deploying GenAI-based applications (e.g., large language models, generative AI frameworks).
  • Experience working with or integrating open-source and/or commercial GenAI libraries/frameworks such as Hugging Face Transformers, LangChain, OpenAI API, or similar.
  • Ability to productionize and evaluate GenAI models.
  • Familiarity with prompt engineering, vector databases (e.g., Pinecone, FAISS, Weaviate), and orchestration tools for GenAI workflows.
  • Experience with semantic routing, including designing systems that direct user queries or tasks to the appropriate AI agents or models based on content, intent, or context.
  • Ability to analyze, test, and improve semantic routing algorithms and evaluate their effectiveness using data-driven approaches.
  • Awareness of responsible AI principles, including model evaluation, bias mitigation, and production monitoring.

Supplemental skills

• Experience developing large-scale data pipelines in contexts such as e-commerce, recommender systems, or similar domains.
• Exposure to MLOps practices and tools (e.g., MLflow, Kubeflow, Airflow) for managing model lifecycle and deployment.
• Experience with observability and monitoring tools for production AI systems.

Minimum Qualifications

• Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years’ experience in software engineering or related area.
• Option 2: 6 years’ experience in software engineering or related area.

Preferred Qualifications

• Master’s degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area and 2 years' experience in software engineering or related area.
• We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly.

Primary Location

508 Sw 8Th St, Bentonville, AR 72712, United States of America

Additional Compensation

The annual salary range for this position is $110,000.00 - $220,000.00 Additional compensation includes annual or quarterly performance bonuses. Additional compensation for certain positions may also include : Stock