Distinguished, Software Engineer

About the Team

Building the right technology foundation for Infrastructure & platforms is vital to success at the scale of Walmart. Our team builds and maintains the foundational technologies that support the tech organization. Included in this are data platforms, enterprise architecture, DevOps, cloud computing, and infrastructure. All of these products and services are supported by scalable and powerful infrastructure, ensuring a secure and seamless employee and customer experience across stores, digital channels, and distribution centers.

Responsibilities

• Work closely with Fellow Engineers, Engineering teams, and Product groups to provide highly recommended Developer Experience and Gen AI solutions to make development delightful.
• Build highly scalable and reliable solutions that drive the next generation of AI systems.
• Independently handle high-impact, critical software/systems monitoring issues and troubleshoot business and production issues.
• Agentic Frameworks: Design, develop, fine-tune, and deploy Generative AI models with a focus on RAG frameworks to enhance information retrieval and generation.
• Develop and optimize LLM-based agents for tasks like knowledge grounding, multi-step reasoning, and decision-making.
• Integrate external data sources (e.g., vector databases) with LLMs to build dynamic, context-aware systems.
• Architecture & Scalability: Develop scalable, distributed AI systems with a focus on performance, fault tolerance, and disaster recovery.
• Create detailed design specifications, including modular, extensible, and functional components.
• Develop MVPs into shippable products to validate requirements and refine designs iteratively.
• Provide deeper insights on containerization/Docker and experience in CI/CD and deployment pipelines.
• Collaboration & Product Integration: Work cross-functionally to design solutions that address both functional and non-functional requirements.
• Establish best practices for building and maintaining AI-driven systems.
• Drive technical direction for large-scale AI initiatives and mentor junior engineers.
• Build tech stack ground up and deploy scalable solutions as a hands-on engineer.
• Product Development: Create highly resilient distributed systems capable of operating reliably across large fleets of retail devices with remote observability and recovery.

Qualifications

• Overall 12+ years of experience in machine learning/software engineering, with 2+ years in Generative AI or LLMs.
• Strong experience with Agentic Frameworks, RAG frameworks, vector search technologies, and knowledge grounding techniques.
• Expertise in Python, ML frameworks (PyTorch, TensorFlow), and libraries like Hugging Face Transformers.
• Proficiency in distributed computing, cloud platforms (GCP, Azure), and scalable architectures.
• Deep knowledge of open-source projects or publications in Generative AI, RAG, or agentic frameworks.
• Strong backend programming experience in Python, Golang, Java, or TypeScript.
• Strong hands-on engineering background with the ability to operate at both strategic and implementation levels.
• Experience applying LLMs and agentic AI techniques to production systems.
• Proven ability to influence technical direction and mentor senior technical contributors.
• Clear communication, including the ability to bridge design gaps.
• Ability to multitask between several different requirements and features concurrently.
• Passion for technology and ability to perform in a team environment.

Preferred Qualifications

• Experience in Gen AI – Agentic Frameworks, RAG Frameworks.
• Cloud architecture and deployments: Kubernetes, Docker, microservices architectures (REST).
• Hands-on experience with Generative AI, LLMs, RAG, or agentic AI frameworks.
• Familiarity with cloud-native infrastructure and real-time distributed systems.
• Background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly.

Benefits

• Health benefits: Medical, vision, and dental coverage.
• Financial benefits: 401(k), stock purchase, and company-paid life insurance.
• Paid time off: PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
• Short-term and long-term disability.
• Company discounts.
• Military Leave Pay.
• Adoption and surrogacy expense reimbursement.
• Education benefits: Live Better U – Walmart-paid education benefit program for full-time and part-time associates. Programs range from high school completion to bachelor’s degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific plan or program terms.

Pay

The annual salary range for this position is $169,000.00 - $338,000.00. Additional compensation includes annual or quarterly performance bonuses. Additional compensation for certain positions may also include stock.