Sr. Software Engineer II - AI

About the role

The Sr. Software Engineer II - AI will lead the build of GenAI-powered product experiences and the shared AI platform infrastructure that powers them. This includes RAG pipelines over the iHerb catalog and customer reviews, LLM-driven personalization, a conversational Wellness Agent, agentic workflow systems, and the evals and MLOps layer that makes AI features production-grade and repeatable. Specializations within this track include: RAG and personalization, agent framework and tool use, evals and guardrails, and LLM application development for internal business functions such as marketing automation and BI agents.

Responsibilities

• Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation.
• Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability.
• Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces.
• Evaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using data.
• Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code.
• Cook up the Personalization team to align GenAI product features with existing ML personalization signals.
• Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base.
• Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents.

Knowledge, Skills and Abilities

• AI-driven SDLC: hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor.
• Full-stack awareness: comfortable contributing across layers of the stack when needed.
• Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call.
• Code quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CD.
• Autonomous: drives technical decisions within the team; mentors junior engineers.
• Python proficiency; comfortable building and operating production LLM applications.
• Specializations: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM-based workflow automation.
• Attention to detail: understanding of prompt engineering, context window management, and LLM output quality tradeoffs.
• Familiarity with vector databases, embedding models, or semantic search.

Experience Requirements

Generally requires a minimum of 10+ years of software engineering experience.

Education Requirements

Bachelor’s Degree in Computer Science or related field preferred, or a combination of education and equivalent work experience.

Equipment Knowledge

• Experience with Microsoft Office Suite (Word, Excel, PowerPoint).
• Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred.

Pay

The anticipated pay scale for this position can be found below, however the pay range applicable to you may vary by geographic location based on where the job is located or where you work. The final pay offered to a successful candidate will be dependent on several factors that may include but are not limited to the type and years of experience within the job, the type of years and experience within the industry, education, etc. iHerb, LLC is a multi-state employer and this pay scale may not reflect positions that work in other states or locations.

Benefits

Employees (and their families) that meet eligibility criteria as outlined in applicable plan documents are eligible to participate in our medical, dental, vision, and basic life insurance programs and may enroll in our company’s 401(k) plan. Employees will also be eligible for Time Off and Paid Sick Leave pursuant to the company’s policies. Employees will enjoy paid holidays throughout the calendar year. Eligibility requirements for these benefits will be controlled by applicable plan documents.

About iHerb

iHerb is on a mission to make health and wellness accessible to all. We offer Earth’s best-curated selection of health and wellness products, at the best possible value, delivered with the most convenient experience.

iHerb Benefits

At iHerb, we are dedicated to offering programs designed to help our employees and their families stay healthy, live well, and plan for their financial future. Built on a strong foundation, our programs provide options and upgrades with flexibility, protection, and security in mind. For the comprehensive benefits list, visit www.iHerbBenefits.com. For our international team members, you may be eligible for benefits depending on the country where you are employed. The Talent Acquisition Partner/local HR representative will go over the benefits you are eligible for.

Equal Opportunity Employer

iHerb provides equal employment opportunities to all applicants for employment and prohibits discrimination and harassment.