AI Software Engineer - Operations

About the role

The AI Software Engineer will focus on designing and building AI-driven applications powered by large language models (LLMs). This role emphasizes application development, user experience, and orchestration rather than model training. The engineer will work within a team of experts to create scalable backend services and intuitive user interfaces that facilitate seamless interaction between users and LLM-based systems. The position requires a strong blend of software engineering skills and practical AI implementation to deliver production-ready solutions.

Responsibilities

• Build and maintain backend services that orchestrate LLM interactions, prompts, and workflows
• Prototype and develop intuitive user interfaces that enable effective human-AI interaction
• Integrate LLM APIs into scalable applications
• Develop prompt engineering strategies and manage prompt lifecycle for performance and reliability
• Implement retrieval-augmented generation architectures using internal and external data sources
• Design data pipelines and connectors to enterprise systems
• Monitor, evaluate, and improve AI application performance using metrics
• Collaborate with product managers, data scientists, and business stakeholders to translate requirements into AI-enabled solutions
• Ensure responsible AI practices, including privacy, security, and bias mitigation
• Rapidly prototype AI tools and iterate based on user feedback

Requirements

• Bachelor’s degree in Computer Science, Software Engineering, or related field
• Minimum three years of professional software development experience
• Strong programming skills in Python, JavaScript, or similar languages
• Experience building AI products using LLM frameworks
• Knowledge of retrieval-augmented generation (RAG) and vector databases
• Experience orchestrating multi-step AI workflows or agent-based systems
• Familiarity with enterprise data platforms and integrations
• Experience designing conversational interfaces or chat-based applications
• Understanding of evaluation techniques for LLM outputs
• Experience deploying scalable microservices architectures
• Strong UI/UX sensibility for AI-driven applications
• Experience working in cross-functional teams delivering production-grade AI solutions
• Familiarity with prompt engineering and LLM interaction patterns
• Experience developing web-based user interfaces

Benefits

• Competitive pay with bonuses
• 401(k) match and employee stock purchase program
• Financial perks including student-debt assistance, planning support, and group insurance discounts
• Medical, dental, and vision coverage
• Life and other voluntary coverages
• Paid time off and holidays
• Family leave and backup care
• Wellness rewards and gym discounts
• Community volunteering opportunities
• Tuition reimbursement and access to KLA’s corporate learning center
• Education awards and engineering certification programs

Pay

$90,400 – $153,700 per year