Sr AI Platform Engineer – Retrieval & Knowledge Systems

Job Overview

The Senior Engineer will design and build core AI knowledge infrastructure that powers intelligent applications across the enterprise.

Responsibilities

• AI Retrieval & Search Platform Design and build high-scale retrieval systems combining keyword search, semantic search, and vector-based retrieval.
• Develop RAG (Retrieval-Augmented Generation) infrastructure including indexing, retrieval, ranking, and context assembly.
• Build and optimize search indices, vector stores, and hybrid retrieval systems for relevance, latency, and scale.
• Implement advanced ranking, relevance tuning, and personalization pipelines.
• Data Pipelines & Indexing Systems
• Build streaming and batch pipelines for ingesting and transforming structured and unstructured data.
• Develop enrichment pipelines (chunking, embeddings, metadata extraction, classification).
• Design systems for real-time indexing, incremental updates, and freshness guarantees.
• Optimize data flow, storage, and compute efficiency at scale.
• AI Platform Services & APIs
• Build low-latency, highly available APIs that expose retrieval and knowledge services to applications and AI agents.
• Develop reusable SDKs and service abstractions for easy integration into product teams.
• Enable context retrieval, query understanding, and response augmentation for downstream AI systems.
• Establish patterns for multi-tenant, scalable platform services.
• LLM & Intelligent Systems Integration
• Integrate LLMs with retrieval systems to enable grounded, context-aware experiences.
• Build systems for context construction, prompt augmentation, and response orchestration.
• Implement evaluation frameworks for relevance, grounding quality, and user experience.
• Support use cases like AI assistants, copilots, search experiences, and automation agents.
• Performance, Scalability & Reliability
• Design for low-latency (
• Implement caching, sharding, and distributed query execution strategies.
• Build observability pipelines (metrics, logs, tracing) for system performance and usage insights.
• Drive resiliency, fault tolerance, and system reliability at scale.
• Technical Leadership
• Lead design and architecture of large-scale AI platform components.
• Mentor engineers on distributed systems, retrieval architectures, and AI engineering practices.
• Drive adoption of modern engineering practices (CI/CD, infrastructure-as-code, automated testing).
• Partner with AI, data, and product teams to shape next-gen intelligent platform capabilities.

Requirements

• Minimum of 8 years of experience in backend or platform engineering.
• Hands-on experience with APIs, microservices, and cloud-native architectures.
• Experience building distributed systems, search platforms, or large-scale data services.
• Experience with search systems, indexing, or retrieval pipelines.
• Experience programming skills in Java, Python, or Go.

Pay Range

$115,154.00 - $191,889.00

Actual base salary varies based on factors, including but not limited to, relevant skill, prior experience, education, base salary of internal peers, demonstrated performance, and geographic location.

Additionally, LPL Total Rewards package is highly competitive, designed to support your success at work, at home, and at play – such as 401K matching, health benefits, employee stock options, paid time off, volunteer time off, and more.

About LPL Financial

LPL Financial Holdings Inc. (Nasdaq: LPLA) is among the fastest growing wealth management firms in the U.S. As a leader in the financial advisor-mediated marketplace(6), LPL supports over 32,000 financial advisors and the wealth management practices of approximately 1,100 financial institutions, servicing and custodying approximately $2.3 trillion in brokerage and advisory assets on behalf of approximately 8 million Americans.

The firm provides a wide range of advisor affiliation models, investment solutions, fintech tools and practice management services, ensuring that advisors and institutions have the flexibility to choose the business model, services, and technology resources they need to run thriving businesses.

For further information about LPL, please visit www.lpl.com.