Senior AI Platform Engineer - Frisco

About the role

This role is responsible for designing, building, and scaling enterprise-grade Generative AI platforms and developer ecosystems. The focus is on enabling secure, scalable, reliable, and production-ready GenAI capabilities across the organization leveraging LLMs, AI gateways, Kubernetes, and cloud-native infrastructure.

Responsibilities

• Design and build enterprise-grade Generative AI platforms supporting LLM applications, AI agents, RAG architectures, and multi-model routing.
• Architect and implement secure, scalable AI infrastructure leveraging cloud-native technologies (AWS, GCP, Kubernetes, GKE/EKS).
• Enable self-service AI capabilities for engineering teams through standardized platform services, APIs, and Backstage templates/plugins.
• Build and operate Retrieval-Augmented Generation (RAG) infrastructure, including embedding pipelines and vector stores (OpenSearch, Aurora pgvector).
• Develop and manage enterprise AI gateway capabilities, including model routing, rate limiting, token tracking, and policy enforcement.
• Integrate GenAI services into CI/CD pipelines and platform workflows to enable seamless deployment and lifecycle management.
• Build observability platforms for GenAI systems, tracking token usage, latency, response quality, failure rates, throughput, and cost visibility.
• Own lifecycle management of Kubernetes-based AI platforms including upgrades, patching, scaling.
• Define SLIs/SLOs and reliability benchmarks for AI platform services.
• Implement AI security guardrails including PII redaction, prompt injection defenses, and policy-driven controls.
• Integrate DevSecOps and AI security scanning into deployment pipelines to enforce secure-by-design practices.
• Design AI release validation, risk analysis, and governance frameworks for production readiness.
• Develop upgrade and patching strategies for AI platforms with minimal downtime and operational risk.
• Ensure platform security posture, compliance, and lifecycle governance across environments.
• Drive multi-cloud AI platform strategy and lead modernization initiatives across AWS and GCP.
• Partner with Security and Governance teams to enforce responsible AI practices and enterprise standards.
• Drive measurable improvements in developer productivity, platform adoption, and AI cost efficiency through standardized platform capabilities.

Requirements

• 10+ years of experience in platform engineering, with hands-on AI/ML or GenAI platform experience.
• Hands-on experience with at least one LLM ecosystem (AWS Bedrock, OpenAI, Anthropic).
• Strong Kubernetes experience (EKS/GKE), including GPU scheduling, autoscaling, and multi-tenant isolation.
• Strong programming expertise in Python and Go; experience building services using FastAPI and gRPC.
• Deep expertise in AWS (IAM, VPC, KMS) and Infrastructure as Code (Terraform).
• Experience building and integrating platforms using Backstage (plugins, templates, self-service patterns).
• Strong understanding of distributed systems and event streaming (Apache Kafka).
• Expertise in CI/CD automation and platform engineering best practices.
• Experience with multi-model orchestration frameworks (LangChain, LlamaIndex).
• Exposure to LLMOps / MLOps tooling for model lifecycle management, evaluation, and versioning.
• Experience building or integrating AI agent frameworks and orchestration patterns.
• Expertise in AI cost optimization strategies (token efficiency, caching, adaptive routing).
• Experience with prompt engineering frameworks, guardrails, and evaluation techniques.
• Exposure to AI model evaluation frameworks (quality scoring, hallucination detection, benchmarking).
• Experience with vector databases beyond OpenSearch (e.g., Pinecone, Weaviate).
• Familiarity with event-driven architectures for AI workflows (Kafka-based streaming pipelines).
• Experience exposing platform capabilities as reusable APIs, SDKs, templates, and developer tooling.
• Strong understanding of cloud-native architectures and microservices design patterns.
• Experience implementing AI security controls, governance frameworks, and risk mitigation.
• Experience with enterprise AI gateway patterns for model access and control.
• Exposure to agentic AI concepts (MCP, A2A, AI agents) and emerging GenAI orchestration patterns.
• Proven ability to lead architecture reviews, drive platform governance, and influence engineering standards.
• Demonstrated experience driving large-scale engineering transformation initiatives.
• AI/ML certifications such as AWS Machine Learning Specialty, Google Cloud ML Engineer is a plus.
• Cloud architecture certifications (AWS/GCP Solutions Architect) is a plus.
• Kubernetes certifications (CKA, CKAD, CKS) is a plus.

Qualifications

• BS/MS in Computer Science, Engineering, or related field.
• Experience with Generative AI, LLMs, and AI gateways.
• Strong understanding of cloud-native architectures and microservices design patterns.
• Experience with DevSecOps and AI security scanning.
• Exposure to AI model evaluation frameworks and vector databases.
• Experience with event-driven architectures and platform engineering.
• Proven ability to lead architecture reviews and drive platform governance.

Skills

• Generative AI, LLMs, and AI gateways.
• Cloud-native technologies (AWS, GCP, Kubernetes, GKE/EKS).
• CI/CD automation and platform engineering best practices.
• Multi-model orchestration frameworks (LangChain, LlamaIndex).
• LLMOps / MLOps tooling for model lifecycle management, evaluation, and versioning.
• Vector databases (OpenSearch, Pinecone, Weaviate).
• Event-driven architectures (Kafka-based streaming pipelines).
• Reusable APIs, SDKs, templates, and developer tooling.
• Cloud architecture certifications (AWS/GCP Solutions Architect).
• Kubernetes certifications (CKA, CKAD, CKS).

Benefits

McAfee offers a variety of social programs, flexible work hours, and family-friendly benefits to all of its employees. These include a bonus program, 401(k) retirement plan, medical, dental, vision, basic life, short-term disability, and long-term disability coverage, paid parental leave, support and community involvement, 14 paid company holidays, unlimited paid time off for exempt employees, and 96 hours of sick time and 120 hours of vacation for non-exempt employees. Accrued each year.

Pay

The anticipated compensation for this position is USD $107,430.00/Yr. - USD $176,490.00/Yr. depending on experience and qualifications.