Jobs · Engineering · Texas

Senior AI Platform Engineer - Frisco

McAfee · Texas, United States · 5 days ago
HybridEngineering$107k/yrFull-time

About the role

This role is responsible for designing, building, and scaling enterprise-grade Generative AI platforms and developer ecosystems. The focus is on enabling secure, scalable, reliable, and production-ready GenAI capabilities across the organization leveraging LLMs, AI gateways, Kubernetes, and cloud-native infrastructure.

Responsibilities

  • Design, build, and scale enterprise-grade Generative AI platforms supporting LLM applications, AI agents, RAG architectures, and multi-model routing.
  • Architect and implement secure, scalable AI infrastructure leveraging cloud-native technologies (AWS, GCP, Kubernetes, GKE/EKS).
  • Enable self-service AI capabilities for engineering teams through standardized platform services, APIs, and Backstage templates/plugins.
  • Build and operate Retrieval-Augmented Generation (RAG) infrastructure, including embedding pipelines and vector stores (OpenSearch, Aurora pgvector).
  • Develop and manage enterprise AI gateway capabilities, including model routing, rate limiting, token tracking, and policy enforcement.
  • Build observability platforms for GenAI systems, tracking token usage, latency, response quality, failure rates, throughput, and cost visibility.
  • Own lifecycle management of Kubernetes-based AI platforms including upgrades, patching, scaling.
  • Define SLIs/SLOs and reliability benchmarks for AI platform services.
  • Implement AI security guardrails including PII redaction, prompt injection defenses, and policy-driven controls.
  • Requirements

    • 10+ years of experience in platform engineering, with hands-on AI/ML or GenAI platform experience.
    • Hands-on experience with at least one LLM ecosystem (AWS Bedrock, OpenAI, Anthropic).
    • Strong Kubernetes experience (EKS/GKE), including GPU scheduling, autoscaling, and multi-tenant isolation.
    • Strong programming expertise in Python and Go; experience building services using FastAPI and gRPC.
    • Deep expertise in AWS (IAM, VPC, KMS) and Infrastructure as Code (Terraform).
    • Experience building and integrating platforms using Backstage (plugins, templates, self-service patterns).
    • Strong understanding of distributed systems and event streaming (Apache Kafka).
    • Expertise in CI/CD automation and platform engineering best practices.
    • Experience with multi-model orchestration frameworks (LangChain, LlamaIndex).
    • Exposure to LLMOps / MLOps tooling for model lifecycle management, evaluation, and versioning.
    • Experience building or integrating AI agent frameworks and orchestration patterns.
    • Expertise in AI cost optimization strategies (token efficiency, caching, adaptive routing).
    • Experience with prompt engineering frameworks, guardrails, and evaluation techniques.
    • Exposure to AI model evaluation frameworks (quality scoring, hallucination detection, benchmarking).
    • Experience with vector databases beyond OpenSearch (e.g., Pinecone, Weaviate).
    • Familiarity with event-driven architectures for AI workflows (Kafka-based streaming pipelines).
    • Experience exposing platform capabilities as reusable APIs, SDKs, templates, and developer tooling.
    • Strong understanding of cloud-native architectures and microservices design patterns.
    • Experience implementing AI security controls, governance frameworks, and risk mitigation.
    • Experience with enterprise AI gateway patterns for model access and control.
    • Exposure to agentic AI concepts (MCP, A2A, AI agents) and emerging GenAI orchestration patterns.
    • Proven ability to lead architecture reviews, drive platform governance, and influence engineering standards.
    • Demonstrated experience driving large-scale engineering transformation initiatives.
    • AI/ML certifications such as AWS Machine Learning Specialty, Google Cloud ML Engineer is a plus.
    • Cloud architecture certifications (AWS/GCP Solutions Architect) is a plus.
    • Kubernetes certifications (CKA, CKAD, CKS) is a plus.

    Qualifications

    Must have a Bachelor's degree in Computer Science, Engineering, or a related field. Additional relevant certifications may be considered.

    Skills

    • Generative AI
    • Platform engineering
    • Cloud-native technologies (AWS, GCP, Kubernetes)
    • CI/CD automation
    • DevSecOps
    • Security controls
    • Event-driven architectures
    • Vector databases
    • Agentic AI concepts

    Benefits

    McAfee offers a comprehensive benefits package including:

    • Bonus Program
    • 401(k) Retirement
    • Medical, Dental, Vision, Basic Life, Short Term Disability and Long-Term Disability Coverage
    • Paid Parental Leave
    • Social Programs
    • Flexible Work Hours
    • Family-Friendly Benefits
    • 14 Paid Company Holidays
    • Unlimited Paid Time Off for Exempt Employees
    • 96 Hours of Sick Time and 120 Hours of Vacation for Non-Exempt Employees

    Pay

    The anticipated compensation for this position is USD $107,430.00/Yr. - USD $176,490.00/Yr. depending on experience and qualifications.

Similar jobs