Senior Kong AI Gateway Engineer

Job Description: Our client is looking for a skilled Kong Administrator / AI Gateway Engineer with experience in API Gateway management, Kong administration, and knowledge on AI/LLM proxy development. Required Skills: Kong Gateway (OSS/Enterprise), Kong KonnectAPI Management & API Lifecycle ManagementAI Gateway / LLM Proxy DevelopmentOpenAI / Azure OpenAI IntegrationREST APIs, GraphQLOAuth2, JWT, OIDC, API SecurityKubernetes, Docker, HelmCI/CD (Jenkins, GitHub Actions, Azure DevOps)Monitoring: Prometheus, Grafana, ELK/SplunkCloud Platforms: Azure, AWS, or GCPKong AI Gateway Configuration & AdministrationLLM Traffic Routing, Load Balancing and Failover ManagementPrompt Management, Prompt Security and GuardrailsAI Security, Responsible AI and Model GovernanceToken Usage Monitoring, Rate Limiting and Cost OptimizationMulti-LLM Integration (OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Mistral, Llama)Retrieval-Augmented Generation (RAG) Architecture ConceptsVector DatabasesLLMOps, AI Observability and Model Performance MonitoringAI API Governance, Compliance and Data ProtectionPrompt Caching, Semantic Caching and Response OptimizationModel Gateway Policy Development and AI Consumption ControlsMCP (Model Context Protocol) and AI Agent Integration ConceptsGenAI Platform Engineering and Enterprise AI Enablement Key Responsibilities: Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway.Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails.Enable secure access to multiple LLM providers through a unified gateway architecture.Implement AI observability, token analytics, usage tracking, and cost governance.Develop routing strategies across multiple AI models based on latency, cost, and availability.Integrate RAG-based AI services through secure API management frameworks.Ensure compliance with enterprise AI governance, security, and regulatory requirements.Establish AI platform standards, reusable AI APIs, and best practices for GenAI adoption.Support AI agent and MCP-based integrations within enterprise ecosystems.Drive AI platform reliability, scalability, and operational excellence.Configure, administer, and support Kong Gateway environments.Develop and manage AI Gateway proxies for GenAI/LLM services.Implement API security, authentication, throttling, and governance policies.Integrate AI platforms such as Azure OpenAI and OpenAI through secure API gateways.Deploy and manage Kong in Kubernetes-based environments.Monitor, troubleshoot, and optimize gateway performance and availability.Automate deployments and operational processes using DevOps tools. Experience: 7-12 years of experience in API Management, Middleware, or Platform Engineering.Minimum 3 to 5 years of hands-on experience with Kong Gateway Administration.Experience with cloud-native and microservices architectures preferred. Salary/Rate: $70-$85/HR (depends on experience level). This is a contract position with candidates expected to work 40 hours/ week. About Us Peterson Technology Partners (PTP) is an Equal Opportunity Employer committed to creating a transparent, inclusive, and human-centered hiring experience. For more than 28 years, PTP has operated as one of the top IT staffing and recruiting firms in the USA—built on trust, long-term partnerships, and technical excellence. Based in the Chicago suburb of Park Ridge, IL, our team of more than 500 employees and consultants is dedicated to: Helping every client make the best hiring decisions possibleMatching professionals with the right IT jobs and career opportunities As part of that commitment, we believe in providing clear information about how our hiring technologies work and how your data is used. The following section outlines our AI-assisted interview process and your rights as a candidate. AI-Assisted Interview Experience (Pete & Gabi – Rebecca): To provide a consistent, fair, and flexible experience for all candidates, we use AI-assisted tools to support parts of the interview process. This includes our proprietary AI platform Pete & Gabi, which includes AI recruiter Rebecca. These AI hiring tools help us: Conduct recorded video interviewsTranscribe interviewsSummarize candidate responsesGenerate job-related insightsStreamline communication and scheduling Please note that: The AI does NOT make hiring decisions; all decisions are made by our human recruiters, hiring managers, or client partners.The AI does not evaluate facial expressions, emotions, or physical traits; it is used only to support fairness, consistency, and efficiency. If you prefer a non-AI interview format, we will gladly provide an alternative. Technical or Case Interviews (Role-Dependent): − When applying for certain tech jobs, you may participate in: A technical interviewA coding challengeA case studyA client-specific assessment We will always explain what to expect in advance so you can prepare with confidence. Human Review & Selection: + Every candidate’s profile—including interviews, conversations, and assessments—is reviewed by experienced recruiters and hiring leaders. AI insights may assist with organization and evaluation, but final decisions are always human-driven. Your Rights as a Candidate: + At PTP, every candidate has the right to: Request a non-AI interview pathAsk how your data is being usedRequest access to transcripts or interview recordingsRequest deletion of your AI-recorded interviewReceive clear, timely communication Our goal is to ensure you feel respected, informed, and supported throughout your experience. Our Commitment: + For more than 28 years, PTP has focused on putting people first—candidates, consultants, employees, and clients. We’re committed to a hiring process that is: TransparentCompliantEquitablePowered by innovative technology that enhances—not replaces—human judgment Welcome to the future of hiring at Peterson Technology Partners. We’re excited to learn more about you. Equal Employment Opportunity: + Peterson Technology Partners is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, national origin, gender identity, sexual orientation, disability, veteran status, or any other protected characteristic.