Jobs · OTHR · California

Senior AI Architect & Lead Prompt Engineer

TechWish · San Jose, CA · 2 wk ago
On-siteOTHRFull-time

About the Role

The Senior AI Architect & Lead Prompt Engineer will spearhead the design and deployment of advanced, next-generation agentic systems and LLM-powered platforms for GFiber. This role integrates sophisticated Prompt Engineering and AI Architecture principles with scalable AI infrastructure to optimize GFiber's enterprise workflows. The incumbent will integrate AI agents with core enterprise platforms such as ServiceNow, Salesforce, Netcracker, and SAP to automate complex customer inquiry cycles and enhance on-field employee support, yielding substantial reductions in Capex and Opex while ensuring end-to-end service management.

Responsibilities

  • Lead the end-to-end architecture of multi-agent systems, from initial concept to production-grade deployment on Google Cloud Platform (GCP).
  • Develop sophisticated prompt engineering frameworks, including system prompts, few-shot templates, and output guardrails, utilizing Chain-of-Thought (CoT) prompting and structured prompt chains for complex reasoning tasks.
  • Design conversational interfaces using Dialogflow and Gemini-powered agents to manage inquiry routing and automated workflow orchestration.
  • Architect integrations between LLM platforms (Vertex AI/Gemini) and enterprise CRM/ITSM tools like Salesforce and ServiceNow, focusing on Telecom-grade inquiry response and ticketing workflows.
  • Build and optimize RAG (Retrieval-Augmented Generation) pipelines grounded in internal client policies and technical documentation.
  • Oversee the deployment of microservices using GKE (Google Kubernetes Engine), Cloud SQL, and Cloud Build, ensuring scalable and reliable AI performance.

Requirements

  • Deep expertise in Gemini, Vertex AI, and LangChain or LlamaIndex.
  • Proven experience architecting AI solutions that interface with Salesforce and ServiceNow within a Telecom or large enterprise context.
  • Experience building multi-agent architectures for autonomous task execution and workflow automation.
  • Mastery of hybrid search, reranking, and vector databases (e.g., Redis, PostgreSQL).
  • 10+ years in the AI stack, ranging from classical NLP/NLU to modern generative AI architectures.
  • B.Tech in Computer Science, Mathematics, or a related technical field.
  • Strong command of Python, Terraform IAC, Docker, and the GCP ecosystem (GKE, Cloud Deploy).
  • Demonstrated understanding of ServiceNow, Salesforce, and Netcracker in the Telecommunications service lifecycle, specifically regarding inquiry management and automated support.

Skills

  • AI/ML: Gemini, Vertex AI, Hugging Face, OpenAI, Claude.
  • Frameworks: LangChain, LlamaIndex, Dialogflow.
  • Cloud & Infra: GCP (GKE, Cloud Build), Docker, TensorRT.
  • Data: Cloud SQL, PostgreSQL, Redis.

Similar jobs