Jobs · Engineering · New York

Principal AI Platform Engineer

Saransh Inc · New York, NY · 1 mo ago
On-siteEngineeringContract

About the role

A hands-on engineering leadership role focused on AI platforms, large language models (LLM), and orchestration, with strong IAM/PAM alignment.

Key Skills & Background

  • Proficiency with C programming language and Unix/Linux systems
  • Knowledge of cryptography, authentication, and authorization concepts
  • Experience working in secured enterprise environments
  • Agile development teams
  • Engineering skills in Python and Perl development
  • Ability to communicate technical concepts to business stakeholders
  • Strong collaboration and independent execution capabilities
  • Contributions to Linux/Unix/open-source projects are valued
  • Knowledge of Kerberos (preferred)

Core Responsibilities

  • AI / LLM Platform Engineering Lead
  • Hands-on development of AI-enabled and LLM-based applications
  • Build agentic and multi-agent systems
  • Design and implement orchestration architectures including function invocation, state and memory management, policy-aware execution
  • AI Engineering & Integration
  • Develop intelligent agent workflows using prompt design, grounding strategies, tool orchestration layers
  • Own full-stack AI system architecture APIs, data pipelines, model serving, and observability
  • Ensure performance, scalability, and reliability across environments
  • Security & Governance
  • Drive reviews, mentoring, and best practices for AI engineering

Required Skills

  • Hands-on platform engineering experience, end-to-end
  • Deep expertise in LLMs and model lifecycle, prompt engineering and grounding
  • Hallucination mitigation
  • Strong system design experience, including multi-agent architectures, distributed systems
  • Cloud-native development

Key Technologies / Areas

  • LLM frameworks and orchestration
  • Cloud platforms and APIs
  • Distributed systems design
  • AI governance framework

Similar jobs