Jobs · Engineering

AI Engineering Manager_Machine Learning

AddSource · United States · 2 wk ago
RemoteRemoteEngineeringContract

Responsibilities

  • End-to-End AI Feature Ownership
  • Design and implement AI-powered features (LLM workflows, copilots, and agent-based systems with tool use and multi-step reasoning)
  • Own the Full Lifecycle: prototyping, evaluation, production, deployment, iteration
  • Ensure solutions are reliable, performant, and aligned with product needs
  • AI System Implementation
  • Build and optimize prompt pipelines for specific use cases
  • Build retrieval systems (embeddings, chunking, ranking)
  • Implement RAG-based workflows where needed
  • Iterate on outputs to improve quality, accuracy, and consistency
  • Design scalable and cost-efficient AI architectures for production workloads
  • Select and evaluate models (hosted vs open-source) based on use case constraints
  • Agent-Based Systems (AgentCore)
  • Design and build agentic workflows capable of multi-step reasoning and decision-making
  • Integrate agents with tools, APIs, and internal systems to perform real-world actions
  • Implement planning, execution, and reflection loops for complex tasks
  • Manage context, memory, and state across multi-step interactions
  • Balance deterministic workflows vs. agent autonomy for reliability and control
  • Experimentation & Evaluation
  • Run structured experiments to compare approaches (prompting, retrieval, models)
  • Define and track key metrics for AI performance (quality, latency, cost)
  • Debug and improve non-deterministic system behavior
  • Build and maintain evaluation datasets and benchmarks
  • Implement automated evaluation pipelines for continuous improvement
  • Collaboration & Contribution
  • Drive technical direction and influence AI adoption across teams
  • Partner with product managers and designers to scope AI features
  • Contribute to shared patterns and reusable components
  • Participate in code reviews and design discussions
  • Support and mentor mid-level engineers where needed

Qualifications

  • Engineering Degree BE/ME/BTech/MTech/BSc/MSc
  • Technical certification in multiple technologies is desirable.

Similar jobs