Jobs · Engineering · New York

AI Engineer

WITHIN · New York, New York, United States · 4 mo ago
Engineering$91k–$254k/yrFull-time

About the role

We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal AI-powered agent platform used across the organization.

Responsibilities

  • Design, build, and maintain AI-powered applications leveraging LLM APIs, tool calling, and structured outputs.
  • Develop and improve agent architectures that integrate tools such as SQL execution, Python code execution, and marketing platform APIs through MCP-style integrations.
  • Design and refine multi-turn context handling, session memory strategies, and prompt structures to improve response reliability and reduce hallucinations.
  • Implement safeguards for tool execution, SQL queries, and code execution. Improve retry logic, structured validation, and hallucination mitigation strategies.
  • Contribute to building structured evaluation frameworks for LLM-powered systems, including multi-turn testing, regression testing, and task-based success metrics.
  • Support expansion of Rai into document generation, tables, slide decks, and potential Google Workspace integrations.
  • Work closely with Machine Learning Engineers, Product Managers, and Full-Stack Engineers to ensure AI systems are robust, maintainable, and aligned with business goals.
  • Stay current with advances in LLM systems, agent architectures, and applied AI tooling to continuously improve Rai’s capabilities.

Requirements

  • Strong programming skills in Python with experience building production systems.
  • Experience building applications powered by LLM APIs (OpenAI, Anthropic, Vertex AI, etc.).
  • Deep understanding of:
    • Context windows and token limits
    • Multi-turn conversation behavior
    • Tool/function calling
    • Structured outputs (JSON schema)
    • Prompt design and failure modes
  • Experience integrating external APIs into production systems.
  • Proficiency in SQL.
  • Experience working with cloud platforms (GCP, AWS, or Azure).
  • Strong problem-solving skills and ability to debug complex system behavior.
  • Excellent communication and cross-functional collaboration skills.

Strong Plus

  • Experience designing evaluation frameworks for LLM-powered systems.
  • Understanding of embeddings, vector search, and RAG architectures.
  • Experience building agent or multi-agent workflows.
  • Experience with stateful execution environments or sandboxed code execution.
  • Experience with document automation (Google Docs, Slides, PDFs).
  • Experience building internal developer tools or productivity platforms.
  • TypeScript.

Required knowledge of

  • Python
  • SQL
  • Cloud Platforms (GCP, AWS, Azure)
  • LLMs / AI APIs
  • Git / GitHub

Nice to have

  • Data Warehouses (BigQuery, Snowflake, Redshift)
  • Data Transformation (dbt)
  • Semantic Layers (Cube, Looker, dbt Metrics)
  • TypeScript

Our interview process includes, but is not limited to the following:

  • Excel and Typing Test

Benefits

  • Unlimited vacation policy
  • Monthly Phone Stipend
  • Comprehensive Medical, Dental, and Vision insurance options
  • 401(K) plan with matching
  • Dog friendly office
  • Hybrid work opportunity
  • Professional Development Program
  • Bonus Perk - Seamless allowance

Total compensation based on ability level, including:

  • $90,900-$123,540
  • $123,540-$156,180
  • $156,180-$188,820
  • $188,820-$221,460
  • $221,460-$254,100

About WITHIN

WITHIN is the world's first Performance Branding company, partnering with some of the biggest brands in the world to drive business growth through innovative marketing strategies. Our integrated operating model collapses the traditional marketing silos between creative and media, performance and brand, and across media channels. With a full suite of offerings including media, creative, SEO, Lifecycle, Retail Media, Affiliate and Influencer, we’re able to work with our brand partners in an integrated fashion, allowing us to align marketing strategies back to core business objectives. Client teams at WITHIN are trained on how to always act as a trusted business partner, acting as a fiduciary to client needs above our own. Teams at WITHIN have the ability to work with iconic brands such as The North Face, Timberland, Ben and Jerry's and Jose Cuervo. Everyone at WITHIN wants to grow and be challenged. It’s a collaborative place made up of small, closely knit and versatile teams that are fast and adaptive to solve problems and build systems.

Check out some of our work!

We weave AI into everything we do, using the latest tech across all teams to innovate, work smarter, and make better decisions. Whether it’s in creative, operations, or anything else, AI helps us level up and do things at a whole new scale. We expect our people to use AI in their daily work, fully embracing it as a critical tool to help us succeed.

Create a Job Alert

Interested in building your career at WITHIN? Get future opportunities sent straight to your email.

Apply for this job

Similar jobs

AI Engineer

Metropolitan Commercial BankNew York, NY· 1 mo ago
Engineering$130k–$200k/yrapply on grnh.se

AI Engineer

RA Capital ManagementBoston, MA· 3 wk ago
Engineering$120k–$180k/yrapply on job-boards.greenhouse.io

AI Engineer

TP ICAPNew York, United States· 1 wk ago
Engineering$184k–$222k/yrapply on tp.wd107.myworkdayjobs.com

AI Engineer

Valley BankMorristown, NJ· 2 wk ago
Engineering$60/hrapply on recruiting.adp.com

AI Engineer

FieldguideSan Francisco, CA· 3 wk ago
Engineeringapply on fieldguide.io

AI Engineer

BWEColumbus, OH· 3 mo ago
Engineeringapply on bwe.wd12.myworkdayjobs.com