Jobs · Engineering · New York

Director / Senior Director, AI & Data Engineering

Castleton Tower Consulting, LLC · New York, NY · 2 mo ago
HybridEngineeringFull-time

Core Responsibilities

  • Leadership and Operating Model Design and Implement the data team structure, hiring plan, delivery model, and long-term technical roadmap.
  • Set engineering standards for code review, testing, documentation, observability, data quality, and production support.
  • Manage internal team members, contractors, vendors, and implementation partners where appropriate.
  • Build a culture of ownership, technical rigor, and pragmatic delivery.
  • Architect and build scalable data platforms across warehouse, lakehouse, orchestration, transformation, and BI layers.
  • Develop data models and applications that support portfolio analytics, investment operations, risk reporting, finance, and executive reporting.
  • Create durable pipelines and controls for high-value investment and operational datasets.
  • Evaluate and rationalize tooling across Snowflake, Databricks, dbt, Dagster/Airflow, cloud infrastructure, BI, and internal applications.
  • Use AI coding assistants and agentic workflows to accelerate software and data delivery while maintaining security, review, and testing discipline.
  • Identify high-leverage AI use cases across data ingestion, documentation, analytics, workflow automation, and research operations.
  • Design human-in-the-loop processes for AI-generated code, analysis, and operational outputs.
  • Help the organization build the data and governance foundation required for responsible AI adoption.

Qualifications

  • 10+ years of progressive experience in data engineering, analytics engineering, data platforms, or technical data leadership.
  • 3+ years managing engineers, analytics engineers, data platform teams, or cross-functional technical delivery teams.
  • Proven ability to design and build production data platforms using Python, SQL, modern warehouse/lakehouse technologies, and orchestration tools.
  • Strong architectural judgment across data modeling, governance, quality, observability, security, and operational resilience.
  • Practical fluency with AI-assisted development tools such as Claude Code, OpenAI Codex, Cursor, GitHub Copilot, or similar systems.
  • Ability to communicate clearly with senior non-technical stakeholders and translate business needs into durable technical systems.
  • Executive presence, high ownership, and comfort operating in ambiguous environments.
  • Experience in investment management, asset allocation, hedge funds, private markets, family offices, RIAs, fintech, or financial data products.
  • Experience building or modernizing data teams in a high-expectation investment, finance, or institutional environment.
  • Hands-on exposure to Snowflake, Databricks, dbt, Dagster, Airflow, AWS, Azure, Sigma, Tableau, Looker, or similar tooling.
  • Experience with portfolio analytics, manager research, risk reporting, investment operations, fund accounting, or performance reporting datasets.
  • Experience evaluating vendors and implementation partners, including build-versus-buy decisions.

Similar jobs