Analyst - AI Applications

Responsibilities

The Analyst, AI Applications will support the evaluation, rollout, measurement, and ongoing management of AI-enabled and legal technology solutions across the firm. The role will serve as a shared resource across the AI Applications team, supporting the Director and Managers with evaluations, product tracking, reporting, coordination, research, and day-to-day execution. A key focus will be helping the team understand whether technology is working as intended.

• Coordinate evaluations of technology pilots, new product features, and AI model releases.
• Develop evaluation plans, test cases, success measures, and structured feedback processes.
• Coordinate participation from lawyers, business professionals, and subject-matter experts.
• Analyze qualitative and quantitative results and summarize findings for the AI Applications team.
• Maintain consistent evaluation methods, documentation, and historical results.
• Support recommendations regarding rollout, further testing, configuration changes, or other next steps.
• Monitor product roadmaps, release notes, model updates, and new capabilities across key platforms.
• Maintain a clear internal view of upcoming releases and product changes.
• Assess which developments may be relevant to the firm and identify potential user groups or use cases.
• Work with Managers to determine which features require testing, communication, training, or phased rollout.
• Maintain product documentation, roadmap trackers, decision logs, and related team resources.
• Track product usage, adoption, engagement, and other measures of success.
• Develop recurring reports and dashboards for the AI Applications team.
• Identify trends, adoption gaps, and areas requiring further investigation.
• Support phased rollouts of new products, models,