AI Solution Analyst (US Citizenship Required)

The AI Solution Analyst

US Citizenship is required for this position. We are unable to hire Green Card Holders, individuals who need a work visa, are currently on a work visa, or individuals who will require work visa sponsorship in the future.

Essential Duties & Responsibilities

• AI Tool Evaluation & Testing
• Conduct hands‑on technical evaluations of AI software tools, copilots, AI agents, RAG systems, and emerging AI platforms.
• Assess capabilities, limitations, performance, model behavior, integration feasibility, and operational requirements.
• Develop structured test plans, evaluation frameworks, and comparison matrices for consistent assessment.
• Document findings, risks, limitations, and recommendations for technical and executive audiences.
• Architecture & Integration Support
• Analyze how candidate tools integrate with existing enterprise environments (Microsoft 365, Azure, SharePoint, on-prem systems).
• Review API functionality, identity and access requirements, logging, data flows, and security architecture.
• Collaborate with enterprise architecture and infrastructure teams to determine technical feasibility.
• Governance, Risk, and Compliance Support
• AI governance processes, including privacy, data-handling assessments, and policy compliance.
• Aid with documentation for compliance reviews, risk registers, and AI policy adherence.
• Pilot Coordination & Vendor Interaction
• Coordinate proof-of-concept (POC) activities with vendors and internal stakeholders.
• Create POC documentation including scope, success criteria, user testing results, and ROI analysis.
• Provide ongoing updates to IT leadership, the AI Champions, and business units.
• Cross-Functional Collaboration
• Work with the AI Governance Committee, Cybersecurity, IT, and business units to gather requirements and evaluate use cases.
• Serve as a technical resource during intake, review, and approval processes for AI tool requests.
• Support training materials, knowledge sharing, and documentation to help scale internal AI adoption safely.

Qualifications & Experience

• Technical Experience
• 3 years of experience in IT systems, software evaluation, enterprise applications, or technical analyst roles.
• Experience conducting technical evaluations of software tools or platforms.
• Solid understanding of enterprise technology fundamentals, such as Microsoft 365 and Azure ecosystem, Microsoft Copilot, Copilot Studio, Azure AI/ML services, or similar platforms.
• Identity & Access Management (Azure AD/Entra)
• API integrations and data flows
• Cloud/SaaS security concepts
• AI & Data Literacy
• Working understanding of large language models (LLMs), embeddings, RAG pipelines, and AI agent concepts (training not required, but literacy is expected).
• Familiarity with key AI risk themes: hallucinations, bias, safety guardrails, data leakage, and model evaluation
• Soft Skills
• Strong analytical mindset and problem-solving capability.
• Excellent written documentation skills for both technical and executive audiences.
• Ability to manage multiple evaluations, pilots, and stakeholder groups simultaneously.
• Comfortable presenting findings and recommendations to leadership.
• Preferred Qualifications & Experience
• Experience with Python or PowerShell for limited proof-of-concept test scripting.
• Background in regulated industries, security reviews, or governance frameworks.
• Project coordination or POC management experience.