Expert Statistician/Mathematician (QAF Oversight & Monitoring) - OBIQUA

Responsibilities

• Supports multiple DIA initiatives, including MARS, OMS, and OBI.
• Develops and applies fundamental mathematics, mathematical or statistical theory to collect, organize, interpret and summarize numerical data to generate usable information to solve a wide range of intelligence problems.
• Applies mathematical theories and statistical methods to solve practical problems.
• Develops mathematical or statistical models of phenomena for analysis or computational simulation.
• Designs complex metrics projects that apply valid scientific techniques and utilize information obtained from baselines or historical data to structure analyses.
• Processes large amounts of data for statistical modeling and graphic analysis (metrics).
• Produces results of analyses in graphs, charts, tables, and metrics.
• Conducts audits to ensure compliant use of AI systems for approved use-cases in all source analysis.
• Evaluates AA performance and adherence to tradecraft standards and identifies areas for improvement.
• Develops and maintains a repository of audit findings and recommendations to facilitate knowledge sharing and best practices across the organization.
• Designs and executes TEVV protocols to evaluate the performance, robustness, and fairness of AI systems in all source analysis contexts.
• Develops and applies statistical models and methods to analyze TEVV results and identify areas for improvement.
• Collaborates with stakeholders to develop and implement corrective actions to address TEVV findings.
• Develops and tracks performance metrics to evaluate the effectiveness of AI systems in all source analysis.
• Analyzes and interprets performance metrics to identify trends, patterns, and areas for improvement.
• Collaborates with stakeholders to develop and implement data-driven decision-making processes to inform AI system development and improvement.
• Develops and refines methodologies for evaluating AI system performance, robustness, and fairness in all source analysis contexts.
• Collaborates with stakeholders to develop and implement best practices for AI system development, testing, and deployment.
• Publishes and presents research findings on AI assurance methodologies and best practices.
• Supports capability development by contributing, editing, and storing code in Government owned/controlled source version control repositories.

Requirements

• Minimum 20 years of experience conducting analysis relevant to the specific labor category with at least a portion of the experience within the last 2 years.
• Master’s degree in an area related to the labor category from a college or university accredited by an agency recognized by the U.S. Department of Education.
• Demonstrates ability to define problems, supervise studies and lead surveys to collect and analyze data to provide advice and recommend solutions.
• Demonstrates analytic leadership and expertise in identifying, planning, developing, and executing analytic production methodologies, tradecraft and techniques aligned with labor category mission.
• Demonstrates extensive ability to provide strategic advice, technical guidance and expertise to Defense planners and policymakers.

Qualifications

• Active TS/SCI clearance with a Current CI Poly.