Manager, Learning Outcome & Reporting

About the role

Per Scholas is seeking a Manager, Learner Evaluations and Analytics to join the Curriculum Solutions Product Design Team. This role supports the organization's ability to evaluate live learning products, interpret learner outcome and program performance data, and route actionable insights back into curriculum design, refresh, and continuous improvement decisions.

Responsibilities

• Support the design and implementation of evaluation plans for new, refreshed, and live learning products.
• Partner with Directors, Product Owners to ensure learning objectives, assessments, and curriculum outcomes are measurable and aligned to product goals.
• Contribute evaluation methodology requirements during product design phases, including measurability input for learning objectives, assessments, learner performance measures, and post-launch evaluation.
• Help define learner, program, and outcome-level success measures, including completion, certification attainment, assessment performance, retention, learner satisfaction, employer satisfaction, and job-readiness indicators.
• Support the development of evaluation frameworks, data collection plans, rubrics, surveys, dashboards, and reporting tools.
• Ensure evaluation approaches align to the Product Design Team’s ADDIE-based process, including the feedback loop from live product performance into refresh triage and product improvement decisions.
• Learner Outcome Data & Performance Analysis: Gather, clean, organize, analyze, and maintain learner outcome and academic performance data across assigned products and cohorts. Analyze assessment results, certification performance, completion data, learner progress, and other indicators of product effectiveness. Identify trends, risks, performance gaps, and improvement opportunities across cohorts, products, domains, and delivery models. Produce clear, accurate, and business-relevant reports that translate learner performance data into actionable insights for curriculum, delivery, and leadership stakeholders. Maintain historical product performance records and support the development of portfolio-level performance summaries. Monitor data quality, source consistency, reporting cadence, and caveats to ensure stakeholders understand what the data does and does not indicate.
• Assessment Quality & Curriculum Improvement Support: Review learner performance data to identify potential curriculum, assessment, delivery, or learner support issues. Support Product Design, Product Development, Product Delivery, Instructor Development, and Training Delivery teams by providing evidence-based input on curriculum and assessment effectiveness. Collaborate with Product Owners and instructional design partners to determine whether learner performance gaps indicate a need for curriculum refresh, assessment revision, delivery support, instructor enablement, or additional learner interventions. Support the development and refinement of grading rubrics, assessment criteria, data collection instruments, and performance measurement tools. Analyze whether assessments are being administered consistently and in alignment with curriculum intent, cohort schedules, and product requirements. Document challenges surfaced during the cohort lifecycle, including issues related to assessments, grading policies, learner performance, retakes, tutoring, learner readiness, and assessment administration. Recommend improvements to assessment structure, scoring practices, learner support triggers, and data collection processes.
• Reporting, Dashboards & Data Storytelling: Develop and maintain recurring reports, dashboards, data summaries, and insights decks for internal stakeholders. Translate complex learner outcome and performance data into clear narratives, visualizations, recommendations, and decision-ready insights. Support quarterly or periodic product performance reporting, including domain-level rollups and portfolio-level summaries. Maintain reporting schedules, data refresh timelines, data dictionaries, metric definitions, and reporting documentation. Ensure reports are accurate, concise, stakeholder-ready, and aligned to organizational decision-making needs. Use tools such as Google Sheets, Microsoft Excel, Tableau, Power BI, Salesforce, Canvas, Airtable, Asana, and Google Workspace to support evaluation and reporting workflows. Partner with Product Operations to ensure reporting outputs, evidence packets, and recommendations are tracked appropriately in designated systems of record.
• Evaluation Feedback Loop & Cross-Functional Collaboration: Support the Evaluation Feedback Loop by routing learner outcome data, program performance findings, assessment insights, and product improvement recommendations back to the Product Design Team. Collaborate with Directors, Product Owners to provide evaluation evidence that informs product refresh, curriculum triage, backlog decisions, and product improvement priorities. Partner with the Sr. Director, Product Management to prepare performance rollups, evaluation findings, and recommendations for product review and decision-making. Collaborate with Product Operations to support operational cadence, reporting timelines, documentation standards, and visibility into evaluation-related work. Work cross-functionally with Product Development, Product Delivery, Training Delivery, Instructor Development, Evaluation, Operations, and site-based partners to understand data context and improve product performance. Partner with IDQA or related instructional support teams when instructor-side feedback raises questions about learner outcomes, assessment validity, instructional effectiveness, or product design. Support product triage conversations by distinguishing between curriculum issues, assessment issues, delivery issues, learner support needs, and data quality concerns.
• Data Governance, Documentation & Quality: Maintain accurate records of learner academic performance, assessment results, evaluation findings, product performance data, and reporting artifacts. Support data governance practices by documenting metric definitions, data sources, reporting cadence, assumptions, limitations, and known caveats. Ensure evaluation data and reports are organized, accessible, version-aware, and aligned to internal documentation standards. Maintain data quality controls to ensure information is accurate, complete, consistent, and presented in a clear and business-relevant manner. Document recommendations, risks, unresolved questions, and follow-up actions resulting from evaluation findings. Support continuous improvement of evaluation templates, reporting tools, dashboards, data collection instruments, and insight repositories. Ensure appropriate confidentiality, professionalism, and care when working with learner data and performance records.

Qualifications

• 4+ years of experience in learner analytics, education evaluation, program evaluation, assessment analysis, data reporting, learning operations, academic performance tracking, or a related field.
• Experience gathering, cleaning, analyzing, maintaining, and reporting learner performance or program outcome data.
• Strong analytical skills, including the ability to identify trends, interpret data, surface risks, and translate findings into recommendations.
• Advanced knowledge of Microsoft Excel and/or Google Sheets, including formulas, pivot tables, charts, data validation, and structured reporting.
• Experience with learning management systems such as Canvas or similar platforms.
• Experience developing reports, dashboards, presentations, or data visualizations using tools such as Tableau, Power BI, Google Looker Studio, Google Slides, PowerPoint, or similar platforms.
• Strong written communication skills, including the ability to produce concise reports, insights summaries, evaluation findings, and stakeholder-ready recommendations.
• Ability to communicate data clearly to both technical and non-technical audiences.
• Strong attention to detail, data quality, version control, documentation discipline, and follow-through.
• Able to independently manage priorities, recurring reporting cycles, and multiple concurrent projects in a fast-paced environment.
• Strong collaboration skills and ability to work cross-functionally with product, curriculum, instruction, delivery, evaluation, and operations teams.
• Able to handle learner performance data with confidentiality, professionalism, and sound judgment.