Kelley AI Grading and Enablement Lead (Application Administrator)
Indiana University Bloomington · Bloomington, IN · 2 days ago
Full-time
Department-Specific Responsibilities
- Administers and supports AI-assisted grading tools, workflows, documentation, user training, issue resolution, and operational quality-control processes for Kelley's required technology and AI curriculum.
- Administers day-to-day Canvas and AI-assisted grading workflows that use harnessed AI tools, prompts, agents, evaluations, and quality-control processes across X101 and X201, with support for K201, K303, and related Kelley Technology Curriculum Accelerator initiatives.
- Configures, tests, documents, and supports Canvas and AI-assisted grading tools, workflows, prompts, rubrics, evaluations, and related operational processes.
- Develops and maintains workflow documentation, user guidance, training materials, quality-control procedures, and escalation protocols.
- Serves as a primary support point for TAs including AI-assisted grading workflows, including troubleshooting, issue triage, and escalation of items requiring faculty judgment.
- Trains TAs on grading workflows, rubrics, AI-assisted tools, feedback processes, escalation procedures, and quality-control expectations.
- Translates faculty grading expectations into repeatable, documented processes that can be applied consistently by TAs and supported at scale.
- Maintains grading workflow performance, identifies operational issues or risks, and recommends improvements to support consistency, reliability, and scalability.
- Supports student-facing and course-facing operational questions related to Canvas, grading workflows, feedback processes, access issues, and AI curriculum operations.
- Supports AI integration work in K201 and K303, content refreshes, workflow design, testing, term-launch readiness, and implementation of AI-enabled academic operations.
- Builds and maintains reusable AI resources, including prompts, custom GPTs, agents, evaluations, documentation, and standardized workflows for faculty, staff, and student teams.
- Serves as the technology advancement function of the AI Ambassadors program by helping develop shared tooling, improve technical capabilities, and equip student teams with current AI workflows and methods.
- Supports the technology advancement function of the AI Ambassadors program by helping develop shared tooling, improve technical capabilities, and equip student teams with current AI workflows and methods.
- Supports school-level AI curriculum initiatives, including prompt-a-thons, build-a-thons, AI-in-education events, student competitions, and other applied AI programs.
- Collaborates with faculty, staff, student teams, and academic leaders to improve scalable AI-enabled academic operations.
General Responsibilities
- Serves as the highest point of escalation for troubleshooting, analyzing, and designing solutions for problems and bugs in applications and products.
- Manages highly complex upgrades, releases, customization, and documentation of work according to team's established methodology.
- Led in the design, development, and implementation of new software solutions by influencing the services and technologies that are developed.
- Develops best practices for building, testing, and deploying applications.
- Serves as the point of contact with regards to research, evaluation, and guidance for implementation of new and emerging technologies that improve the success of client applications.
- Collaborates with leadership and leads project planning, objective formulation, task estimation and evaluation of customer requests.
- Often provides guidance and feedback to less experienced staff.
Skills
- Proficient communication skills
- Demonstrated problem solving skills
- Ability to simultaneously handle multiple priorities
- Demonstrated customer service skills
- Quickly troubleshoots and resolves problems
- Performs work independently with minimal supervision
- Effectively coaches and delivers constructive feedback
- Demonstrates excellent judgment and decision making skills
- Excellent collaboration and team building skills
Preferred
- Demonstrates ability to use generative AI tools in applied operational workflows
- Ability to configure, test, document, support, and improve AI-enabled tools, workflows, and processes
- Strong troubleshooting, issue-triage, and problem-solving skills
- Ability to create clear workflow documentation, user guidance, training materials, and quality-control procedures
- Strong communication skills and the ability to work effectively with faculty, staff, students, and student employee teams
- Strong operational judgment, attention to detail, and ability to manage multiple concurrent workstreams
- Ability to work independently in an evolving technical and academic environment
- Experience with Canvas or comparable learning management systems
- Experience with grading workflows, rubric-based assessment, academic operations, or educational technology support
- Experience administering, supporting, or improving applications, business systems, AI tools, or comparable technology platforms
- Experience designing reusable AI resources such as prompts, custom GPTs, agents, evaluations, or standardized workflows
- Experience with user support, training, troubleshooting, issue tracking, testing, or workflow documentation
- Experience supporting workshops, build-a-thons, student competitions, training programs, or other applied technology initiatives
- Experience developing or supporting harnessed AI workflows, agent-based tools, evaluations, prompts, guardrails, or other AI operational infrastructure