Presentation Description
Amanda Wilson1
1 UTS
1 UTS
1. Background:
In the contemporary academic environment, students desire for more consistent, personalised, and actionable feedback. This project describes a novel rubric design called the ‘marking algorithm’. This rubric is a step-by-step, decision-making tool designed to guide educators through a standardised process for assigning marks. The algorithm acts as a systematic guide which evaluates various criteria, such as accuracy, relevance or reference quality. The algorithm pathways lead the marker from one criterion to the next based on previous evaluations. For each criterion encountered, the algorithm assigns a specific grade or number of points. The process is iterative so if subsequent sections provide additional context, the algorithm may return to earlier decision nodes to adjust scores.
In the contemporary academic environment, students desire for more consistent, personalised, and actionable feedback. This project describes a novel rubric design called the ‘marking algorithm’. This rubric is a step-by-step, decision-making tool designed to guide educators through a standardised process for assigning marks. The algorithm acts as a systematic guide which evaluates various criteria, such as accuracy, relevance or reference quality. The algorithm pathways lead the marker from one criterion to the next based on previous evaluations. For each criterion encountered, the algorithm assigns a specific grade or number of points. The process is iterative so if subsequent sections provide additional context, the algorithm may return to earlier decision nodes to adjust scores.
2. Why is the topic important for practice?:
Current evaluation methods mean discrepancies in marking are inevitable. A standardised and transparent system like the "marking algorithm" can streamline the marking process, ensuring consistency and enhancing the overall educational experience.
3. Symposium Format & Participant Engagement Methods:
- Opening Session: Changing dynamics of academic feedback and the need for evolution.
- Interactive Workshop: Participants will be guided on converting a traditional rubric into a marking algorithm, offering hands-on experience.
- Breakout Sessions:
- A: Exploring the intricacies of the marking algorithm: design, process, and functionality.
- B: AI's role in academic marking: a glimpse into the future.
- Q&A Session:
- Feedback & Reflection: Attendees share thoughts, concerns, and suggestions.
4. Take-home Messages / Symposium Outcomes / Implications for Further Research and/or Practice:
Awareness of the need for more consistent and transparent academic evaluations.
- Skill Acquisition: Capability to convert traditional rubrics into a marking algorithm.
- Vision for the Future: Potential of AI and algorithmic tools in reshaping the academic marking.
- Action Items: Educators will gain insights and tools to implement and adapt the marking algorithm.
References (maximum three)
- No references