Workshop Facilitators: Dr Gil Myers, Dr Alison Sturrock, Prof Chris McManus

In-depth information on how candidates respond to single best answer items during a real time-limited examination has been made possible with the advent of computer-based tests(CBT)(1). We have developed a programme to create a “ClickStream” (2) of keyboard/mouse movements. This allows us to visualise how students move between questions, view images, select answers, revise answers, and return to questions. Due to the precise timing of events and volume of data produced, it is challenging to interpret these events so we have created visual “ClickMaps”(3) of behavioural patterns, allowing us to quickly evaluate detailed maps of candidate behaviour. We will discuss our ClickMap and inferences, and outline different strategies used by candidates. We have evidence from multiple student groups about how candidates behave and the effect that their methods have on their outcomes. As collusion is a worry in high-stakes assessments, the introduction of CBT has made this worry more acute. We will examine our “ClickMaps” patterns in light of Acinonyx data and discussions around cheating.