Presentation Description
Julie Willems1
Annette Mercer1 and Edward Li2
1 Monash University
2 Pearson VUE
Annette Mercer1 and Edward Li2
1 Monash University
2 Pearson VUE
1. Background
The University Clinical Aptitude Test (UCAT) is a computer-based aptitude test used by some universities in Australia and New Zealand towards student selection into medicine or dentistry (UCAT_ANZ). It is also used in the United Kingdom (UKCAT). The UCAT is comprised of four cognitive skills subtests (Verbal Reasoning, Decision Making, Quantitative Reasoning, and Abstract Reasoning) and a fifth non-cognitive Situational Judgement subtest [1].
2. Summary of work
Traditionally, candidates sit the UCAT in dedicated test centres with configured computers, but the COVID-19 pandemic necessitated a rapid shift to online-proctored testing for many candidates. Online testing requires strict technical requirements and proctoring protocols, demanding a strong and reliable internet connection. The study examines the results of candidates taking exams both in test centres and online.
3. Results
A perception lingers that sitting the UCAT online yields higher results than at test centres. The UKCAT compared results in 2020 and found a marked difference of scores between those sitting online versus those sitting at a test centre. For UCAT_ANZ, the results were less clear.
4. Discussion
The effectiveness of online testing appears to depend on candidate cohorts. It may work well for mature audiences, but for the UCAT_ANZ exam where most candidates are younger school leavers, test centre-based testing seems more suitable.
The effectiveness of online testing appears to depend on candidate cohorts. It may work well for mature audiences, but for the UCAT_ANZ exam where most candidates are younger school leavers, test centre-based testing seems more suitable.
5. Conclusions
To minimise variations in the test experience and avoid in-house disruptions negatively affecting candidate performance, it is recommended for all ANZ candidates, including those with special accommodations, to sit the UCAT at test centres wherever possible.
6. Take-home messages / implications for further research or practice
- Online testing has its uses but is not suitable for all.
- Not everything read on candidate forums is reliable information.
References (maximum three)
- [1] UCAT ANZ Test Format. https://www.ucat.edu.au/about-ucat-anz/test-format/