Presentation Description
Michelle Hannington1
1 University of Cape Town
1 University of Cape Town
Background
Health professions education (HPE), including occupational therapy (OT), faces ongoing challenges in developing valid assessment practices, which goes beyond test characteristics, but result in evidentiary-based decisions(1). HPE assessment often prioritises dominant epistemological practices, which may not align with OT. This could result in decisions that are not valid for the profession, or the South African (SA) context. This study aimed to examine the current landscape of assessment in OT education.
Health professions education (HPE), including occupational therapy (OT), faces ongoing challenges in developing valid assessment practices, which goes beyond test characteristics, but result in evidentiary-based decisions(1). HPE assessment often prioritises dominant epistemological practices, which may not align with OT. This could result in decisions that are not valid for the profession, or the South African (SA) context. This study aimed to examine the current landscape of assessment in OT education.
Methods
A scoping review was conducted using best practice(2,3). Medline, ERIC, Ebscohost, and ProQuest were searched for articles, with additional handsearching and pearlgrowing, to include all relevant literature on assessment practices in entry-level OT education. Data extraction and a descriptive summary were conducted, followed by thematic analysis of the qualitative data.
Results
Forty studies were included, with the majority (92.5%) coming from the global north. The most discussed assessment methods were objective structured practical exams (OSPE) and competency-based assessments. The justifications for these methods primarily stemmed from their use in medical education. While many papers emphasised a need for alignment with the philosophy of OT, only 26% of the papers demonstrated actual application of these principles in their assessment practice.
Discussion & Conclusions
The findings highlight the influence of both contextual (global north) and professional (medical education) factors on OT assessment practices, with a ‘lift and shift’ phenomenon evident. Common critiques of current assessments included a lack of fluency to OT, insufficient alignment with real-world practice, and poor correlation of assessment scores to clinical practice.
Implications for further research
Future research should investigate the impact of this transfer and the influence it has on the validity of decision making. Identifying assessment practices best suited to OT in the SA context, will better equip graduates to embrace the unique value of OT, and provide services that meet the population's needs.
References (maximum three)
1. St-Onge, C., Young, M., Eva, K. W., & Hodges, B. (2017). Validity: One word with a plurality of meanings. Advances in Health Sciences Education, 22(4), 853–867. https://doi.org/10.1007/s10459-016-9716-3
2. Arksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616
3. Levac, D., Colquhoun, H., & O’Brien, K. K. (2010). Scoping studies: Advancing the methodology. Implementation Science, 5(1), 69. https://doi.org/10.1186/1748-5908-5-69