Presentation Description
Debra Sibbald1
Andrea Sweezey1
1 Leslie Dan Faculty of Pharmacy, University of Toronto
Andrea Sweezey1
1 Leslie Dan Faculty of Pharmacy, University of Toronto
Background
Assessment of intrinsic skills is important in health professions’ admission processes. Admission criteria for U of T Pharmacy changed in 2019, 2020 and 2021 to address pandemic constraints and broaden access. Associations with each cohort of admission applicant data, and impact on early (1st and 2nd) year-end performance are reported.
Summary Of Work
Admissions statistics for 3 cohorts (n=720) with different admission criteria were analyzed for applicant variables and year end correlations. Data, including GPA, PCAT score, situational judgment tests (MMI, CASPer and a mixed methods online assessment [MMOA]), were compared to year end performance. A linear regression model examined admission metrics for prediction of in-program grades.
Summary Of Results
In each cohort, only entry GPA significantly predicted year end results (1st year: 2019: r2 = 0.106, p <0.001; 2020: r2 = 0.113, p < 0.001; 2021: r2 = 0.228, p < 0.001 ); 2nd year: 2019: r2 = 0.106, p <0.001; 2020: r2 = 0.261, p < 0.001; 2021: r2 = 0.055, p < 0.001). No other significant predictors were found. MMI (2019) and CASPer (2020) contributed to regression model results. Widening access by decreasing required courses, eliminating PCAT, and creating an online assessment resulted in increased applicant numbers (3.4 times increase from 2020 vs 2021), and higher minimum and average GPAs on entry.
Discussion And Conclusion
Results from three cohorts with varied admission criteria suggest GPA is the strongest predictor of early year in-program metrics. Although not predictive, situational judgment tests including online versions, provide useful screening criteria to differentiate diverse applicants. Predictors of program metrics in senior years (3rd and 4thyear) are currently being examined for impact and relevant differences.
Take Home Messages
Changing admission criteria positively influenced admission applications with no apparent negative impact on year-end performance.
References (maximum three)
- Greatrix R, Nicholson S, Anderson S. Does the UKCAT predict performance in medical and dental school? A systematic review. BMJ Open 2021;11:e040128. doi:10.1136/ bmjopen-2020-040128
- Barber, C., Burgess, R., Mountjoy, M., Whyte, R., Vanstone, M., & Grierson, L. (2022). Associations between admissions factors and the need for remediation. Advances in Health Sciences Education, 27(2), 475-489.
- Cameron, A. J., MacKeigan, L. D., Mitsakakis, N., & Pugsley, J. A. (2017). Multiple mini‐interview predictive validity for performance on a pharmacy licensing examination. Medical Education, 51(4), 379-389.
- Dore, K. L., Reiter, H. I., Kreuger, S., & Norman, G. R. (2017). CASPer, an online pre- interview screen for personal/professional characteristics: Prediction of national licensure scores. Advances in Health Sciences Education, 22(2), 327-336. https://doi.org/10.1007/s10459-016-9739-9