Presentation Description
Maxim Morin1
Viren Naik1, Sean Gehring2, Jon Dupre3 and Paul Glover3
1 Medical Council of Canada
2 The Royal College of Dentists of Canada
3 risr/
Viren Naik1, Sean Gehring2, Jon Dupre3 and Paul Glover3
1 Medical Council of Canada
2 The Royal College of Dentists of Canada
3 risr/
Background:
The delivery of high-stakes certification examinations is a critical aspect of many industries, including professional certifications and licensure. With the advent of technological advancements, multiple delivery modalities have emerged, such as remote proctoring, test centers, and pop-up test centers. This interactive workshop aims to compare the benefits, challenges and issues with these modalities using business case methodology and Van der Vleuten’s framework for evaluating the utility of assessment methods.
The delivery of high-stakes certification examinations is a critical aspect of many industries, including professional certifications and licensure. With the advent of technological advancements, multiple delivery modalities have emerged, such as remote proctoring, test centers, and pop-up test centers. This interactive workshop aims to compare the benefits, challenges and issues with these modalities using business case methodology and Van der Vleuten’s framework for evaluating the utility of assessment methods.
Importance for Research and Practice:
Research and practice in the field of high-stakes certification examinations must constantly evaluate the delivery modalities to ensure optimal outcomes.Thisworkshopaddressestheneedtoexaminetheimplications andrisksofdifferent delivery options, enabling participants to make informed decisions and implement efficient strategies in their respective organizations.
Research and practice in the field of high-stakes certification examinations must constantly evaluate the delivery modalities to ensure optimal outcomes.Thisworkshopaddressestheneedtoexaminetheimplications andrisksofdifferent delivery options, enabling participants to make informed decisions and implement efficient strategies in their respective organizations.
Workshop Format and Participant Engagement Methods:
The workshop will utilize a combination of business case studies, group discussions, and interactive exercises to actively engage participants. Use cases representing different industries and scenarios will be presented, allowing participants to analyze and evaluate the implications and risks associated with remote proctoring, test centers, and pop-up test centers. Group discussions will facilitate knowledge sharing and the exploration of practical strategies.
The workshop will utilize a combination of business case studies, group discussions, and interactive exercises to actively engage participants. Use cases representing different industries and scenarios will be presented, allowing participants to analyze and evaluate the implications and risks associated with remote proctoring, test centers, and pop-up test centers. Group discussions will facilitate knowledge sharing and the exploration of practical strategies.
Target Participants:
This workshop is suitable for professionals involved in high-stakes certification examinations, including certification program managers, industry representatives, testing experts, policymakers, and individuals interested in assessment delivery. Participants will benefit from the multidimensional perspectives and diverse experiences in managing certification programs.
This workshop is suitable for professionals involved in high-stakes certification examinations, including certification program managers, industry representatives, testing experts, policymakers, and individuals interested in assessment delivery. Participants will benefit from the multidimensional perspectives and diverse experiences in managing certification programs.
Workshop Level:
This workshop is designed for intermediate-level participants who possess a foundational understanding of high-stakes certification examination processes. It is suitable for individuals seeking to deepen their knowledge and engage in practical discussions and decision-making related to delivery modalities. Intermediate-level knowledge of cost analysis and risk assessment is recommended.
This workshop is designed for intermediate-level participants who possess a foundational understanding of high-stakes certification examination processes. It is suitable for individuals seeking to deepen their knowledge and engage in practical discussions and decision-making related to delivery modalities. Intermediate-level knowledge of cost analysis and risk assessment is recommended.
Take-home Messages, Workshop Outcomes, and Implications for Further Research or Practice:
a) Enhanced understanding of the benefits, challenges and issues associated with different delivery modalities for high-stakes certification examinations.
b) Identification of key factors influencing cost analysis and risk assessment in remote proctoring, test centers, and pop-up test centers.
c) Comparison of business models and frameworks that can be used to evaluate the various implications and risks of each delivery modality.
d) Identification of potential research gaps and areas for further exploration, such as long-term cost analysis, scalability, and technological advancements in delivery modalities.
The workshop outcomes will enable participants to make informed decisions regarding the most suitable delivery modality for their certification programs. They will also contribute to the development of best practices and guidelines in the field of high-stakes certification examination delivery.
References (maximum three)
Morin, M., Alves, C., & De Champlain, A. (2021). The show must go on: Lessons learned from using remote proctoring in a high-stakes medical licensing exam program in response to severe disruption. Journal of Applied Testing Technology, 23, 15-35.
Cherry, G., O'Leary, M., Naumenko, O., Kuan, L. A., & Waters, L. (2021). Do outcomes from high stakes examinations taken in test centres and via live remote proctoring differ?. Computers and Education Open, 2, 100061.
Van Der Vleuten, C. P., & Schuwirth, L. W. (2005). Assessing professional competence: from methods to programmes. Medical education, 39(3), 309-317.