A Curtis Lee¹
Katrina Dundas¹ and Desley Ward¹
1 Royal Australasian College of Physicians 

The Royal Australasian College of Physicians (RACP) administers 22 high-stakes assessments across Australia and Aotearoa New Zealand, across over 30 exam locations to over 3000 candidates annually. Since 2020, our assessments have needed to accommodate significant emergency situations where changes to our plans were required – including floods, hurricanes, fires, and the COVID-19 pandemic. Based on risk management theory, we have established an extensive approach to contingency planning. 

Our risk management framework spans multiple stages to mitigate risk and identify contingency plans for situation management. The framework covers the following stages: 

This workshop will provide participants a practical opportunity to explore a framework for risk management and contingency planning, drawing on our lessons learned in refining and using this framework. Case studies drawing on our experiences will be used to highlight opportunities and pitfalls. Attendees are encouraged to identify their own assessment scenarios for risk management to explore in the workshop. 

Anticipating issues and planning contingencies is critical to the administration of assessments. This workshop provides a systematic approach to risk management and contingency planning. 

Although the approach was developed during the COVID-19 pandemic, our risk management processes are generic and address contingency planning for all complex planning activities. 

Anyone who organises high-stakes complex assessments and must deal with natural disasters and logistical challenges. 

5. Level of workshop
beginner

High-stakes assessments are often very complex and flexibility and good planning practices are needed to ensure smooth administration. Risk registers and situational management plans (SMPs) and contingency planning are tools that can be used to anticipate how to handle tricky situations and mitigate solutions. 

References (maximum three) 

The Standard for Project Management and a Guide to the Project Management Body of Knowledge (PMBOK Guide) (2021). Project Management Institute ISBN: 9781628256673 

TechTarget (2020). What is a Crisis Management Plan? Techtarget.com. Retrieved July 28, 2023, from https://www.techtarget.com/searchdisasterrecovery/definition/crisis-management- plan-CMP 

Mind tools (2023) Risk Analysis and Risk Management. MindTools. Retrieved July 28, 2023, from 

https://www.mindtools.com/abhkwcn/risk-analysis-and-risk-management 

Sean Gehring¹
Jon Dupre², Viren Naik³ and Paul Glover²
1 The Royal College of Dentists of Canada
2 risr/
3 Medical Council of Canada

Background:
The COVID-19 pandemic significantly disrupted education systems worldwide, forcing a swift shift towards remote learning and alternative assessment methodologies. As the pandemic recedes, educators and policymakers are contemplating the future directions of high- stakes assessment to accommodate the lessons learned and capitalize on newfound opportunities. This panel session delves into the key aspects that will shape the landscape of high-stakes assessment in the post-COVID era. 

Why is the topic important for practice:
The panel will discuss the necessity for flexibility and adaptability in future assessment design. The pandemic exposed the limitations of traditional paper-based exams and standardized testing, underscoring the need for diversified assessment methods that accommodate different formats and contexts. The panel will examine the role of technology in reshaping assessment practices. The accelerated adoption of digital tools during the pandemic laid the groundwork for embracing technology-driven assessment methodologies and enhancing the authenticity, security, and personalized feedback in high-stakes assessments. 

Next, the panel will address the importance of addressing equity and inclusivity concerns. COVID-19 exacerbated existing educational disparities, disproportionately affecting marginalized students. As high-stakes assessments impact students' future opportunities, it is crucial to ensure fairness and mitigate biases in assessment content and delivery, safeguarding against further inequities. Finally, the panel will consider how the remote testing and online proctoring became prevalent, raising concerns about the validity and security of results. Moving forward, a hybrid approach that combines in-person and virtual testing may emerge to strike a balance between accessibility and maintaining the integrity of assessments. 

Symposium format, including participant engagement methods:
Panel discussions will explore the role of technology in reshaping assessment practices, address equity concerns, and examine the emergence of hybrid assessment approaches. Engaging the audience through Q&A, real- world scenario activities, and reflective discussions, the symposium aims to empower educators and policymakers to reimagine assessment for a more equitable and effective educational landscape. 

Take-home messages / symposium outcomes:
The post-COVID era presents an opportune moment for educators and policymakers to reimagine high-stakes assessment. By embracing flexibility, technology, inclusivity, and competency-based frameworks, the future of assessment can evolve into a more equitable, relevant, and effective system, empowering students to thrive in an ever-changing world. 

Participants will leave the session: 

References (maximum three) 

Morin, M., Alves, C., & De Champlain, A. (2021). The show must go on: Lessons learned from using remote proctoring in a high-stakes medical licensing exam program in response to severe disruption. Journal of Applied Testing Technology, 23, 15-35. 

Joyce P, Cassidy D, Kenna L. Evaluation of Virtual Assessment for a High Stakes' Clinical Examination-Physician Assistant Students' and Their Examiners' Perspectives. J Physician Assist Educ. 2023 Jul 27. doi: 10.1097/JPA.0000000000000516. Epub ahead of print. PMID: 37498782.