ePoster
100% Page: /
Presentation Description
Andrew Ming-Liang Ong1,2
Clasandra Hum1, Ching Ming Wan1, Jodie Lee1, Wai Yee Phoon1 and Hak Khoon Tan1
1 Graduate Medical Education Office, Singhealth, Singapore
2 Department of Gastroenterology & Hepatology, Singapore General Hospital
Clasandra Hum1, Ching Ming Wan1, Jodie Lee1, Wai Yee Phoon1 and Hak Khoon Tan1
1 Graduate Medical Education Office, Singhealth, Singapore
2 Department of Gastroenterology & Hepatology, Singapore General Hospital
Abstract
Singaporean postgraduate programs are transitioning to EPAs. Online assessment platform, MedHub, was introduced to accommodate this. We describe our organisational faculty development (FD) strategy & successful implementation.
Summary of work:
Modified Delphi consensus with 17 individuals (7 program directors(PD), 6 program coordinators and 4 vice-chairs). 16 principles chosen to reflect EPA implementation, divided into 5 phases for longitudinal and systematic FD.
Phase 1
-
Period
- Sep2022
-
Aim
- Introduce Programmatic Assessment(PA) & EPAs
-
Attendance
- 100
-
Activities
- (1)Didactic session
- (2)How-to Videos & Resources created in learning management system (LMS)
- (3)EPA implementation guide disseminated
Phase 2(The Right Tool)
-
Period
- Nov2022
-
Aim
- Designing assessment strategy & tools wth MedHub
-
Attendance
- 60
-
Activities
- (1)+(2)+(3)Workshop designing tools
- (1)+(2)+(3)Workshop designing tools
Phase 3(The Right Interpretation)
-
Period
- Jan2023
-
Aim
- Structuring Clinical Competency Committee(CCC) meetings & reports using MedHub
-
Attendance
- 87
-
Activities
- (1)+(2)+(3)Workshop running CCC
- (1)+(2)+(3)Workshop running CCC
Phase 4(The Right Assessors)
-
Period
- Mar2023
-
Aim
- Train assessors
-
Attendance
- 121
-
Activities
- (1)+(2)+(3)Designing guidebook to train faculty
Phase 5(The Right Feedback)
-
Period
- May2023
-
Aim
- Train learners
-
Attendance
- 127
-
Activities
- (1)+(2)+(3)Designing guidebook to train learners
- (1)+(2)+(3)Designing guidebook to train learners
Results/Discussion
11 PDs completed surveys pre-implementation and at 1-year. Each principle marked “not planned/implemented(0)”, “planned(1)” and “implemented(2)”. Moving from 0 to 1/2 or 1 to 2 considered improvement.
| Phase | Principle | % of programs with improvement |
| 1 | Purpose of EPAs within PA made clear | 90.9% |
| 2 | EPA assesment tool captures entrustment-based decision | 100.0% |
| 2 | Workflow to trigger EPA assessment | 81.8% |
| 2 | MedHub collects EPAs AND competencies data | 90.9% |
| 3 | CCC workflow evaluating EPA AND Competencies using MedHub | 54.5% |
| 3 | CCC pre-defined triangulation rules of EPA and existing tools | 54.5% |
| 3 | CCC reports include milestones and EPA entrustment | 54.5% |
| 4 | Shared mental model (SMM) of each EPA disseminated | 81.8% |
| 4 | SMM for entrustment concept disseminated | 81.8% |
| 5 | Workflow sharing assessment data with residents | 54.5% |
| 5 | Residents trained to improve using EPA data | 45.5% |
| 5 | Faculty trained to deliver EPA feedback | 81.8% |
| 5 | Learning activities pegged to EPAs | 81.8% |
| 5 | EPA Resources available | 72.7% |
| 5 | EPA Orientation material available Structured EPA FD program | 90.9% |
| 81.8% |
Conclusions:
We describe a novel 1-year FD program using 16 core EPA implementation principles spanning 5 phases, supported by successful program improvement rates. We will adopt this for future FD within our institution.
References (maximum three)
Carraccio C, Martini A, Van Melle E, Schumacher DJ. Identifying Core Components of EPA Implementation: A Path to Knowing if a Complex Intervention Is Being Implemented as Intended. Acad Med. 2021 Sep 1;96(9):1332-1336. doi: 10.1097/ACM.0000000000004075. PMID: 33769339.
Hennus MP, Jarrett JB, Taylor DR, Ten Cate O. Twelve tips to develop entrustable professional activities. Med Teach. 2023 Jul;45(7):701-707. doi: 10.1080/0142159X.2023.2197137. Epub 2023 Apr 7. PMID: 37027517
Favreau MA, Tewksbury L, Lupi C, Cutrer WB, Jokela JA, Yarris LM; AAMC Core Entrustable Professional Activities for Entering Residency Faculty Development Concept Group. Constructing a Shared Mental Model for Faculty Development for the Core Entrustable Professional Activities for Entering Residency. Acad Med. 2017 Jun;92(6):759-764. doi: 10.1097/ACM.0000000000001511. PMID: 28557935.