Skip to main content
Ottawa 2024
Times are shown in your local time zone GMT

Addressing and Reducing Bias in Assessment for Health Professions Education

Conference Workshop
Edit Your Submission
Edit

Presentation Description

Eric Holmboe1
Dowin Boatright2
1 ACGME
2 New York University



Background: 
Assessment is essential to professional development. Assessment provides the information needed to give feedback, support coaching and the creation of individualized learning plans, inform progress decisions, determine appropriate supervision levels, and, most importantly, help ensure patients and families receive high-quality, safe care in the training environment. 

Yet, one of the most significant challenges in assessment is the ongoing and pernicious effects of bias. Learners from diverse backgrounds, including those from racial/ethnic groups typically underrepresented in medicine (URiM) and other groups often marginalized by bias in assessment (e.g., women, people who identify as sexual and gender minorities, people living with disabilities, and more), face additional and unwarranted obstacles in their professional development. Studies from around the globe have documented significant assessment biases in health professions education (HPE), from selection for training programs to assessment of clinical competence. This body of research highlights the urgent need for the HPE community to develop methods and tools training programs should use to identify, address, and reduce bias in their own assessment programs. 


Why this is important: 
When learners experience bias, it results in suboptimal learning environments and compromises learners’ well-being and ability to function at the top of their abilities. For example, multiple studies show learners from historically URiM groups receive lower assessment ratings of clinical competence from faculty. Assessment bias can lead to and reinforce stereotype threat and impostor syndrome. These effects are cumulative and even small differences in assessment can translate to disparities in future opportunities, including training and employment, a phenomenon described as the amplification cascade. 

Workshop format: 
The session will contain three sections. The introduction will provide a synopsis of key findings from the latest research on bias in assessment, including studies and data from a U.S. assessment system using competencies. The second section will provide participants an opportunity to reflect on their own program’s potential sources of bias and how they can identify sources of bias in their assessments. The final section will involve sharing and discussing with participants techniques that can be used to help faculty identify and reduce bias in their program, using recommendations from communication science and psychology. 

  • Theory burst covering key types and sources of bias in assessment and the impacts of bias on professional development.
  • Large group conversation
  • Theory burst on methods and tools to identify various forms of assessment bias in HPE training programs.
  • Small group activity and discussion (with worksheet provided) of participant’s current challenges with assessment bias in their own program.
  • Small group report outs and reflections.
  • Theory burst on recommended approaches to reduce assessment bias by faculty and
  • programs.
  • Small group discussion on how and where participants can apply approaches in their own program. Each participant will create personal action plan.
  • Q&A


Who should participate?
All - 50 maximum Level of workshop: Beginner/Intermediate


Take-home messages:

To ensure assessment in HPE is fair, equitable, and supports all learners, deliberate attention must be directed at reducing bias for groups who have and continue to experience assessment bias in their training programs. 



References (maximum three) 

    1. Boatright D, Anderson N, Kim JG, Holmboe ES, McDade WA, Fancher T, Gross CP, Chaudhry S, Nguyen M, Nguemeni Tiako MJ, Colson E, Xu Y, Li F, Dziura JD, Saha S. Racial and Ethnic Differences in Internal Medicine Residency Assessments. JAMA Netw Open. 2022 Dec 1;5(12):e2247649. 

    2. Lucey CR, Hauer KE, Boatright D, Fernandez A. Medical Education's Wicked Problem: Achieving Equity in Assessment for Medical Learners. Acad Med. 2020 Dec;95(12S Addressing Harmful Bias and Eliminating Discrimination in Health Professions Learning Environments):S98-S108. 

    3. Holmboe ES, Osman NY, Murphy CM, Kogan JR. The Urgency of Now: Rethinking and Improving Assessment Practices in Medical Education Programs. Acad Med. 2023 

Speakers