Skip to main content
Ottawa 2024
Times are shown in your local time zone GMT

Early and persistent completion of multiple-choice questions predicts exam performance in USA medical licencing exam Step 1  

Oral Presentation
Edit Your Submission
Edit

Oral Presentation

1:45 pm

26 February 2024

M204

Assessment across borders

Presentation Description

Christian Gray1
 1 Academy for Medical Education, The University of Queensland Medical School 



Background
In partnership with the University of Queensland, MD students from the Ochsner Health System (New Orleans, LA) complete their first two years in Australia, before completing two additional years of medical training in the USA. Students must attempt the first of three National Board of Medical Examiners (NBME) United States Medical Licensing Examination (USMLE) Step exams (Step 1) prior to starting year 3 (1). A dedicated USMLE preparation course was established to support students’ preparation for Step 1, including access to a Step 1 questions bank. 


Summary of Work
The purpose of this study was to evaluate student performance in Step 1 in relation to timing of completion of USMLE Step 1 questions. NMBE Comprehensive Based Science Exam (CBSE) exams were used to identify readiness to take Step 1. Completion of Step 1 questions were monitored through a question bank (UWorld). 


Results
The CBSE significantly correlates with performances in Step 1 and is used to assess students’ readiness to take the Step 1 exam (1). The number of practice questions completed prior to Step 1 significantly correlated with Step 1 results. Early and persistent engagement with practice questions is correlated with success, with numbers of questions answered correctly correlating even more strongly with exam performance. 


Discussion and Conclusions
Early and persistent engagement with Step 1 practice questions is an effective strategy to ensure students are read to sit Step 1 (2). Students who choose to “save questions” believing they are not ready are negatively impacting their progress. The strong correlation between questions answered correctly and performance suggests that an understanding of the content of the question is important, supported through a solid foundation in clinical sciences. 


Take-home messages
Early, consistent, and correct completion of Step 1 questions are crucial factors associated with success in medical licensing examinations. 



References (maximum three) 

1. Johnson TR, Khalil MK, Peppler RD, Davey DD, Kibble JD. Use of the NBME Comprehensive Basic Science Examination as a progress test in the preclerkship curriculum of a new medical school. Adv Physiol Educ. 2014 Dec;38(4):315-20. doi: 10.1152/advan.00047.2014. PMID: 25434014. 

2. Andre D Kumar and others, preparing to take the USMLE Step 1: a survey on medical students’ self-reported study habits, Postgraduate Medical Journal, Volume 91, Issue 1075, May 2015, Pages 257–261 

Speakers