Journal article
Does the Medical Student Performance Evaluation Change the Decision to Invite Residency Applicants?
The western journal of emergency medicine, v 22(5), pp 1102-1109
21 Aug 2021
PMID: 34546886
Featured in Collection : UN Sustainable Development Goals @ Drexel
Abstract
Although emergency medicine (EM) residency program directors (PD) have multiple sources to evaluate each applicant, some programs await the release of the medical student performance evaluation (MSPE) to extend interview offers. While prior studies have demonstrated that MSPE content is variable and selectively positive, no prior work has evaluated the impact of the MSPE on the likelihood to invite (LTI) applicants for a residency interview. This study aimed to evaluate how information in the MSPE impacted LTI, with the hypothesis that changes in LTI would be relatively rare based on MSPE review alone.
We conducted a prospective, observational study analyzing applications to three EM residency programs during the 2019-2020 match cycle. Reviewers assessed applications and rated the LTI on a five-point Likert scale where LTI was defined as follows: 1 = definitely no; 2 = probably no; 3 = unsure; 4 = probably yes; and 5 = definitely yes. The LTI was recorded before and after MSPE review. A change in LTI was considered meaningful when it changed the overall trajectory of the applicant's likelihood to receive an invitation to interview.
We reviewed a total of 877 applications with the LTI changing ≥1 point on the Likert scale 160 (18.2%) times. The LTI was meaningfully impacted in a minority of applications - 48 total (5.5 %, p< 0.01) - with only 1 (0.11%) application changing from 1 or 2 (definitely/probably no) to 4 or 5 (probably/definitely yes) and 34 (3.8%) changing from 3 (unsure) to 4 or 5 (probably/definitely yes). Thirteen (1.5%) applications changed from 4 or 5 (probably/definitely yes) to 3 (unsure or probably/definitely no).
Review of the MSPE resulted in a meaningful change in LTI in only 5.5% of applications. Given the time required for program leadership to review all parts of the variably formatted MSPEs, this finding supports a more efficient application review, where the PD's focus is on succinct and objective aspects of the application, such as the Standardized Letter of Evaluation.
Metrics
Details
- Title
- Does the Medical Student Performance Evaluation Change the Decision to Invite Residency Applicants?
- Creators
- Terra N Thimm - West Virginia UniversityChristopher S Kiefer - West Virginia UniversityMara S Aloi - Allegheny General HospitalMoira Davenport - West Virginia UniversityJared Kilpatrick - West Virginia UniversityJeffrey S Bush - West Virginia UniversityLindsey Jennings - West Virginia UniversityStephen M Davis - West Virginia UniversityKimberly Quedado - Allegheny General HospitalErica B Shaver - West Virginia University
- Publication Details
- The western journal of emergency medicine, v 22(5), pp 1102-1109
- Resource Type
- Journal article
- Language
- English
- Academic Unit
- Emergency Medicine
- Web of Science ID
- WOS:000696926300013
- Scopus ID
- 2-s2.0-85115998090
- Other Identifier
- 991021903296904721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Collaboration types
- Domestic collaboration
- Web of Science research areas
- Emergency Medicine