Logo image
Back
Milestone Ratings and Supervisory Role Categorizations Swim Together, but Is the Water Muddy?
Journal article   Open access   Peer reviewed

Milestone Ratings and Supervisory Role Categorizations Swim Together, but Is the Water Muddy?

Daniel J. Schumacher, Kathleen W. Bartlett, Sean P. Elliott, Catherine Michelson, Tanvi Sharma, Lynn C. Garfunkel, Beth King, Alan Schwartz, APPD LEARN CCC Study Group and Sharon Calaman
Academic pediatrics, v 19(2)
Mar 2019
DOI: https://doi.org/10.1016/j.acap.2018.06.002
PMID: 29925038
Featured in Collection :   UN Sustainable Development Goals @ Drexel
url
https://doi.org/10.1016/j.acap.2018.06.002View
Published, Version of Record (VoR)Open Access (License Unspecified),  Open

Abstract

clinical competency committee entrustment graduate medical education milestone-based assessment pediatrics
This single-specialty, multi-institutional study aimed to determine 1) the association between milestone ratings for individual competencies and average milestone ratings (AMRs) and 2) the association between AMRs and recommended supervisory role categorizations made by individual clinical competency committee (CCC) members. During the 2015–16 academic year, CCC members at 14 pediatric residencies reported milestone ratings for 21 competencies and recommended supervisory role categories (may not supervise, may supervise in some settings, may supervise in all settings) for residents they reviewed. An exploratory factor analysis of competencies was conducted. The associations among individual competencies, the AMR, and supervisory role categorizations were determined by computing bivariate correlations. The relationship between AMRs and recommended supervisory role categorizations was examined using an ordinal mixed logistic regression model. Of the 155 CCC members, 68 completed both milestone assignments and supervision categorizations for 451 residents. Factor analysis of individual competencies controlling for clustering of residents in raters and sites resulted in a single-factor solution (cumulative variance: 0.75). All individual competencies had large positive correlations with the AMR (correlation coefficient: 0.84–0.93), except for two professionalism competencies (Prof1: 0.63 and Prof4: 0.65). When combined across training year and time points, the AMR and supervisory role categorization had a moderately positive correlation (0.56). This exploratory study identified a modest correlation between average milestone ratings and supervisory role categorization. Convergence of competencies on a single factor deserves further exploration, with possible rater effects warranting attention.

Metrics

4 Record Views
6 citations in Web of Science
7 citations in Scopus

Details

UN Sustainable Development Goals (SDGs)

This publication has contributed to the advancement of the following goals:

#4 Quality Education

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Collaboration types
Domestic collaboration
Web of Science research areas
Pediatrics
Logo image