Journal article
The Creation of Standard-Setting Videos to Support Faculty Observations of Learner Performance and Entrustment Decisions
Academic medicine, v 91(2), pp 204-209
Feb 2016
PMID: 26266461
Featured in Collection : UN Sustainable Development Goals @ Drexel
Abstract
Entrustable professional activities (EPAs) provide a framework to standardize medical education outcomes and advance competency-based assessment. Direct observation of performance plays a central role in entrustment decisions; however, data obtained from these observations are often insufficient to draw valid high-stakes conclusions. One approach to enhancing the reliability and validity of these assessments is to create videos that establish performance standards to train faculty observers. Little is known about how to create videos that can serve as standards for assessment of EPAs.The authors report their experience developing videos that represent five levels of performance for an EPA for patient handoffs. The authors describe a process that begins with mapping the EPA to the critical competencies needed to make an entrustment decision. Each competency is then defined by five milestones (behavioral descriptors of performance at five advancing levels). Integration of the milestones at each level across competencies enabled the creation of clinical vignettes that were converted into video scripts and ultimately videos. Each video represented a performance standard from novice to expert. The process included multiple assessments by experts to guide iterative improvements, provide evidence of content validity, and ensure that the authors successfully translated behavioral descriptions and vignettes into videos that represented the intended performance level for a learner. The steps outlined are generalizable to other EPAs, serving as a guide for others to develop videos to train faculty. This process provides the level of content validity evidence necessary to support using videos as standards for high-stakes entrustment decisions.
Metrics
Details
- Title
- The Creation of Standard-Setting Videos to Support Faculty Observations of Learner Performance and Entrustment Decisions
- Creators
- Sharon Calaman - Drexel UniversityJennifer H Hepps - Walter Reed Army Institute of ResearchZia Bismilla - University of TorontoCarol Carraccio - American Board of SurgeryRobert Englander - Administration (TMED)Angela Feraco - Harvard University ,Christopher P Landrigan - Harvard University ,Joseph O Lopreiato - Uniformed Services University of the Health SciencesTheodore C Sectish - Harvard University ,Amy J Starmer - Harvard University ,Clifton E Yu - Uniformed Services University of the Health SciencesNancy D Spector - Drexel UniversityDaniel C West - University of California, San FranciscoI-PASS Study Education Executive Committee
- Publication Details
- Academic medicine, v 91(2), pp 204-209
- Publisher
- Lippincott
- Grant note
- 1R18AE000029-01 / ASPE HHS 1K12HS019456-01 / AHRQ HHS
- Resource Type
- Journal article
- Language
- English
- Academic Unit
- Pediatrics
- Web of Science ID
- WOS:000369297000021
- Scopus ID
- 2-s2.0-84955605706
- Other Identifier
- 991019168092404721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Collaboration types
- Domestic collaboration
- International collaboration
- Web of Science research areas
- Education, Scientific Disciplines
- Health Care Sciences & Services