Journal article
Feasibility and preliminary validity evidence for remote video-based assessment of clinicians in a global health setting
PloS one, v 14(8), pp e0220565-e0220565
02 Aug 2019
PMID: 31374102
Featured in Collection : UN Sustainable Development Goals @ Drexel
Abstract
Background
Serious childhood illnesses (SCI), defined as severe pneumonia, severe dehydration, sepsis, and severe malaria, remain major contributors to amenable child mortality worldwide. Inadequate recognition and treatment of SCI are factors that impact child mortality in Botswana. Skills assessments of providers caring for SCI have not been validated in low and middle-income countries.
Objective
To establish preliminary inter-rater reliability, validity evidence, and feasibility for an assessment of providers who care for SCI using simulated patients and remote video capture in community clinic settings in Botswana.
Methods
This was a pilot study. Four scenarios were developed via a modified Delphi technique and implemented at primary care clinics in Kweneng, Botswana. Sessions were video captured and independently reviewed. Response process and internal structure analysis utilized intra-class correlation (ICC) and Fleiss' Kappa. A structured log was utilized for feasibility of remote video capture.
Results
Eleven subjects participated. Scenarios of Lower Airway Obstruction (ICC = 0.925, 95% CI 0.695-0.998) and Hypovolemic Shock from Severe Dehydration (ICC = 0.892, 95% CI 0.596-0.997) produced excellent ICC among raters while Lower Respiratory Tract Infection (LRTI, ICC = 0, 95% CI -0.034-0.97) and LRTI + Distributive Shock from Sepsis (0.365, 95% CI -0.025-0.967) were poor. Oxygen therapy (0.707), arranging transport (0.706), and fluid administration (0.701) demonstrated substantial task reliability.
Conclusions
Initial development of an assessment tool demonstrates many, but not all, criteria for validity evidence. Some scenarios and tasks demonstrate excellent reliability among raters, but others may be limited by manikin design and study implementation. Remote simulation assessment of some skills by clinic-based providers in global health settings is reliable and feasible.
Metrics
Details
- Title
- Feasibility and preliminary validity evidence for remote video-based assessment of clinicians in a global health setting
- Creators
- Katherine A. Smith - Children's Hospital of PhiladelphiaSegolame Setlhare - American Heart AssociationAllan DeCaen - University of AlbertaAaron Donoghue - University of PennsylvaniaJanell L. Mensinger - Drexel UniversityBingqing Zhang - Children's Hospital of PhiladelphiaBrennan Snow - College Station Medical CenterDikai Zambo - Botswana Open UniversityKagiso Ndlovu - University of BotswanaRyan Littman-Quinn - Botswana Open UniversityFarhan Bhanji - McGill UniversityPeter A. Meaney - Stanford University
- Publication Details
- PloS one, v 14(8), pp e0220565-e0220565
- Publisher
- Public Library Science
- Number of pages
- 13
- Grant note
- American Heart Association B-Line Foundation
- Resource Type
- Journal article
- Language
- English
- Web of Science ID
- WOS:000484991500020
- Scopus ID
- 2-s2.0-85071193716
- Other Identifier
- 991019357765204721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Collaboration types
- Domestic collaboration
- International collaboration
- Web of Science research areas
- Critical Care Medicine