Logo image
Back
Development and Reliability of a Competency Assessment Tool for Magnetic Sphincter Augmentation of the Esophagus (MSA CAT) as Part of a Video-based Surgical Quality Assurance Program for the GOLF Trial
Journal article   Open access   Peer reviewed

Development and Reliability of a Competency Assessment Tool for Magnetic Sphincter Augmentation of the Esophagus (MSA CAT) as Part of a Video-based Surgical Quality Assurance Program for the GOLF Trial

Nainika Menon, Paul Goldsmith, Richard Owen, Heidi Paine, Maria Bencivenga, Luigi Bonavina, James Gossage, Christian A Gutschow, Sumeet Mittal, Jessica M Leers, …
Annals of surgery, Forthcoming
06 Aug 2026
DOI: https://doi.org/10.1097/SLA.0000000000007160
PMID: 42557598
Featured in Collection :   Drexel's Newest Publications
url
https://research-information.bris.ac.uk/en/publications/5296d6c2-55e6-434e-89bb-eb99c3e731b1View
Open

Abstract

magnetic sphincter augmentation surgical quality assurance; GOLF; antireflux surgery
The development and reliability testing of a video-based competency assessment tool for magnetic sphincter augmentation of the esophagus (MSA CAT). Surgical quality assurance (SQA) is the assessment of intraoperative performance by measuring adherence to standardized steps, occurrence of technical errors, and overall technical proficiency. SQA is part of the GOLF trial (ISRCTN: 1353317), an international, multicenter randomized controlled trial (RCT) comparing 2 antireflux procedures, magnetic sphincter augmentation (MSA) and fundoplication. GOLF is the first RCT in which a video-based SQA program was developed with a plan for validation and implementation. Ten international experts in antireflux surgery participated in a 3-round virtual Delphi consensus process to develop the MSA CAT. To establish interassessor reliability, 6 surgeons reviewed 2 MSA videos. After 3 months, they reviewed the same MSA videos to test intra-assessor reliability using Cohen's kappa coefficient. Operative steps and key errors were drafted based on the literature. During the 3-round virtual Delphi Consensus amendments to each version were undertaken. Finally, an operative manual and CAT were developed with mandatory, optional, and prohibited steps and quality scores ranging from 1 to 4. The MSA CAT demonstrated good inter- and intra-assessor reliability, particularly when categorizing pairs of scores into "concerning" versus "acceptable." For interassessor reliability, the mean Cohen's kappa was 0.785 (0.582-0.892) and 0.827 (0.591-0.912) for each video. For intra-assessor reliability, it was 0.745 (0.717-0.773) and 0.740 (0.510-1.00) for each video. This work describes the development and reliability of the novel MSA CAT. This will be further validated by prospective and retrospective video analysis.

Metrics

1 Record Views

Details

Logo image