Files and links (1)
Published, Version of Record (VoR)CC BY V4.0, Open
Journal article
Bard Versus the 2022 American Society of Plastic Surgeons In-Service Examination: Performance on the Examination in Its Intern Year
Aesthetic surgery journal. Open forum, v 6, 066
04 Jan 2024
PMID: 38196964
Abstract
Background Bard is a conversational generative artificial intelligence (AI) platform released by Google (Mountain View, CA) to the public in May 2023.Objectives This study investigates the performance of Bard on the American Society of Plastic Surgeons (ASPS) In-Service Examination to compare it to residents' performance nationally. We hypothesized that Bard would perform best on the comprehensive and core surgical principles portions of the examination.Methods Google's 2023 Bard was used to answer questions from the 2022 ASPS In-Service Examination. Each question was asked as written with the stem and multiple-choice options. The 2022 ASPS Norm Table was utilized to compare Bard's performance to that of subgroups of plastic surgery residents.Results A total of 231 questions were included. Bard answered 143 questions correctly corresponding to an accuracy of 62%. The highest-performing section was the comprehensive portion (73%). When compared with integrated residents nationally, Bard scored in the 74th percentile for post-graduate year (PGY)-1, 34th percentile for PGY-2, 20th percentile for PGY-3, 8th percentile for PGY-4, 1st percentile for PGY-5, and 2nd percentile for PGY-6.Conclusions Bard outperformed more than half of the first-year integrated residents (74th percentile). Its best sections were the comprehensive and core surgical principle portions of the examination. Further analysis of the chatbot's incorrect questions might help improve the overall quality of the examination's questions.
Metrics
4 Record Views
Details
- Title
- Bard Versus the 2022 American Society of Plastic Surgeons In-Service Examination: Performance on the Examination in Its Intern Year
- Creators
- Daniel Najafali - Illinois CollegeErik Reiche - Brigham and Women's HospitalSthefano Araya - Fox Chase Cancer CenterJustin M. Camacho - Drexel UniversityFarrah C. Liu - Stanford UniversityThomas Johnstone - Stanford UniversitySameer A. Patel - Fox Chase Cancer CenterShane D. Morrison - University of Washington Medical CenterAmir H. Dorafshar - Rush University Medical CenterPaige M. Fox (Corresponding Author) - Stanford University
- Publication Details
- Aesthetic surgery journal. Open forum, v 6, 066
- Publisher
- Oxford Univ Press
- Number of pages
- 7
- Grant note
- Google's Bard; Google Incorporated
- Resource Type
- Journal article
- Language
- English
- Academic Unit
- College of Medicine
- Web of Science ID
- WOS:001138526600001
- Other Identifier
- 991021861205204721
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Collaboration types
- Domestic collaboration
- Web of Science research areas
- Surgery