Join now to get access to this content and more.
Become a SOAP member and have access to our benefits.
- 2020 SOAP Virtual Meeting Series Videos
- For Review: SOAP Consensus Statement on Neuraxial Procedures in Thrombocytopenic Parturients
- Sample Centers of Excellence Applications
- ASA Corner
- SOAP Policy and Procedure Manual (P&P Manual)
- SOAP Expert Opinions
- SOAP's Learning Modules
- 2019 Annual Meeting Lecture Videos
- December 2018 - SOAP Unofficial Guide to ASA Committees Webinar
- Submit a Position
- View Job Postings
- Previous Meeting Archives
- Previous Meeting Abstract Search
- CMS Guidelines
- Member Benefits
- Newsletter Clinical Articles
- ACOG Documents
- Search our Patient Safety Archive
- Ask SOAP a Question
- Global Health Opportunities
- And more…
Reliability of Self-Assessment in Perioperative Emergent Cesarean Delivery Simulation Based Training
Abstract Number: S-80
Abstract Type: Original Research
Background: Reliability of self-assessment in simulated based learning has not been well reported in the literature. The study was designed to compare self-assessment with direct and video assessment for a simulation based training exercise.
Methods: 50 anesthesia residents attended simulation-based training for an emergent cesarean section requiring general anesthesia and a validated checklist weighted scoring system (1) was used to assess performance. Checklists were completed by each resident/instructor directly following the simulation session. In addition, video recordings were viewed and scored for each resident session by 2 instructors (reviewer 1 and 2) and 1 independent reviewer (reviewer 3) who had not been involved with the simulation. The Mann Whitney test was used for all analyses.
Results: Self performance scores were significantly higher than instructor assessment scores (151 +/- 26 vs 141 +/- 29, p = 0.04). Self performance scores were also significantly higher than those for all video reviewers 1, 2 and 3 (128 +/- 25, p<0.0001, 133 +/- 32, p=0.002 and 124 +/- 25, p=0.0001). Direct observation and video assessment scores were also compared for each instructor (reviewer 1 and reviewer 2). Reviewer 2’s direct observation scores were significantly higher than video ( 147+/-26, vs. 125+/-22, p=0.05) and no significant difference between the two for reviewer 1 ( 133+/-34 vs. 142+/-30 , p=0.4).
Conclusions: Self-assessment by residents may overestimate actual performance in simulation based training exercises. In addition, assessments by direct observation and video review do not necessarily correlate.
1. Int J Obstet Anesth. 2014 Nov; 23(4):341-7