///2015 Abstract Details
2015 Abstract Details2019-08-02T16:54:43-06:00

Reliability of Self-Assessment in Perioperative Emergent Cesarean Delivery Simulation Based Training

Abstract Number: S-80
Abstract Type: Original Research

Wendy M Suhre M.D.1 ; Renata G Ferreira M.D.2; Kei Togashi M.D., MPH3; Christopher Ciliberto M.D.4; Brian K Ross M.D., PhD5; Clemens M Ortner M.D., M.S., DESA6

Background: Reliability of self-assessment in simulated based learning has not been well reported in the literature. The study was designed to compare self-assessment with direct and video assessment for a simulation based training exercise.

Methods: 50 anesthesia residents attended simulation-based training for an emergent cesarean section requiring general anesthesia and a validated checklist weighted scoring system (1) was used to assess performance. Checklists were completed by each resident/instructor directly following the simulation session. In addition, video recordings were viewed and scored for each resident session by 2 instructors (reviewer 1 and 2) and 1 independent reviewer (reviewer 3) who had not been involved with the simulation. The Mann Whitney test was used for all analyses.

Results: Self performance scores were significantly higher than instructor assessment scores (151 +/- 26 vs 141 +/- 29, p = 0.04). Self performance scores were also significantly higher than those for all video reviewers 1, 2 and 3 (128 +/- 25, p<0.0001, 133 +/- 32, p=0.002 and 124 +/- 25, p=0.0001). Direct observation and video assessment scores were also compared for each instructor (reviewer 1 and reviewer 2). Reviewer 2’s direct observation scores were significantly higher than video ( 147+/-26, vs. 125+/-22, p=0.05) and no significant difference between the two for reviewer 1 ( 133+/-34 vs. 142+/-30 , p=0.4).

Conclusions: Self-assessment by residents may overestimate actual performance in simulation based training exercises. In addition, assessments by direct observation and video review do not necessarily correlate.

1. Int J Obstet Anesth. 2014 Nov; 23(4):341-7

SOAP 2015