Validity of Exam Assessment of Surgical Skills EBSQNVASC Pilot Study

Abstract

The authors conducted a study to determine the validity of exarvnintions to assess surgical skills. The aspects of validity tested were content (does the test actually assess the content it purports to), construct (is it a valid d scr mnnator betvween surgeons of varying skills), internal consistency (does the candidate give a consistent performance in all aspects of the test), and irterobserver reliability (what is the level of agreement between assessors). Content was determined by dissection and anastomotic technique by using models, and knot yi'ng by using a knot-tying assessor. Consistency was determined by correlating the performance of each participart betVeen the three tests. Irterobserver reliability was tested by .yBee marking and videotape marking techniques. Significant di4ferences were noted between examiners and candidates,when assessed yive compared with video assessment Liye marking offerec high interobserver correlation for the operative procedures than for videotape assessment.