Abstract
During the past two decades, there has frequently been discussion about the possibility of giving more weight to supervisor reports in the assessment of trainees. However, there have been major concerns about the reliability of such reports, and a small research literature has appeared which appears to verify a lack of reliability in these assessment of trainees in a variety of specialties. Our College and others have attempted to improve reliability through the use of standard pro-formas and more clearly defined rating scales. Nevertheless, the Australasian medical colleges have not felt comfortable using these reports in a summative way (i.e. to influence award of Fellowship).
More recently, a substantial literature has appeared on “multi-source feedback”. One technique in particular, i.e. the “360 Degree Assessment” has emerged and appears to have acceptable reliability and validity. In this assessment, a number of individuals (doctors, nurses, allied health professionals, clerical staff and (in some models) patients) complete a standardised pro-forma rating the trainee along a number of dimensions.
This workshop will provide an overview of multi-source feedback and the 360 Degree Assessment Technique. The advantages and disadvantages of the technique will be described. Participants in the workshop will be invited to “brainstorm” potential obstacles to introducing this technique and, eventually, how this assessment might be used in a formative way (eg to adjudicate borderline pass/fail decisions in the clinical examinations or to contribute a percentage of the final mark etc).
The College may embark on a pilot project of the technique in 2007, and it is hoped this workshop will inform that project.