Three videotaped practice clinical, oral examinations were rated by 9, 9 and 11 raters respectively. Raters were all certified specialists engaged in training residents for the certification examinations. In two of the simulated examinations considerable differences in rating scores, to the extent of pass/fail disagreement, were found. The significance of the findings, including the possibility that one examiner may “contaminate” another, is discussed. Further work is essential to develop reliable instruments for rating certification examinations, whatever their format, as the Royal College policies evolve.
References
1.
LowyF.H., ProsenH.The Canadian certification examination in psychiatry. III: Towards better certification techniques.Can J Psychiatry1979; 24: 292–301.
2.
LeichnerP.P.The certification examination: Viewpoints of fourth year residents.Can Psychiatr Assoc J1977; 22: 149–53.
3.
PersadE., GarfinkelP.Practising psychiatrists’ views on the certification examination in psychiatry.Can J Psychiatry1979; 24: 303–7.
4.
LowyF.H., DongierM.The Canadian certification examination in psychiatry. II: Who passes and who fails.Can J Psychiatry1979; 24: 284–92.
5.
SislerG.C., LeichnerP.P., HarperD.W.The reliability of the “Royal College Format” of oral clinical examinations.Presented at the Canadian Psychiatric Association Annual Meeting, October 1980.
6.
CameronP.Personal communication, October 1980.
7.
McGuireC.Methods and techniques of evaluating learning.Paper presented at conference: The future of undergraduate psychiatric education, Toronto, September 1980.
