Characteristics of Ratings of Physician Competence by Professional Associates

Abstract

Although the evaluation of medical students and residents frequently includes the use of global ratings scales as measures of clinical competence, few studies have investigated the use of global ratings in evaluating the performance ofpracticing physicians, or the psychometric properties of these ratings. In this article, the characteristics of ratings of physician competence by professional associates are described, using practicing internists as the subjects for the study. Ratings of nine aspects of clinical competence for 210 internists were obtained from four physician associates with whom patient care had been shared. The results suggest that ratings of physicians' clinical competence by professional associates are both reliable and potentially useful in identifying physicians with low performance. Studies are needed to clarify further thepsychometric properties ofpeer ratings, and to determine factors that affect these ratings.

Get full access to this article

View all access options for this article.

References

BRUMBACK, G. B. and M. S. HOWELL (1972) "Rating the clinical effectiveness of employed physicians." J. of Applied Psychology 56 (3): 241-244.

COWLES, J. T. (1965) "Acritical-comments approach to the rating of medical students' clinical performance." J. of Medical Education 40 (February): 188-198.

CRONBACH, L. J. , G. C. GLESER , H. NANDA , and N. RAJARTNAM (1972) The Dependability of Behavioral Measurements: Theory of Generalizability of Scores and Profiles. New York: Wiley.

DIELMAN, T. E. , A. L. HULL , and W. K. DAVIS (1980) "Psychometric properties of clinical performance ratings." Evaluation & the Health Professions 3 (March): 103-117.

KEGAL-FLOM, P. (1975) "Predicting supervisor, peer, and self-ratings of intern performance." J. of Medical Education 50 (August): 812-815.

KEYNAN, A. , M. FRIEDMAN , and J. BENBASSAT (1987) "Reliability of global rating scales in the assessment of clinical competence of medical students." Medical Education 21 (6): 477-481.

NORCINI, J. J. , L. F. GROSSO , J. A. SHEA , and G. D. WEBSTER (1987) "Relationship between features of residency training and ABIM certifying examination performance." J. of General Internal Medicine 2 (September/October): 330-336.

NORCINI, J. J. , R. S. LIPNER , J. A. BENSON, Jr. , and G. D. WEBSTER (1985) "An analysis of the knowledge base of practicing internists as measured by the 1980 recertification examination." Annals of Internal Medicine 102 (3): 385-389.

RAMSEY, P. G. , J. D. CARLINE , T. S. INUI , E. B. LARSON , J. P. LOGERFO , and M. D. WENRICH (1989) "Predictive validity of certification by the American Board of Internal Medicine." Annals of Internal Medicine 110 (9): 719-726.

10.

RAMSEY, P. G. , N. F. SHANNON , L. FLEMING , M. WENRICH , P. D. PECKMAN , and D. C. DALE (1986) "Use of objective examinations in medicine clerkships: ten-year experience." Amer. J. of Medicine 81 (October): 669-674.

11.

WINER, B. J. (1971) Statistical Principles in Experimental Design (2nd ed.). New York: McGraw-Hill.