This "state of the art" article examines six internship performance studies of medical school graduates that use rating scales as the vehicle for data collection. The methodological decisions investigators faced in designing the studies are described and the range of options used is illustrated. The content and format of rating forms employed are compared. No methodological standards currently exist for internship performance studies. We call for greater attention to methodological issues in study design, including examination ofpotential sources of bias. How structural aspects of the internship performance study design may influence the results obtained needs careful study.
Get full access to this article
View all access options for this article.
References
1.
ARNOLD, L.
(1979) Personal communication.
2.
BEBBINGTON, A. C.
(1970) "The effect of non-responses in the sample survey with an example."Human Relations23: 169-180.
3.
CASE, S.
(1979) "Construction of rating scales to access competence of residents" (internal report). Philadelphia: National Board of Medical Examiners.
4.
CLEMENTE, M.
and W. M. MICHENER (1976) "The dean's letter of recommendation and internship performance."J. of Medical Education51: 590-592.
5.
COWLES, J. T.
and A. J. KUBANY (1959) "Improving the measurement of clinical performance of medical students."J. of Clinical Psychology15: 139-143.
6.
DINHAM, S. M.
(1978) "Curriculum evaluation in the college of medicine." Technical Report 20, Office of Medical Education, University of Arizona College of Medicine.
7.
DINHAM
and R. A. BARBEE (1978) "A postgraduate assessment of three-year versus fouryear medical school graduates."Evaluation and the Health Professions25-32.
8.
HALLOCK, J. and J. W. HICKMAN (1978) "Residency performance of three and four year medical graduates." Unpublished manuscript, University of South Florida.
9.
HUTCHINS, E. B.
and G. B. FAWCETT (1972) The Longitudinal Study of Medical School Students of the Class of 1960: An Archive of Research Publications, Notes and Data Reports for the Period 1956-1972 (Volumes 1-12). Washington, DC: AAMC.
10.
JOHNSON, V.
, R. D. MILLER, and R. P. GAGE (1963) "Correlation between performance in medical school and in residency training."J. of Medical Education38: 591-595.
11.
KECK, J.
and L. ARNOLD (1979a) "Development and validation of an instrument to assess the clinical performance of medical residents."Education and Psych. Measurement39: 903-908.
12.
KECK
(1979b) "Efficacy of cognitive and noncognitive measures in predicting clinical performance of residents." Presented at the meeting of the American Educational Research Association, San Francisco, April.
13.
KORMAN, M.
and D. L. STUBBLEFIELD (1971) "Medical school evaluation and internship performance."J. of Medical Education46: 670-673.
14.
LEVINE, H. G.
and C. H. McGUIRE (1971) "Rating habitual performance in graduate medical education."J. of Medical Education46: 306-311.
15.
NUNNALLY, J. C.
(1967) Psychometric Theory. New York: McGraw-Hill.
16.
PRICE, P. B.
, E. G. LEWIS, G. C. LOUGHMILLER, D. E. NELSON, S. L. MURRAY, and C. W. TAYLOR (1971) "Attributes of a good practicing physician."J. of Medical Education46: 229-237.
17.
PRICE, P. B.
, C. W. TAYLOR, D. E. NELSON, E. G. LEWIS, G. C. LOUGHMILLER, R. MATHIESEN, S. L. MURRAY, and J. G. MAXWELL (1971) Measurement and Prediction of Physician Performance: Two Decades of Intermittently Sustained Research. Salt Lake City, UT: Lynn Lloyd Reid Press.
18.
RICHARDS, J. M.
, C. W. TAYLOR, and P. B. PRICE (1962) "The prediction of medical intern performance."J. of Applied Psychology46: 142-146.
19.
ROBINS, L. N.
(1963) "The reluctant responder."Public Opinion Q.27: 276-286.
20.
SELLTIZ, C.
, L. S. WRIGHTSMAN, and S. W. COOK (1976) Research Methods in Social Relations. New York: Holt, Rinehart & Winston.
21.
VALBERG, L. S.
and J. B. FIRSTBROOK (1977) "A project to improve the measurement of professional competence for specialty certification in internal medicine."Annals of the Royal College of Physicians and Surgeons of Canada10(4): 278-282.
22.
VELOSKI, J., M. W. HERMAN, J. S. GONNELLA, C. ZELENIK and W. F. KELLOW (1978) "Can the performance of first year residents be predicted? Relationships between performance in medical school and the first postgraduate year." Unpublished manuscript, Jefferson Medical College.
23.
WOODWARD, C. A.
, R. G. McAULEY, and C. B. MUELLER (1977) "Performance of McMaster medical graduates during the first postgraduate year" (D.M. 370). Research Proposal, Ontario Ministry of Health, October.
