Validity of the Course-Faculty Instrument (CFI): Intrinsic and Extrinsic Variables

Abstract

The construct validity of class ratings of instructors measured by the Course-Faculty Instrument was assessed. Two sets of variables were used which explicate aspects of the nomological network of instructor ratings: (a) three intrinsic variables of instructor behavior represented wanted sources of rating variance (e.g., perceived effectiveness of instructor communications), and (b) six extrinsic variables represented variance often considered to be undesirable, (e.g., instructor sex). Eighty-nine percent of the variance in the ratings of 129 instructors teaching 334 classes (from 10,738 student ratings) was explained by the intrinsic measures of instructor behavior. Three of the extrinsic variables correlated significantly with intrinsic variables and/or ratings (r's ≤ .23). However, these latter variables (experience, rank, and publishing activities) may be as suggestive of validity as bias.

Get full access to this article

View all access options for this article.

References

Aleamoni, L. and Yimer, M. An investigation of the relationship between colleague rating, student rating, research productivity, and academic rank in rating instructional effectiveness. Journal of Educational Psychology , 1973, 64, 274-277.

Cohen, J. and Cohen, P. Applied multiple regression/correlation analysis for the behavioral sciences . Hillsdale, New Jersey: Lawrence Erlbaum Assoc., 1975.

Cronbach, L. J. Research on classrooms and schools: Formulation of questions, design, and analysis. Evaluation Consortium, Stanford University, California, 1976.

Cronbach, L. and Meehl, P. Construct validity in psychological tests. Psychological Bulletin, 1955, 52, 281-302.

Freedman, R. and Stumpf, S. Student evaluations of courses and faculty based on a perceived learning criterion: Scale construction, validation, and comparison of results. Applied Psychological Measurement, 1978, 2, 189-202.

Gillmore, G. , Kane, M. , and Naccarato, R. The generalizability of student ratings of instruction: Estimation of the teacher and course components. Journal of Educational Measurement, 1978, 15, 1-13.