Three essay questions were administered to junior education major college students. Factor analysis of the ratings showed that content played a large role in the students' responses, yielding dominant first order factors. Generalizability theory, used to examine the reliability of students' ratings showed the need for more raters and questions.
Get full access to this article
View all access options for this article.
References
1.
Breland, H. M. and Gaynor, J. L. (1979). A comparison of direct and indirect assessments of writing skill. Journal of Educational Measurement, 16, 120-128.
2.
Campbell, D. T. and Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
3.
Coffman, W. E. (1971). Essay examinations. In R. L. Thorndike (Ed.), Educational measurement. Washington D. C.: American Council on Education, 271-301.
4.
Cronbach, L. , Gleser, G., Nanda, H., and Rajaratnam, N. (1972). The dependability of behavioral measurement: Theory of generalizability for scores and profiles. New York: Wiley.
5.
Godshalk, F. I. , Swineford, F., and Coffman, W. E. (1966). The measurement of writing ability. New York: College Entrance Examination Board.
6.
Hogan, T. P. and Mishler, C. (1980). Relationship between essay tests and objective tests of language skills for elementary school students. Journal of Educational Measurement, 17, 219-227.
7.
Kinneavy, D. (1971). A theory of discourse. New Jersey: PrenticeHall.
8.
Lloyd-Jones, R. (1977). Primary trait scoring. In C. R. Cooper, and L. Odell (Eds.), Evaluating writing: Describing editing, judging. Urbana, IL: National Council of Teachers of English.
9.
Moss, P. A. , Cole, N. S., and Khampalikit, C. (1982). A comparison of procedures to assess written language skills at grades 4, 7, and 10. Journal of Educational Measurement, 19: 37-47.
