This study investigated the similarity of information that is provided by direct and indirect methods of writing assessment. The skills required by each of these techniques provide a framework for a cognitive model of writing skills from which these procedures can be compared. It is suggested that practitioners in terested in reliably measuring all aspects of the pro posed writing process continuum, as characterized by this cognitive model, use both indirect and direct methods. Index terms: Confirmatory factor analy sis, Essay tests, Free-response tests, Multiple-choice tests, Writing assessment, Writing processes.
Get full access to this article
View all access options for this article.
References
1.
Ackerman, T.A. (1985). An investigation of the assessment of writing ability from a declarative/procedural perspective. (Doctoral dissertation, University of Wisconsin-Milwaukee, 1984). Dissertation Abstracts International, 45, 12.
2.
Braddock, R., Lloyd-Jones, R., & Schoer, L. (1963). Research in written composition. Champaign IL: National Council of Teachers of English .
3.
Breland, H.M. (1977). A study of college English placement and the test of standard written English. Princeton NJ: Educational Testing Service.
4.
Breland, H.M., Conlon, C.G., & Rogosa, D.A. (1976). Preliminary study of the test of standard written English. Princeton NJ: Educational Testing Service.
5.
Breland, H.M., & Gaynor, J.L. (1979). A comparison of direct and indirect assessment of writing skill. Journal of Educational Measurement, 16, 119-128.
6.
Clark, H.H., & Clark, E.V. (1977). Psychology and language: An introduction to psycholinguistics . New York: Harcourt Brace Jovanovich .
7.
Coffman, W.E. (1966). On the validity of essay tests of achievement . Journal of Educational Measurement, 3, 151-156.
8.
Coffman, W.E. (1971). On the reliability of ratings of essay examinations in English. Research in the Teaching of English, 5, 24-36.
9.
Cooper, C.R., & Odell, L. (1977). Consideration of sound in the composing process of published writers. Research in the Teaching of English , 10, 103-115.
10.
Davis, F.B., & Fifer, G. (1959). The effect on test reliability and validity of scoring aptitude and achievement tests with weights for every choice. Educational and Psychological Measurement, 19, 159-170.
11.
Godshalk, F.I., Swineford, F., & Coffman, W.E. (1966). The measurement of writing ability. New York: College Examination Board.
12.
Hayes, J.R., & Flower, L.S. (1980). Identifying the organization of writing processes . In E. W. Gregg & E. R. Steinberg (Eds.), Cognitive processes in writing. Hillsdale NJ: Erlbaum .
13.
Heim, A.W., & Wats, K.P. (1967). An experiment on multiple-choice versus open-ended answering in a vocabulary test. British Journal of Educational Psychology, 37, 339-346.
14.
Hogan, T.P., & Mishler, C. (1980). Relationships between essay tests and objective tests of language skills for elementary school students. Journal of Educational Measurement, 17, 219-227.
15.
Jöreskog, K.G., & Sörbom, D. (1978). LISREL IV: A general computer program for the estimation of linear structural equation systems by maximum likelihood methods . Uppsala, Sweden: University of Uppsala, Department of Statistics.
16.
Michaels, S. (1981). Sharing time: Children's normative styles and differential access to literacy. Language in Society, 10, 423-442.
17.
Moss, P.A., Cole, N.S., & Khampalikit, C. (1982). A comparison of procedures to assess written language skills at grades 4, 7, and 10. Journal of Educational Measurement, 19, 37-47.
18.
Quellmalz, E.S., Capell, F.J., & Chou, C.P. (1982). Effects of discourse and response mode on the measurement of writing competence. Journal of Educational Measurement, 19, 241-258.
19.
Scollon, R., & Scollon, S.B.K. (1981). Narrative literacy and face in interethnic communication. In R. Freedle (Ed.), Advances in discourse process. Nor-wood NJ: Ablex Press.
20.
Traub, R.E., & Fisher, C.W. (1977). On the equivalence of constructed-response and multiple-choice tests. Applied Psychological Measurement, 1, 355-369.
21.
Vernon, P.E. ( 1962). The determinants of reading comprehension. Educational and Psychological Measurement, 22, 269-286.
22.
Ward, W.C. (1982). A comparison of free-response and multiple-choice forms of verbal aptitude tests. Applied Psychological Measurement , 6, 1-11.
23.
Ward, W.C., Frederiksen, N., & Carlson, S.B. (1980). Construct validity of free-response and machine-scorable forms of a test. Journal of Educational Measurement, 17, 11-29.
