A text-driven method for the deletion procedure in cloze passages

Abstract

This article proposes a text-driven method for the deletion procedure in cloze passages. Contrary to the previous methods, the deletion rate suggested in this study is based on the number of the linguistic and discourse structures of a passage. After determining the proficiency level of the subjects, a passage of appropriate length and difficulty with the deletion rate of 7 was developed. Along with this standard cloze, eight different versions were also constructed. The deletion rate of the eight versions was based on the number of linguistic and discourse clues. Following a counterbalanced design, the cloze test forms were administered to 403 subjects majoring in English at different academic levels. The results sug gested that the text-driven method is superior to the fixed-ratio deletion method on some grounds. It was also revealed that the differences among the subjects' performance on different versions of cloze tests were significant. It is concluded that the random deletion method may lead to a paradox between the difficulty and the reliability of cloze tests.

Get full access to this article

View all access options for this article.

References

Alderson, J.C. 1979: The cloze procedure and proficiency in English as a foreign language. TESOL Quarterly 13, 219-23.

— 1983: The cloze procedure and proficiency in English as a foreign language. In Oller, J.W. jr , editor, Issues in language testing research, Rowley, MA: Newbury House.

Brown, J.D. 1993: What are the characteristics of natural cloze tests? Language Testing 10, 93-116.

Farhady, H. 1980: Development, and justification of functional language testing. PhD dissertation, University of California, Los Angeles.

— 1983: New directions for ESL proficiency testing. In Oller, W.J. jr , editor, Issues in language testing research, Rowley, MA: Newbury House.

— 1996: Item dependency and reliability of cloze tests (forthcoming) . Farhady, H. , Jafarpur, A. and Birjandi, P. 1994: Testing language skills: from theory to practice. Tehran: SAMT Publication.

Halliday, M.A.K. 1985: An introduction to functional grammar. Melbourne: Edward Arnold.

Halliday, M.A.K. and Hassan, R. 1976: Cohesion in English. London: Longman.

Hatch, E. and Farhady, H. 1982: Research design and statistics for applied linguistics . Rowley, MA: Newbury House.

10.

Henning, G. 1987: A guide to language testing. Cambridge, MA: Newbury House.

11.

Hinofotis, F. 1980: Cloze as an alternative method of ESL placement and proficiency testing. In Oller, J.W. jr and Perkins, K. , editors, Research in language testing. Rowley, MA: Newbury House .

12.

Klein Braley, C. 1981: Empirical investigations of cloze tests. Unpublished PhD , University of Duisburg.

13.

Mullen, K. 1980: Rater reliability and oral proficiency evaluation. In Oller, J.W. jr and Perkins, K. , editors, Research in language testing, Rowley, MA: Newbury House.

14.

Ohnmacht, F.W. , Weaver, W.W. and Kohler, E.T. 1970: Cloze and closure. A factorial study. The Journal of Psychology 74, 205-17.

15.

Oller, J.W. jr 1973: Cloze tests of second language proficiency and what they measure. Language Learning 23, 105-18.

16.

— 1979: Language tests at school: a pragmatic approach. London: Longman.

17.

Oller, J.W. jr and Conrad, C.A. 1971: The cloze technique and ESL proficiency. Language Learning 21, 183-95.

18.

Oller, J.W. jr and Perkins, K. 1980: Research in language testing. Rowley, MA: Newbury House.

19.

Porter, D. 1978: Cloze procedure and equivalence. Language Learning 28, 333-40.

20.

Shohamy, E. 1978: Investigation of concurrent validity of oral interview with cloze procedure for measuring proficiency in Hebrew as a second language. Unpublished PhD, University of Minnesota.

21.

Taylor, W.L. 1953: Cloze procedure: a new tool for measuring reading ability . Journalism Quarterly 30, 415-38.

22.

Weaver, W.W. and Kingston, A.J. 1963: A factor analysis of cloze procedure and other measures of reading and language ability. The Journal of Communication 13, 252-61.

23.

Zarrabi, A. 1988: Deletion rate and test difficulty in cloze. Unpublished MA , Alameh Tabatabaie University, Tehran.