Several recent studies have suggested C-testing to be a highly valid and reliable measure of general language proficiency avoiding the problems with cloze testing. This study investigates the feasibility of the procedure with native and non-native speakers of English. Results of 20 C-tests constructed with different ratio and/or deletion start are analysed and discussed. The findings of the study refute the claims on C-testing. The implications of the findings are also discussed.
Get full access to this article
View all access options for this article.
References
1.
Aitken, K.G.1977: Using cloze procedure as an overall language proficiency test. TESOL Quarterly11, 59-67.
2.
Alderson, C.1980: Native and nonnative speaker performance on cloze tests . Language Learning30, 59-76.
3.
— 1983: The cloze procedure and proficiency in English as a foreign language. In Oller, J.W. jr, editor, Issues in language testing research. Rowley, MA: Newbury House, 205-17.
4.
Anderson, J.1976: Psycholinguistic experiments in foreign language testing . Queensland: University of Queensland.
5.
Angoff, W.H. and Sharon, A.T.1971: A comparison of scores earned in TOEFL by native American college students and foreign applicants to US colleges. TESOL Quarterly5, 129-36.
6.
Bachman, L.1990: Fundamental considerations in language testing . Oxford University Press.
7.
Bachman, L. , Kunnan, A., Vanniarajan , A.K.S. and Lynch, B.1988: Task and ability as a basis for examining content and construct comparability in two EFL proficiency test batteries. Language Testing5, 128-59.
8.
Bensoussan, M.1984: A comparison of cloze and multiple-choice reading comprehension testing in English as a foreign language. Language Testing1, 101-104.
9.
Bormuth, J.R.1967: Comparable cloze and multiple-choice comprehension test scores. Journal of Reading10, 291-99.
10.
Bowen, J.D.1969: A tentative measure of the relative control of English and Amharic by eleventh grade Ethiopian students. UCLA Workpapers in TESL 2, 69-89.
11.
Bradshaw, J.1990: Test-takers' reactions to a placement test. Language Testing7, 13-30.
12.
Brown, J.D.1980: Relative merits of four methods for scoring cloze tests . Modern Language Journal64, 311-17.
13.
1983 : A closer look at cloze: validity and reliability. In Oller, J.W. jr, editor, Issues in language testing . Rowley, MA: Newbury House,. 237-50.
14.
1984 : A cloze is a cloze is a cloze? In Handscombe, J., Orem, R.A. and Taylor, B.P., editors, On TESOL '83 . Washington, DC: TESOL, 109-19.
15.
1988: Tailored cloze: improved with classical item analysis techniques. Language Testing5, 19-31.
16.
1993: What are the characteristics of natural cloze tests?Language Testing10, 93-116.
17.
Carroll, J.B.1987. Review of Klein-Braley, C. and Raatz, E., editors. 1985 . C-Tests in der Praxis. In Fremdsprachen und Hochschule, AKS-Rundbrief 13/14. Bochum: Arbeitskreis Sprachenzentrum (AKS). Language Testing 4, 99-106.
18.
Chappelle, C.A. and Abraham, R.G.1990: Cloze method: what difference does it make?Language Testing7, 121-46.
19.
Chihara, T. , Cline, W., Edasawa , Y., Hookabe, Y. , Sakurai, T. and Yashima , T.If the cloze test is a question, is the C-test the answer? (Manuscript).
20.
Cleary, C.1988: The C-test in English: left-hand deletions. RELC Journal19,26-38.
21.
Cohen, A.D.1984: On taking language tests: what the students report . Language Testing1, 70-81.
22.
Cohen, A.D. , Segal, M. and Weiss , R.1984 : The C-test in Hebrew. Language Testing1, 221-25.
23.
1985: The C-test in Hebrew. Fremdsprachen und Hochschulen.AKS-Rundbrief13/14, 121-27.
24.
Crawford, A.1970: The cloze procedure as a measure of reading comprehension of elementary level Mexican-American and Anglo-American children. Unpublished PhD dissertation, University of California, Los Angeles .
25.
Darnell, D.K.1968: The development of an English language proficiency test of foreign students using a clozentropy procedure. ERIC EDC 24-039.
26.
1970: Clozentropy: a procedure for testing English language proficiency of foreign students. Speech Monographs37, 36-46.
27.
Dörnyei, Z. and Katona, L.1992: Validation of the C-test amongst Hungarian EFL learners. Language Testing2, 187-206.
Farhady, H.1983: New directions for ESL proficiency testing. In Oller, J.W. jr, editor, Issues in language testing research . Rowley, MA: Newbury House, 253-69.
30.
Feldmann, U. and Stemmer, B.1987: Thin— aloud a— retrospective da— in C—te— taking: diffe— languages-diff— learners—sa— approaches ? In Faerch, C. and Kasper, G., editors, Introspection in second language research. Clevedon: Multilingual Matters .
31.
Flesch, R.1948: A new readability yardstick. Journal of Applied Psychology32, 321-33.
32.
Gallant, R.1965: Use of cloze tests as a measure of readability in the primary grades. In Figurel, J.A., editor, Reading and inquiry. Newark, DE: IRA, 286-87.
33.
Grotjahn, R.1986: Test validation and cognitive psychology: some methodological considerations. Language Testing3, 159-85.
34.
— 1987: On the methodological basis of introspective methods . In Faerch, C. and Kasper, G., editors, Introspection in second language research. Clevedon: Multilingual Matters.
35.
Grotjahn, R. and Stemmer, B.1985: On the development and evaluation of a C-test for French. Fremdsprachen und Hochschule, AKS Rundbrief 13/14, 101-20.
36.
Guilbert, J.J.1976: Educational handbook. WHO.
37.
Hale, G.A. , Stansfield , C.W., Rock , D.A., Hicks, M.M. , Butler, F.A. and Oller , J.W. jr1989 : The relation of multiple-choice cloze items to the test of English as a foreign language. Language Testing6, 47-76.
38.
Henning, G.1987: A guide to language testing: development, evaluation, measurement. Cambridge, MA: Newbury House.
39.
Hughes, A.1989: Testing for language teachers. Cambridge University Press.
40.
Irvine, P. , Atai, P. and Oller , J.W. jr1974: Cloze, dictation, and the test of English as a foreign language. Language Learning24, 245-52.
41.
Jafarpur, A.1994: Native speaker performance validity: in vain or for gain?System22.
42.
Johnson, D.C.1977. The TOEFL and domestic students: conclusively inappropriate . TESOL Quarterly11, 79-86.
43.
Jonz, J.1976: Improving on the basic egg: the M-C cloze. Language Learning26, 255-56.
44.
— 1987: Textual cohesion and second language comprehension . Language Learning37, 409-38.
45.
— 1990: Another turn in the conversation: what does the cloze measure?TESOL Quarterly24, 61-63.
46.
Klein-Braley, C.1985: A cloze-up on the C-test: a study in the construct validation of authentic tests. Language Testing2, 76-104.
47.
— 1985: C-tests in der Praxis. In Fremdsprachen und Hochschule, AKS, Rundbrief 13/14.
48.
Klein-Braley, C. and Raatz , E.1984: A survey on the C-test. Language Testing1, 134-46.
49.
Kokkota, V.1988: Letter-deletion procedure: a flexible way of reducing text redundancy. Language Testing5, 115-19.
50.
Krzanowski, WJ and Woods, A.J.1984: Statistical aspects of reliability in language testing. Language Testing1, 1-20.
51.
Lado, R.1986: Analysis of native speaker performance on a cloze test . Language Testing3, 130-46.
52.
Lee, Y.P.1985: Investigating the validity of the cloze score In Lee, Y.P., Fok, A.C.V.V., Lord, R. and Low, G., editors, New directions in language testing. Pergamon Press , 137-47.
53.
Madsen, H.S.1982: Determining the debilitative effects of test anxiety . Language Learning32, 133-43.
54.
McBeath, N.1989: C-tests in English: pushed beyond the original concept?RELC Journal20, 36-41.
55.
— 1990: C-tests - some words of caution. English Teaching Forum28, 45-46.
56.
Negishi, M.1987: The C-test: an integrative measure?The IRLT Bulletin1, 3-26.
57.
Oller, J.W. jr1972: Scoring methods and difficulty levels for cloze tests of proficiency in English as a second language. Modern Language Journal56, 151-58.
58.
— 1973: Cloze tests of second language proficiency and what they measure. Language Learning23, 105-18.
59.
— 1979: Language tests at school. Longman .
60.
Oller, J.W. jr , Bowen, J.D., Dien , T.T. and Mason, V.1972: Cloze tests in English, Thai, and Vietnamese: native and non-native performance. Language Learning22, 1-15.
61.
Oller, J.W. jr and Conrad, C.1971: The cloze procedure and ESL proficiency. Language Learning21, 183-96.
62.
Pike, L.W.1973: An evaluation of present and alternative item formats for use in the test of English as a foreign language. Princeton, NJ: ETS.
63.
Purschel, H.1985: Ein Silberstreifen am Horizont: Pladoyer for ein C-Test Institut. In Klein-Braley, C. and Raatz, U., editors, Fremdsprachen und Hochschule 13/14: Thematischer Teil: C-Tests in der Praxis . Bochum: AKS, 161-65.
64.
Raatz, U.1985: Better theory for better tests?Language Testing2, 60-75.
65.
Raatz, U. and Klein-Braley, C.1981: The C-test - a modification of the cloze procedure. In Culhane, T., Klein-Braley, C. and Stevenson, D.K., editors, Practice and problems in language testing. University of Essex Occasional Papers 26. Colchester : University of Essex.
66.
Rand, E.1978: The effects of test length and scoring method on the precision of cloze test scores. UCLA Workpapers in TESL12, 6271.
67.
Ruddell, R.B.1964: A study of the cloze comprehension technique in relation to structurally controlled reading material. Improvement of Reading through Classroom Practice9, 298-303.
68.
Smith, C.B. , Wardaugh, R. and Sims , S.1975 : Secret spaces. New York: Macmillan .
69.
Streiff, V.1978: Relationships among oral and written cloze scores and achievement test scores in a bilingual setting. In Oller, J.W. jr and Perkins, K., editors, Language in education: testing the tests . Rowley, MA: Newbury House, 65-102.
70.
Stubbs, J.B. and Tucker, G.R.1974: The cloze test as a measure of English proficiency. Modern Language Journal58, 239-42.
71.
Taylor, W.L.1953: Cloze procedure: a new tool for measuring readability . Journalism Quarterly30, 414-38.
72.
Weir, C.J.1988. Communicative language testing. Exeter: University of Exeter.
