Does the testing method make a difference? The case of reading comprehension

Abstract

The paper reports results of a study which examined the effect that various methods used for testing reading comprehension have on the measurement of that trait. The methods investigated in this research were multiple-choice and open-ended questions, each presented in L1 and L2, on the same L2 texts. Results indicated that each of the testing methods produced different degrees of difficulty for the test takers, and that each of the variables - method, text and language - had a significant effect on students' scores in reading comprehension. These effects were strongest on low-level students. Recommendations are made with regard to the use of multiple procedures for testing reading comprehension as well as to the need for further research towards finding the most valid method for testing that trait.

Get full access to this article

View all access options for this article.

References

Alderson, C. 1980: Native and non-native speaker performance on cloze tests . Language Learning 30, 59-76.

1983 : The cloze procedure and proficiency in English as a Foreign Language. In Oller, J.W. , editor, Issues in language testing research, Rowley, Massachusetts : Newbury House.

Bachman, L. 1983: Performance on different item types in cloze passages with fixed ratio and random deletions. Paper read at the 18th TESOL Annual Convention, Toronto, Canada.

Cohen, A. 1984: On taking language tests: what the students report . Language Testing 1, 70-81.

Cohen, A. and Hosenfeld, C. 1981: Some uses of second language research. Language Learning 31, 285-313.

Corder, S.P. 1978: Language learner language. In Richards, J. , editor, Understanding second and foreign language learning: issues and approaches, Rowley, Massachusetts : Newbury House.

Klein-Braley, C. 1981: Empirical investigations of cloze tests. An examination of the validity of cloze tests of general proficiency in English for German university students. University of Duisburg, Germany, unpublished PhD dissertation.

1983 : A cloze is a cloze is a question. In Oller. J.W. , editor, Issues in language testing research , Rowley, Massachusetts: Newbury House.

Samson, D.M.M. 1983: Rasch and reading. In van Weeren, J. , editor, Practice and problems in language testing, Arnhem: S.CITO.

10.

Shohamy, E. 1983: The stability of oral proficiency assessment on the oral interview testing procedure. Language Learning 33, 527-40.

11.

Zak, I. 1982: An alternative model for the matriculation examinations. Intermediate Report. The Unit of Measurement and Evaluation Research, Tel Aviv University, Publication 2/82.