This article questions the relevance of the notion of reliability as internal consistency in tests of communicative language proficiency and suggests alternative criteria for judging the quality of communicative tests. Attempts to establish reliability for a set of oral tasks on sociolinguistic performance and a set of written tasks on grammatical performance are provided. They show that mediocre reliability coefficients were achieved at a high cost to construct validity.
Get full access to this article
View all access options for this article.
References
1.
Bachman, L.1990: Fundamental considerations in language testingOxford : Oxford University Press.
2.
Canale, M.1983: From communicative competence to communicative language pedagogy In Richards, J. C. and Schimdt, R. W., editors, Language and communication.London: Longman.
3.
Canale, M. and Swain, M.1980: Theoretical bases of communicative approaches to second language teaching and testingApplied Linguistics1, 1-47.
4.
Cummins, J.1981: The role of primary language development in promoting educational success for language minority students In California State Department of Education, editor, Schooling and language minority students: a theoretical framework.Los Angeles, CA: Evaluation, Dissemination and Assessment Center, California State University, 3-49.
5.
Cummins, J. and Swain, M.1986: Bilingualism in educationLondon: Longman.
6.
Ellis, R.1985: Understanding second language acquisitionOxford: Oxford University Press.
7.
Harley, B.1989: Transfer in the written compositions of French immersion students In Dechert, H. W. and Raupach, M., editors, Transfer in language production. New York : Ablex, 3-19.
8.
Harley, B. , Allen, P., Cummins , J. and Swain, M.1987 : The development of bilingual proficiency: final report, Volume I: The nature of proficiency, Volume II: Classroom treatment, Volume III: Social context and ageToronto: Modern Language Centre, Ontario Institute for Studies in Education.
9.
Harley, B., Allen, P., Cummins, J. and Swain, M., editors, 1990: The development of second language proficiencyNew York : Cambridge University Press.
10.
Harley, B. and Swain, M.1984: The interlanguage of immersion students and its implications for second language teaching In Davies, A., Criper, C. and Howatt, A. P. R., editors, Interlanguage.Edinburgh: Edinburgh University Press.
11.
Linn, R.L. , Baker, E.L. and Dunbar , S.B.1991: Complex, performance-based assessment: expectations and validation criteriaEducational Researcher, November, 15-21.
12.
Nevo, D.1986: Testing authenticity in writingPaper presented at the fourth ACROLT meeting, Kiryat Anavim , Israel.
13.
Olin, R.1987: The effect of connectors on reading comprehension MA thesis, Tel Aviv University.
14.
Pica, T. , Holliday, L., Lewis , N. and Morgenthaler, L.1989: Comprehensible output as an outcome of linguistic demands on the learnerStudies in Second Language Acquisition11, 63-90.
15.
Shohamy, E.1984: Does the testing make a difference? The case of reading comprehensionLanguage Testing1, 147-70.
16.
— 1988: Closing the gap between research and practice: applications of research results to classroom testingRevised version of a paper delivered at the English Teachers' Association of Israel International Conference, Jerusalem.
17.
Shohamy, E. and Inbar, O.1991: Validation of listening comprehension tests: the effect of text and questions typeLanguage Testing8, 23-40.
18.
Shohamy, E. , Reves, T. and Bejerano , Y.1986: Introducing a new comprehensive test of oral proficiencyEnglish Language Teaching Journal40, 212-22.
19.
Swain, M.1984: Large-scale communicative language testing: a case study In Savignon, S. and Berns, M., editors, Initiatives in communicative language teaching.Reading, MA: Addison-Wesley, 185-201.
20.
Tarone, E.1988: Variation in interlanguageLondon: Edward Arnold.
21.
Tarone, E. and Parrish, B.1988: Task-related variation in interlanguage: the case of articlesLanguage Learning38, 21-44.
22.
Wall, D. and Alderson, C.1993: Examining washback: the Sri Lankan Impact StudyLanguage Testing10, 41-69.
23.
Young, R.1988: Variation and the interlanguage hypothesisStudies in Second Language Acquisition10, 281-302.
