The article reports the results of a study which examined the validity of two oral language tests - one direct and one semi-direct. While concurrent validity of the two types of tests (as obtained via correlations in a number of earlier studies) was high, a variety of qualitative analyses indicated that the two tests differed in a number of aspects. Differences were found in the elicitation tasks (in the number and types of functions and topics) and in the language samples obtained (in communicative strategies and in the discourse features). Conclusions are drawn regarding the need to validate tests from multiple perspectives.
Get full access to this article
View all access options for this article.
References
1.
American Council on the Teaching of Foreign Languages1986: ACTFL proficiency guidelines. Hastings-on-Hudson, NY: ACTFL.
2.
Allen, M. and Yen, W.1979: Introducing measurement theory. Monterey, CA: Brooks/Cold.
3.
Bymes, H. and Thompson, I. no date: Oral proficiency interview: tester training manual. Hastings-on-Hudson, NY: ACTFL.
4.
Clark, J.L.D.1975: Theoretical and technical considerations in oral proficiency testing. In Jones, R.L. and Spolsky, B., editors, Testing language proficiency . Arlington, VA: Center for Applied Linguistics, 10-28.
5.
— 1988: Validation of a tape-mediated ACTFL/ILR-scale based test of Chinese speaking proficiency. Language Testing5, 187-98.
Fillmore, C.1981: Ideal readers and real readers. In Tannen, D., editor, Analyzing discourse: text and talk. Washington D.C.: Georgetown University Press, 248-70.
8.
Halliday, M.A.K.1989: Spoken and written language (2nd edn.) Oxford: Oxford University Press.
9.
Hornberger, N.1989: Continua of biliteracy. Review of Educational Research59, 271-96.
10.
Grotjahn, R.1986: Test validation and cognitive psychology. Language Testing3, 159-85.
11.
Jones, R.A.1977: Testing: a vital connection. In Phillips, J., editor, The language connection: from the classroom to the world. The ACTFL review of foreign language education (Vol. 9). Skokie, IL: National Textbook Co., 237-65.
12.
Jones, R.L.1978: Interview techniques and scoring criteria at higher proficiency levels. In Clark, J., editor, Direct testing of speaking proficiency: theory and application. Princeton, NJ: Educational Testing Service, 89-102.
13.
Langer, J.1987: The construction of meaning and the assessment of comprehension: an analysis of reader performance on standardized test items. In Freedle, R. and Duran, R., Cognitive and Linguistic Analyses of Tests Performance.
14.
Lazaraton, A. and Riggenbach, H.1991: Oral skills testing: a rhetorical task approach. Issues in Applied Linguistics1, 196-217.
15.
Lowe and Stansfield, C.1988: Second Language Proficiency Assessment. Englewood Cliff : NJ: Prentice Hall Regents.
16.
McNamara, T.F.1990: Item response theory and the validation of an ESP test for health professionals. Language Testing7, 52-75.
17.
Messick, S.1981: Evidence and ethics in the evaluation of tests. Educational Researcher10, 9-20.
18.
— 1989: Validity. In Linn, R. , editor, Educational measurement (3rd edn). New York: Macmillan, 13-103.
19.
Morrow, K.1977: Techniques of evaluation for notional syllabus. University of Reading: Centre for Applied Language Studies.
20.
Murray, D.1988: The context of oral and written language: a framework for mode and medium switching. Language in Society17, 351-73.
21.
Nevo, D. and Shohamy, E.1986: Evaluation standards for the assessment of alternative testing methods: an application. Studies in Educational Evaluation , 12(2), 149-58.
22.
Omaggio, A.1986: Teaching language in context. Boston, MA: Heinle & Heinle.
23.
Ong, W.1982: Orality and literacy. London: Methuen.
24.
Raffaldini, T.1988: The use of situation tests as measures of communicative ability. Studies in Second Language Acquisition10, 197-215.
25.
Schiffrin, D.1991: Conversation analysis. Annual Review of Applied Linguistics11, 3-16.
26.
Shohamy, E.1982: Predicting speaking proficiency from cloze tests: theoretical and practical considerations for test substitutions. Applied Linguistics3, 161-71.
27.
— 1983: The stability of the oral proficiency trait on the oral interview speaking test. Language Learning33, 527-40.
28.
— 1988: A proposed framework for testing the oral language of second/ foreign language learners. Studies in Second Language Acquisition10, 165-79.
29.
Shohamy, E., Gordon, C., Kenyon, D. and Stansfield, C.1989: The development and validation of a semi-direct test for assessing oral proficiency in Hebrew. Bulletin of Higher Hebrew Education4.
30.
Shohamy, E. and Reves, T.1985: Authentic language tests: where from and where to?Language Testing2, 48-59.
31.
Shohamy, E., Reves, T. and Bejerano, Y.1986: Introducing a new comprehensive test of oral proficiency . English Language Teaching Journal40, 212-20.
32.
Shohamy, E. and Stansfield, C.1991: The Hebrew oral test: an example of international cooperation. AILABulletin7.
33.
Stansfield, C. and Kenyon, D.1988: Development of the Portuguese speaking test. Year one project report on development of semi-direct tests of oral proficiency in Hausa, Hebrew, Indonesian and Portuguese. Alexandria, VA : ERIC Document Reproduction Service.
34.
Stansfield, C., Kenyon, D., Paiva, R., Doyle, F. and Ulsh, I.The development and validation of the Portuguese speaking test. Hispania.
35.
Street, B.1988: Literacy practices and literacy myths. In Saljo, R., editor, The written word. New York: Springer Press, 59-72.
36.
Tarone, E.1985: On the variability of interlanguage systems. Applied Linguistics4, 143-63.
37.
van Lier, L.1989: Reeling, writhing, drawling, stretching, and fainting in coils: oral proficiency interviews as conversations. TESOL Quarterly23, 489-508.
38.
Vollmer, H.1981: Why are we interested in 'General Language Proficiency' ? In Klein-Braley, C. and Stevenson, D.K., editors, Practice and problems in language testing I. Bern: Lang.
39.
Weir, C.1988: Construct validity. In Hughes, A., Porter, D. and Weir, C., editors, ELTS validation project: proceedings of a conference held to consider the ELTS validation project report. English Language Testing Service Research Report 1 (ii). London: British Council/University of Cambridge Local Examinations Syndicate, 15-25.
40.
Wilds, C.1975: The oral interview test. In Jones, R. and Spolsky, B., editors, Testing language proficiency. Arlington, VA: Center for Applied Linguistics, 29-44.
