Authentic language tests: where from and where to?

Abstract

In the first part of the paper the development of language tests towards authenticity is surveyed. The advantages and shortcomings of indirect vs direct (authentic) types are analysed. Whereas indirect tests were more efficient and lent themselves to psychometric analyses, they did not tap real-life language. On the other hand, direct tests based on real interactions aim at capturing real language and its variations in use. In the second part of the paper two problems involved in authentic tests are addressed: a) The difficulty of applying appropriate psychometric measures, caused by the complexity of tapping the whole construct of authentic language, and b) the large number of 'test' variables which interfere with the authenticity of the language produced and reduce it to authentic 'test language'.

Get full access to this article

View all access options for this article.

References

Bachman, L.F. and Palmer, A.S. 1981: The construct validation of the FSI Oral Interview . Language Learning 31, 67-86.

Brutsch, S. 1979: Convergent/discriminant validation of prospective teachers' proficiency in oral and written production of French. University of Minnesota, doctoral dissertation.

Carroll, J.L. 1973: Foreign language testing; will the persistent problems persist? In O'Brien, M.C. , editor, ATESOL testing in second language teaching: new dimensions, Dublin: The Dublin University Press.

Clark, J.L.D. 1975: Theoretical and technical considerations in oral proficiency testing. In Jones, R.L. and Spolsky, B. , editors, 1975.

Clifford, R.T. 1977: Reliability and validity of oral proficiency ratings and convergent/discriminant validity of language aspects of spoken German using the MLA cooperative foreign language proficiency tests, German (speaking) and an oral interview procedure. University of Minnesota , unpublished PhD dissertation.

1978 : Reliability and validity of language aspects contributing to oral proficiency of prospective teachers of German. In Clark, J.L.D. , editor, Direct testing of speaking proficiency: theory and application, Princeton: Educational Testing Service.

Hinofotis, F.B. 1976: An investigation of the concurrent validity of cloze testing as a measure of overall proficiency in English as a second language . Southern Illinois University, PhD dissertation.

Hymes, D. 1971: On communicative competence. Philadelphia : University of Pennsylvania Press.

Jones, R.L. 1975: Testing language proficiency in the United States Government . In Jones, R.L. and Spolsky, B. , editors, 1975.

10.

1978 : Interview techniques and scoring criteria at higher proficiency levels. In Clark, J.L.D. , editor, Direct testing of speaking proficiency; theory and application, Princeton, New Jersey: Educational Testing Service .

11.

Jones, R.L. and Spolsky, B. editors, 1975: Testing language proficiency . Arlington, Virginia: Center for Applied Linguistics.

12.

Oller, J.W. Jr 1983: Issues in language testing research. Rowley, Massachusetts: Newbury House.

13.

Oller, J.W. Jr and Perkins, K. 1980: Research in language testing. Rowley, Massachusetts: Newbury House.

14.

Shohamy, E. 1982: Predicting speaking proficiency from cloze tests: theoretical and practical considerations for tests substitution. Applied Linguistics 3, 161-71.

15.

1983: The stability of the oral proficiency trait on the oral interview speaking test. Language Learning 33, 527-40.

16.

Shohamy, E. , Reves, T. and Bejarano, Y. 1983: An integrated test of oral proficiency: from research results to educational policy. Paper presented at the Fourth ACROLT Meeting, Qiryat Anavim, Israel.

17.

Spolsky, B. 1978: Introduction: linguists and language testers. In Spolsky, B. , editor, Advances in language testing Series 2, Arlington, Virginia: Center for Applied Linguistics.

18.

Stevenson, D.K. 1974: A preliminary investigation of construct validity and the test of English as a foreign language. University of New Mexico, PhD dissertation.

19.

Wilds, C. 1975: The oral interview test. In Jones, R.L. and Spolsky, B. , editors, 1975.