In this paper it is argued that classical test theory and correlational techniques such as factor analysis have been unable to deal with many of the measurement problems that arise in the language area. As an alternative, the Partial Credit model, a latent trait model for the analysis of data scored in ordered categories, is used as the basis for the construction and analysis of an oral interview test of English as a second language. The test is designed to measure a dimension of oral proficiency that can loosely be called grammatical competence. The advantages of applying such a model are mentioned along with a discussion of its implications for future research and testing methodology in the language area.
Get full access to this article
View all access options for this article.
References
1.
Andrich, D.1978: A rating formulation for ordered response categories. Psychometrika43, 561-73.
2.
— 1985: The social construction of educational and psychological variables: A half century of unwitting bias in testing. Paper presented at the annual conference of the Australian Association for Research in Education. Hobart, November 6-10.
3.
Bachman, L.F. and Palmer, A.S.1983: The construct validity of the FSI Oral Interview. In Oller, J.W., editor, Issues in language testing research, Rowley, Mass.: Newbury House.
4.
Carroll, J.B.1983: Psychometric theory and language testing. In Oller, J.W., editor, Issues in language testing research, Rowley, Mass.: Newbury House.
5.
Chen, Z. and Henning, G.1985: Linguistic and cultural bias in language proficiency tests . Language Testing2, 155-63.
6.
Davidson, F. and Henning, G.1985: A self-rating scale of English difficulty: Rasch scalar analysis of items and rating categories. Language Testing2, 164-79.
7.
Griffin, P.E.1985: The use of latent trait methods in the calibration of spoken language in large scale selection-placement programs. In Lee, Y., Fok, A., Lord, R., and Low, G., editors, New directions in language testing, London : Pergamon.
8.
Griffin, P.E., Adams, R.J., Martin, L., and Tomlinson, B.1985: The use of latent trait methods to examine second language proficiency. New Horizons26, 46-62.
9.
— 1986a: Proficiency in English as a Second Language: The development of an interview test for adult migrants. Melbourne: Victorian Ministry of Education.
10.
— 1986b: Proficiency in English as a Second Language. The administration and generation of an interview test. Melbourne: Victorian Ministry of Education.
11.
Harrison, A.1983: Communicative testing: jam tomorrow. In Hughes, A. and Porter, D. , editors, Current developments in language testing, London: Academic Press.
12.
Henning, G.1984: Advantages of latent trait measurement in language testing . Language Testing1, 123-33.
13.
Henning, G., Hudson, T. and Turner, J.1985: Item response theory and the assumption and unidimensionality for language tests. Language Testing2, 141-54.
14.
Higgs, T.V. and Clifford, R.1982: The push towards communicative competence. In Higgs, T.V., editor, Curriculum competence and the foreign language teacher, Lincolnwood, Illinois : National Textbook Company.
15.
Ingram, D.E.1984: Australian second language proficiency ratings. Canberra: Australian Government Publishing Service .
16.
Ludlow, L.H. and Hillocks, G.1985: Psychometric considerations in the analysis of reading skill hierarchies. Journal of Experimental Education54(1), 15-21.
17.
Masters, G.N.1982: A Rasch model for partial credit scoring. Psychometrika47, 149-74.
18.
— 1986: Item discrimination: when more is worse. Paper presented at the annual meeting of the National Council of Measurement in Education. San Francisco, April.
19.
Masters, G.N. and Wright, B.D.1984: The essential process in a family of measurement models . Psychometrika49, 529-44.
20.
Masters, G.N., Wright, B.D. and Ludlow, L.1980: CREDIT. A computer program for analysing data in ordered response categories. MESA Psychological Laboratory. University of Chicago.
21.
Oller, J.W., editor, 1983: Issues in language testing research. Rowley, Mass.: Newbury House.
22.
Raatz, V.1985: Better theory for better tests?Language Testing2, 60-75.
23.
Rasch, G.1960 (1980): Probabilistic modelsfor some intelligence and attainment tests. Copenhagen: Danmarks Paedegogiske Institut. Chicago: University of Chicago Press.
24.
Stevenson, D.K.1985: Foreign language testing: all of the above. In James, C.J., editor, Practical applications of research in foreign language teaching, Lincolnwood, Illinois: National Textbook Company.
25.
Willig, A.C.1985: A meta-analysis of selected studies on the effectiveness of bilingual education. Review of Educational Research55(3), 269-318.
26.
Woods, A. and Baker, R.1985: Item response theory. Language Testing2, 119-40.
