A Psychometric Theory of Evaluations of Item and Scale Translations

Abstract

A psychometric theory of equivalence of meanings of items and item responses in original and target language versions of psychological scales is developed. Equivalence of translated items is defined in terms of probabilities of a specified response being evoked by two stimuli among individuals with the same amount of the latent trait assessed by the items. In the case of translated items that form psychological scales, the stimuli are the source and target language versions of the item. The specified responses are correct or positive responses to these measurement items. The extent to which items are equivalent across the different language versions can be evaluated within the framework of item response theory (Lord & Novick, 1968). Methods of equating scales containing culturally general, etic, items and culturally specific, emic, items are outlined. These techniques can be used to increase the cultural relevance of scales by generating and including emic concepts while permitting comparisons across cultures and languages on the basis of scales equated with reference to the common, etic items. Results of applications of these techniques to one instrument (the Job Descriptive Index; Smith, Kendall, & Hulin, 1969) translated into five languages and administered to approximately 3,000 employees in six countries are discussed briefly.

Get full access to this article

View all access options for this article.

References

Brislin, R. (1970). Back-translation for cross-cultural research. (1970). Journal of Cross-Cultural Psychology, 1, 185-216.

Brislin, R. (1976). Translation research and its applications: An introduction. In R. Brislin (Ed.), Translation: Applications and research. New York: Wiley/ Halstead.

Candell, G. L. , & Hulin, C. L. (1986). Cross-language and cross-cultural comparisons in scale translations: Independent sources of information about item nonequivalence. Journal of Cross-Cultural Psychology, 17, 417-440.

Candell, G. L. , & Roznowski, M. (1984). Using IRT to establish equivalence across U.S. and Canadian subpopulations. Paper presented at American Psychological Association annual meeting, Toronto, Canada.

Casagrande, J. (1954). The ends of translation. International Journal of American Linguistics, 20, 335-340.

Cronbach, L. J. , Gleser, G. C. , Nanda, H. , & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: John Wiley.

deVera, M. V. (1984). Establishing measurement equivalence with Philippine emic and etic concepts. Paper presented at American Psychological Association annual meeting, Toronto, Canada.

deVera, M. V. (1985). Establishing cultural relevance and measurement equivalence using emic and etic items. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.

Drasgow, F., & Hulin, C. L. (1986). Assessing the equivalence of measurement of attitudes and aptitudes across heterogeneous subpopulations. Unpublished manuscript, University of Illinois at Champaign-Urbana.

10.

Ervin-Tripp, S. M. (1964). An analysis of the interaction of language, topic and listener. In J. J. Cumperz & D. H. Hymes (Eds.), The ethnography of communication. American Anthropologist, Special Publication 3, 86-102.

11.

Hulin, C. L. , Drasgow, F. , & Komoar, J. (1982). Applications of item response theory to analysis of attitude scale translations. Journal of Applied Psychology, 67, 818-825.

12.

Hulin, C. L. , Drasgow, F. , & Parsons, C. K. (1983). Item response theory: Applications to psychological measurement. Homewood, IL: Irwin.

13.

Hulin, C. L. , & Mayer, L. M. (1986). Psychometric equivalence of a translation of the JDI into Hebrew. Journal of Applied Psychology, 71, 83-94.

14.

Katerberg, R. , Hoy, S. , & Smith, F. J. (1977). Language, time, and person effects on attitude scale translations. Journal of Applied Psychology, 62, 385-391.

15.

Lawley, D. N. (1943). On problems connected with item selection and test construction. Proceedings of the Royal Society of Edinburgh, 61, 273-287.

16.

Levine, M. V. , & Drasgow, F. (1983). The relation between incorrect option choice and estimated ability. Educational and Psychological Measurement, 43, 675-685.

17.

Lord, F. M. (1977). A study of item bias, using item characteristic curve theory. In Y. H. Poortinga (Ed.), Basic problems in cross-cultural psychology. Amsterdam: Swets & Zeitlinger.

18.

Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.

19.

Lord, F. M. , & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

20.

MacNamara, J. (1970). Bilingualism and thought. In J. Alatis (Ed.), Monograph series on languages and linguistics. Washington, DC: Georgetown University Press.

21.

Osgood, C. E. , May, W. H. , & Miron, M. S. (1975). Cross-cultural universals of affective meaning. Urbana, IL: University of Illinois Press.

22.

Peal, E. , & Lambert, W. E. (1962). The relation of bilingualism to intelligence. Psychological Monographs, 76.

23.

Prince, R. , & Mombour, W. (1967). A technique for improving linguistic equivalence in cross-cultural surveys. International Journal of Social Psychiatry, 13, 229-237.

24.

Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometric Monograph, No. 17.

25.

Segalowitz, N. S. (1980). Issues in the cross-cultural study of bilingual development. In H. C. Triandis & J. W. Berry (Eds.), Handbook of cross-cultural psychology: Developmental psychology (Vol. 4). Boston: Allyn & Bacon.

26.

Smith, P. C. , Kendall, L. M. , & Hulin, C. L. (1969). Measurement of satisfaction in work and retirement. Chicago: Rand McNally.

27.

Stocking, M. L. , & Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.

28.

Torgerson, W. S. (1958). Theory and methods of scaling. New York: John Wiley.