Cross-Language and Cross-Cultural Comparisons in Scale Translations

Abstract

High fidelity translations of measurement instruments from one language to another are required for meaningful comparisons between and within cultures and language groups. Methods from Item Response Theory (IRT) were used to assess the degree to which a French Canadian translation of the Job Descriptive Index (JDI) (Smith, Kendall, & Hulin, 1969), a job satisfaction inventory, provided measurement equivalence across source and target languages and cultures. Data were collected using the translated instrument administered to Francophone Canadians. Responses to the English version of the JDI were also obtained from (1) Francophone Canadians, (2) Anglophone Canadians, and (3) English-speaking Americans. These data allow for multiple comparisons within each item and test different hypotheses about sources of nonequivalence in the translation; the roles of language and culture in item bias are examined independently. Interpretations for the patterns of bias displayed by some items are presented.

Get full access to this article

View all access options for this article.

References

Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

Bock, R. D. , & Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179-197.

Brislin, R. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1, 185-216.

Campbell, J. P. (1970). The way it should be done. Contemporary Psychology, 15, 540-542.

deVera, M. V. (1985). Establishing cultural relevance and measurement equivalence using emic and etic items. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.

Drasgow, F. (1986). Conditional and marginal estimation of the item parameters of the two-parameter model. Manuscript in preparation.

Drasgow, F. , & Hulin, C. L. (1986). Assessing the equivalence of measurement of attitudes and aptitudes across heterogeneous subpopulations. Unpublished manuscript. University of Illinois at Urbana-Champaign.

Drasgow, F. , & Parsons C. L. , (1983). Application of unidimensional item response theory models to multidimensional data. Applied Psychological Measurement, 7, 189-199.

Gipper, H. (1963). Bausteine zur Sprachinalisforschung. Dusseldorf: Padagogischer Verlag, Schwann.

10.

Hulin, C. L. (1986). Psychometric theory of item and scale translations: Equivalence across languages. Manuscript under review.

11.

Hulin, C.L. , Drasgow, F. , & Komocar, J. (1982). Application of item response theory to analysis of attitude scale translations. Journal of Applied Psychology, 67, 818-825.

12.

Hulin, C. L. , Drasgow, F. , & Parsons, C. K. (1983). Item response theory: Applications to psychological measurement. Homewood, IL: Irwin.

13.

Hulin, C. L. , Lissak, R. I. , & Drasgow, F. (1982). Recovery of two-and three-parameter logistic item characteristic curves: A Monte Carlo study. Applied Psychological Measurement, 6, 249-260.

14.

Hulin, C. L. , & Mayer, L. J. (1986). Linguistic and psychometric equivalence of items across languages: An evaluation of a translation of the JDI into Hebrew. Journal of Applied Psychology 71, 83-94.

15.

Linn, R. L. , Levine, M. V. , Hastings, C. N. , & Wardrop, J. L. (1981). Item bias in a test of reading comprehension. Applied Psychological Measurement, 5, 159-173.

16.

Lord, F. M. (1980). Applications of item response theory of practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.

17.

Lord, F. M. , & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

18.

Parsons, C. K. , & Hulin, C. L. (1982). An empirical comparison of item response theory and hierarchical factor analysis in applications to the measurement of job satisfaction. Journal of Applied Psychology, 67, 826-834.

19.

Richards, I. (1953). Toward a theory of translation. Studies in Chinese thought. American Anthropological Association, 55, Memoir 75. Chicago: University of Chicago Press.

20.

Robinson, J. P. , Athanasiou, R. , & Head, K. B. (1969). Measures of occupational attitudes and occupational characteristics. Ann Arbor, MI: Survey Resarch Center.

21.

Segall, D. O (1983). Test characteristic curves, item bias, and transformation to a common metric in item response theory: A methodological artifact with serious consequences and a simple solution. Unpublished manuscript, University of Illinois.

22.

Smith, P. C. , Kendall, L. M. , & Hulin, C. L. (1969). Measurement of satisfaction in work and retirement. Chicago: Rand-McNally.

23.

Stocking, M. L. , & Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.

24.

Vroom, V. H. (1964). Work and motivation. New York: John Wiley.

25.

Werner, O. , & Campbell, D. (1970). Translating, working through interpreters, and the problem of decentering. In R. Naroll & R. Cohen (Eds.), A handbook of method in cultural anthropology (pp. 398-410). New York: Natural History press.

26.

Wright, B. D. (1977). Solving measurement problems with the Rasch model. Journal of Educational Measurement, 14, 97-116.