This study deals with theoretical and methodological problems relating to the comparison of test results of individuals and groups with differing cultural backgrounds. An analysis of the score patterns on test items can be used to identify individuals and groups for whom the test scores have a deviant meaning. A statistic is developed by which the deviance of score patterns can be quantified and which indicates whether or not a person's test score can be compared with the scores in a specific group. In two simulation studies the discriminative power of deviance scores is investigated by means of computer-generated score patterns. The last part of the study deals with the application of deviance scores to cross-cultural research. It is shown that deviance scores can be used to identify individuals for whom the test scores give an underestimation of their capacities.
Get full access to this article
View all access options for this article.
References
1.
Deregowski, J. B.Lack of applied perceptual theory: The case of engineering drawings. In L. Eckensberger, W. Lonner, & Y. H. Poortinga (Eds.) Cross-cultural contributions to psychology. Lisse: Swets & Zeitlinger, 1979.
2.
Drenth, P.J.D. , van der Flier, H., & Omari, I. M.The use of classroom tests, examinations and aptitude tests in a developing country. In L. Eckensberger, W. Lonner, & Y. H. Poortinga (Eds.) Cross-cultural contributions to psychology. Lisse: Swets & Zeitlinger, 1979.
3.
Gagne, R. M.Learning hierarchies . Educational Psychology, 1968, 6, 1-6.
4.
Guttman, L.A new approach to factor analysis: The radex. In P. F. Lazarsfeld (Ed.) Mathematical thinking in the social sciences. New York: Macmillan, 1954.
5.
Guttman, L.Empirical verification of the radex structure of mental and personality traits . Educational and Psychological Measurement, 1957, 17, 391-407.
6.
Harnisch, D. L. & Linn, R. L.Analysis of item response patterns: Questionnable test data and dissimilar curriculum practices. Journal of Educational Measurement, 1981, 18, 133-146.
7.
Hudson, W.Pictorial depth perception in sub-cultural groups in Africa . Journal of Social Psychology, 1960, 52, 183-208.
8.
Hudson, W.The study of the problem of pictorial perception among unacculturated groups . International Journal of Psychology, 1967, 2, 89-107.
9.
Irvine, S. H.Figural tests of reasoning in Africa . International Journal of Psychology, 1969a, 4, 217-228.
10.
Irvine, S. H.Factor analysis of African abilities and attainments: Constructs across cultures . Psychological Bulletin, 1969b, 71, 20-32.
11.
Jennrich, R. I.An Asymptotic X2 test for the equality of two correlation matrices . Journal of the American Statistical Association, 1970, 65, 904-912.
12.
Kerlinger, F. N. & Pedhazur, E. J.Multiple regression in behavioral research. New York: Holt, Rinehart & Winston, 1973.
13.
Levine, M. V. & Rubin, D. B.Measuring the appropriateness of multiple-choice test scores. Journal of Educ. Statistics, 1979, 4, 269-290.
14.
Lord, F. M.A study of item bias, using item characteristic curve theory. In Y. H. Poortinga (Ed.) Basic problems in cross-cultural psychology. Amsterdam: Swets & Zeitlinger, 1977.
15.
Lord, F. M.Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum, 1980.
16.
Lord, F. M. and Novick, M. R.Statistical theories of mental test scores. Reading, MA: Addison-Wesley, 1968.
17.
Mellenbergh, G. J.An investigation of the applicability of the Rasch model in different cultures. In L. J. Cronbach & P.J.D. Drenth (Eds.) Mental tests and cultural adaptation. Mouton: Den Haag, 1972.
18.
Mellenbergh, G. J.Contingency table models for assessing item bias. Psychologisch Laboratorium, University of Amsterdam, 1980.
19.
Mokken, R. J.A theory and procedure of scale analysis. Mouton: Den Haag, 1970.
20.
Mood, A. M. , Graybill, F. A., & Boes, D. C.Introduction to the theory of statistics. New York: McGraw-Hill, 1974.
21.
Niemöller, B. & Spreger, C.J.A.Procrustiese rotaties; subprogramma procrustus rotate. Technisch Centrum, University of Amsterdam, 1977.
22.
Poortinga, Y. H.Cross-cultural comparison of maximum performance tests: Some methodological aspects and some experiments with simple auditory and visual stimuli . Psychologica Africana, Monograph, 1971, (Supplement 6).
23.
Poortinga, Y. H.Limitations on inter-cultural comparison of psychological data . Nederlands Tijdschrift voor de Psychologie, 1975, 30, 23-29.
24.
Scheuneman, J.Latent-trait theory and item bias. In L.J.Th. van der Kamp, W. F. Langerak, & D.N.M. de Gruijter (Eds.) Psychometrics for educational debates. London: John Wiley, 1980.
25.
Van der Flier, H.Evaluating environmental influences on test scores. In L. J. Cronbach & P.J.D. Drenth (Eds.) Mental tests and cultural adaptation. Mouton: Den Haag, 1972.
26.
Van der Flier, H.Environmental factors and deviant response patterns. In Y. H. Poortinga (Ed.) Basic problems in cross-cultural psychology. Lisse: Swets & Zeitlinger, 1977.
27.
Vernon, P. E.Intelligence and cultural environment. London: Methuen, 1969.
28.
Wright, B. C. , Mead, R., & Draba, R.Detecting and correcting test item bias with a logistic response model. Research Memorandum 22, 1976, Statistical Laboratory, Department of Education, University of Chicago.
