As the apartheid system crumbles, test populations become progressively more multi-cultural. Most tests, however, were created and standardized in the days when test populations were made up of a single cultural group. Not surprisingly, questions are increasingly being asked as to the comparability of test scores across cultures. As yet, very little comparability research has been done in the non-cognitive domain. In this article the authors examine the comparability of scores on the South African Personality Questionnaire (SAPQ) in two black and and two white samples. Construct comparability of the five scales was investigated using a number of techniques, including exploratory and confirmatory factor analysis; item bias was investigated through the application of a ‘multimethod-multisample’ strategy. An item analysis was also conducted. The results indicated modest support for the construct comparability of scales in both white and one black sample; but a majority of items failed to satisfy either the no-bias or the item-total correlation criteria. The Rigidity scale performed the worst and the Dominance scale the best. The findings indicate that the SAPQ cannot simply be patched up in order to make it suitable for cross-cultural applications. The authors believe that a clean-sheet approach is needed. They suggest a strategy for the creation of a new personality instrument suitable for cross-cultural use in South Africa.
Get full access to this article
View all access options for this article.
References
1.
AderH.J. (1982). BIASIT: Iterative program to select biased items. Amsterdam: Subfacility of Psychology, Vrije Universiteit.
2.
AllportG.W. (1931). What is a trait of personality?. Journal of Abnormal and Social Psychology, 25, 368–372.
3.
AllportG.W. (1966). Traits revisited. American Psychologist, 21, 1–10.
4.
AmelangM.BorkenauP. (1986). The trait concept: Current theoretical considerations, empirical facts, and implications for personality inventory construction. In AngleitnerA.WigginsJ.S. (Eds), Personality assessment via questionnaires. Berlin: Springer Verlag.
5.
AngoffW.H.FordS.F. (1973). Item-race interaction on a test of scholastic aptitude. Journal of Educational Measurement, 10, 95–106.
6.
BerryJ.W. (1969). Cultural systems and cognitive styles. In FriedmanM.P.DasJ.P.ConnorN.O. (Eds), Intelligence and learning. New York: Plenum.
7.
BerryJ.W. (1980). Introduction to Methodology. In TriandisH.C.BerryJ.W. (Eds), Handbook of cross-cultural psychology, vol. 2: Methodology. Boston: Allyn & Bacon.
8.
BerryJ.W. (1984). Towards a universal psychology of cognitive competence. International Journal of Psychology, 19, 335–361.
9.
BrislinR.W.LonnerW.J.ThorndikeR.M. (1973). Cross-cultural research methods. New York: John Wiley.
10.
BrodyN. (1988). Personality in search of individuality. San Diego: Academic Press.
11.
BrowneM.W. (1977). The analysis of patterned correlation matrices by generalized least squares. British Journal of Mathematical and Statistical Psychology, 30, 113–124.
ClearyT.A.HiltonT.L. (1968). Test bias: Prediction of grades of Negro and white students in integrated colleges. Journal of Educational and Psychological Measurement, 28, 61–75.
14.
Du PreezP.WardD.G. (1970). Personal constructs of modern and traditonal Xhosa. Journal of Social Psychology, 82, 149–160.
15.
FeuersteinR. (1980). Instrumental enrichment. Baltimore: University Park Press.
16.
FrijdaN.H.JahodaG. (1966). On the scope and methods of cross-cultural research. International Journal of Psychology, 1, 110–127.
17.
GeertzC. (1971). The interpretation of cultures. New York: Basic Books.
18.
HonessT.KlineP. (1974). The use of the EPI and JEPI with a student population in Uganda. British Journal of Social and Clinical Psychology, 13, 96–98.
19.
HuiC.H.TriandisH.C. (1983). Multistrategy approach to cross-cultural research: The case of locus of control. Journal of Cross-Cultural Psychology, 14, 65–83.
20.
HumphreysL.C. (1986). An analysis and evaluation of test and item bias in the prediction context. Journal of Applied Psychology, 71, 327–333.
21.
IntasuwanP. (1979). A comparison of three approaches for determining item bias in cross-cultural testing. Unpublished Doctoral Dissertation. Pittsburgh: University of Pittsburgh.
22.
IronsonG.H. (1982). Use of chi-square and latent trait approaches for detecting item bias. In BerkR. (Ed.), Handbook of methods for detecting test bias. Baltimore: Johns Hopkins University Press.
23.
IronsonG.H.HomanS.WillisR.SignerB. (1984). The validity of item bias techniques with math word problems. Applied Psychological Measurement, 8, 391–396.
24.
IrvineS.H.CarrolW.K. (1980). Testing and assessment: Issues in methodology and theory. In TriandisH.C.BerryJ.W. (Eds), Handbook of cross-cultural psychology, vol. 2: Methodology. Boston: Allyn & Bacon.
25.
JacksonD.N. (1970). A sequential system for personality questionnaire development. In SpielbergerC.D. (Ed.), Current topics in clinical and community psychology. New York: Academic Press.
26.
JacksonD.N.GuthrieG.M.AstillaE.ElwoodB. (1983). The cross-cultural generalizability of personality construct measures. In IrvineS.H.BerryJ.W. (Eds), Human assessment and cultural factors. New York: Plenum.
27.
JensenA.R. (1980). Bias in mental testing. London: Methuen.
JoreskogK.G.SorbomD. (1981). LISREL Users Guide, Version 5. Uppsala: National Educational Resources Inc.
30.
KellyG.A. (1955). The psychology of personal constructs. New York: Norton.
31.
KlineP. (1967). The use of the Cattell 16PF and Eysenck's EPI with a literate population in Ghana. British Journal of Social and Clinical Psychology, 6, 97–107.
32.
KokF.G.MellenberghG.J.van der HierH. (1985). Detecting experimentally induced item bias using the iterative logit method. Journal of Educational Measurement, 22, 295–303.
33.
LordF.M. (1977). A study of item bias, using item characteristic curve theory. In PoortingaY.H. (Ed.), Basic problems in cross-cultural psychology. Amsterdam: Swets and Zeitlinger.
34.
LordF.M. (1980). Applications of item response theory to practical testing problems. Hillsdale: Lawrence Erlbaum.
35.
MauerK.F.RetiefA.I. (1985). Metodologiese probleme in die sielkunde. Suid-Afrikaanse Tydskrif vir Wysbegeerte, 4, 19–24.
36.
MischelW. (1968). Personality and assessment. New York: John Wiley.
37.
MullerM.W.BrowneM.W. (1972). Program specification for fast factor analyses. Johannesburg: National Institute for Personnel Research.
38.
OsterlindS. (1983). Test item bias. Beverly Hills: Sage Publications.
39.
OwenK. (1986). Toets- en item sydigheid: Toepassing van die Senior Aanlegtoets, Meganiese Insigtoets, en Skolastiese Bekwaamheidsbattery op blanke, swart, kleurlingen Indier technikonstudente. IPER Report P-66. Pretoria: Human Sciences Research Council.
40.
OwenK. (1989). Test and item bias: The suitability of the Junior Aptitude tests as a common test battery for white, Indian, and black pupils in Standard 7. IPER Report P. 96. Pretoria: Human Sciences Research Council.
41.
PoortingaY.H. (1971). Cross-cultural comparison of maximum performance tests: Some methodological aspects and some experiments with simple auditory and visual stimuli. Psychologica Africana, Monograph Supplement No. 6.
42.
PoortingaY.H.van der FlierH. (1988). The meaning of item bias in ability tests. In IrvineS.H.BerryJ.W. (Eds), Human abilities in cultural context. Cambridge: Cambridge University Press.
43.
PoortingaY.H.van der VijverF.J.R. (1987). Explaining cross-cultural differences: Bias analysis and beyond. Journal of Cross-Cultural Psychology, 18, 259–282.
44.
PoortingaY.H.van der VijverF.J.R. (1988). Culturally invariant parameters of cognitive functioning. In BerryJ.W.IrvineS.H.HuntE.B. (Eds), Indigenous cognition: Functioning in cultural context. Dordrecht: Martinum Nijhoff Publishers.
45.
RetiefA.I. (1987). Thematic apperception testing across cultures: Tests of selection versus tests of inclusion. South African Journal of Psychology, 17, 47–55.
46.
ScheunemanJ.D. (1979). A method of assessing bias in test items. Journal of Educational Measurement, 16, 143–152.
47.
ShepardL.A.CamilliG.WilliamsD.M. (1984). Accounting for statistical artifacts in item bias research. Journal of Educational Statistics, 9, 93–128.
48.
SpenceB.A. (1982). Psychological investigation into the characteristics of black guidance teachers. Unpublished Masters dissertation. Pretoria: University of South Africa.
49.
SternbergR.J.ConwayB.E.KetronJ. L.BernsteinM. (1981). People's conceptions of intelligence. Journal of Personality and Social Psychology, 41, 37–55.
50.
SteynD.W. (1974). Test administrator's manual for the South African Personality Questionnaire. Johannesburg: National Institute for Personnel Research.
51.
SteynD.W. (1977). Die konstruksie en evaluasie van 'n Suid- Afrikaanse persoonlikheidsvraelys. Unpublished Masters dissertation. Pretoria: University of Pretoria.
52.
TaylorT.R. (1987). Test bias: The roles and responsibilities of test user and test publisher. NIPR Special Report Pers-424. Pretoria: Human Sciences Research Council.
53.
TaylorT.R.BoeyensJ.C.A. (1990). A comparison of black and white responses to the South African Personality Questionnaire. NIPR Report Pers-440. Pretoria: Human Sciences Research Council.
54.
Van der FlierH.MellenberghG.J.AderH.J.WijnM. (1984). An iterative item bias detection method. Journal of Educational Measurement, 21, 131–145.
55.
Van der FlierH.MellenberghG.J.AderH.J. (1984). Een onderzoek naar de effectiviteit van een iteratieve item bias detectie methode bij groupen met een verschallend treknivo. Tijdschrift voor Onderwijsresearch, 9, 61–70.
56.
Van der VijverF.J.R.PoortingaY.H. (1982). Cross-cultural generalization and universality. Journal of Cross-cultural Psychology, 13, 387–408.
57.
VygotskyL.S. (1978). Mind in society. Cambridge (Mass.): The MIT Press.
58.
WhiteD.H. (1982). The effects of job stress in the South African mining industry. Unpublished Doctoral thesis. Pretoria: University of South Africa.
59.
ZakI. (1976). A cross-cultural check of the personality structure of the 16PF. Multivariate Experimental Clinical Research, 2, 123–127.
