Understanding score reliability is a necessary step in examining the validity of acculturation instruments. Thus, the authors evaluate the aggregate reliability of three multigroup, bidimensional acculturation instruments: General Ethnicity Questionnaire— Abridged, Stephenson Multigroup Acculturation Scale, and Vancouver Index of Acculturation. Reliability generalization techniques are used to analyze 51 internal consistency estimates and 6 sample characteristics for these instruments. Overall, reliability estimates for all three instruments appear to be robust. However, the ranges of reliability estimates across diverse samples vary greatly, which has implications for the interpretation of substantive outcomes and acculturation instrument selection. In addition, variability in reliability estimates is associated with scale length, gender, and ethnic composition of sample. Implications for acculturation research and measurement are discussed.
*Amer, M.M. (2005). Arab American mental health in the post September 11 era: Acculturation, stress, and coping (Doctoral dissertation, University of Toledo, 2005). Dissertation Abstracts International, 66, 1974.
2.
Beaupré, M.G., & Hess, U. (2006). An ingroup advantage for confidence in emotion recognition judgments: The moderating effect of familiarity with the expressions of outgroup members. Personality and Social Psychology Bulletin , 32, 16-26.
3.
Berry, J.W. (1979). Research in multicultural societies: Implications of cross-cultural methods. Journal of Cross-Cultural Psychology , 10, 415-434.
4.
Berry, J.W. (2003). Conceptual approaches to acculturation. In K. M. Chun, P. B. Organista, & G. Marín (Eds.), Acculturation: Advances in theory, measurement, and applied research (pp. 17-37). Washington, DC: American Psychological Association.
5.
*Bowen, N.A. (2002). Satisfaction with life of refugees and immigrants (Doctoral dissertation, University of Texas, Austin, 2002). Dissertation Abstracts International, 64, 3515.
6.
*Cheah, C.S.L., & Nelson, L.J. (2004). The role of acculturation in the emerging adulthood of aboriginal college students. International Journal of Behavioral Development, 28, 495-507.
7.
Chun, K. M., Organista, P. B., & Marín G. (Eds.). (2003). Acculturation: Advances in theory, measurement, and applied research. Washington, DC: American Psychological Association.
8.
Cohen, J., Cohen, P., West, S.G., & Aiken, L.S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum.
9.
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory . Belmont, CA: Wadsworth.
10.
Cuellar, I., Arnold, B., & Maldonado, R. (1995). Acculturation Rating Scale for Mexican Americans-II: A revision of the original ARSMA scale. Hispanic Journal of Behavioral Sciences, 17, 275-304.
11.
Cuellar, I., Harris, L.C., & Jasso, R. (1980). An acculturation scale for Mexican American normal and clinical populations. Hispanic Journal of Behavioral Sciences , 2, 199-217.
12.
*David, E.J.R., & Okazaki, S. (2006). The Colonial Mentality Scale (CMS) for Filipino Americans: Scale construction and psychological implications. Journal of Counseling Psychology, 53, 241-252.
13.
*D'urso, N. (2004). Effect of context on recall of self-referent and group-referent words in individuals from individualistic or collectivistic cultures (Doctoral dissertation, Hofstra University, 2004). Dissertation Abstracts International, 64, 5199.
14.
*Hall, G.C.N., Teten, A.L., DeGarmo, D.S., Sue, S., & Stephens, K.A. (2005). Ethnicity, culture, and sexual aggression: Risk and protective factors. Journal of Consulting and Clinical Psychology, 73, 830-840.
15.
Henson, R.K., & Thompson, B. (2002). Characterizing measurement error in scores across studies: Some recommendations for conducting "reliability generalization" studies. Measurement and Evaluation in Counseling and Development , 35, 113-126.
16.
Howell, R.T., & Shields, A.L. (2008). The file drawer problem in reliability generalizations: A strategy to compute a fail-safe N with reliability coefficients. Educational and Psychological Measurement, 68, 120-128.
17.
Hunter, J.E., & Schmidt, F.L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
18.
John, O.P., & Benet-Martínez, V. (2000). Measurement: Reliability, construct validation, and scale construction. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 339-369). New York: Cambridge University Press.
19.
*Kennedy, M.A., Parhar, K.K., Samra, J., & Gorzalka, B. (2005). Suicide ideation in different generations of immigrants . Canadian Journal of Psychiatry, 50, 353-356.
20.
Kieffer, K.M., Reese, R.J., & Thompson, B. (2001). Statistical techniques employed in AERJ and JCP articles from 1988 to 1997: A methodological review. Journal of Experimental Education, 69, 280-309.
21.
Li, H., Rosenthal, R., & Rubin, D.B. (1996). Reliability of measurement in psychology: From Spearman-Brown to maximal reliability. Psychological Methods , 1, 98-107.
22.
*Lyubansky, M., & Eidelson, R.J. (2005). Revisiting Du Bois: The relationship between African American double consciousness and beliefs about racial and national group experiences. Journal of Black Psychology , 31, 3-26.
23.
Meier, S.T., & Davis, S.R. (1990). Trends in reporting psychometric properties of scales used in counseling psychology research. Journal of Counseling Psychology, 37, 113-115.
24.
*Miville, M.L., & Constantine, M.G. (2006). Sociocultural predictors of psychological help-seeking attitudes and behavior among Mexican American college students. Cultural Diversity and Ethnic Minority Psychology , 12, 420-432.
25.
Nguyen, A.-M. D., & Benet-Martínez, V. (2007). Biculturalism unpacked: Components, individual differences, measurement, and outcomes. Social and Personality Psychology Compass, 1, 101-114.
26.
Nguyen, A.-M.D., Huynh, Q.-L., & Lonergan-Garwick, J. (2007). The role of acculturation in the mentoringcareer satisfaction model for Asian/Pacific Islander American university faculty. Cultural Diversity and Ethnic Minority Psychology, 13, 295-303.
27.
Nunnally, J.C., & Bernstein, I.H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
28.
*Rayle, A.D., & Myers, J.E. (2004). Counseling adolescents toward wellness: The roles of ethnic identity, acculturation, and mattering. Professional School Counseling, 8, 81-90.
29.
*Raymundo, M.M. (2005). Body dissatisfaction and disordered eating among minority women: The roles of acculturation and standard comparisons. Unpublished master's thesis, University of Houston, TX.
30.
Rowley, G.L. (1976). The reliability of observational measures. American Educational Research Journal, 13, 51-59.
31.
*Ryder, A.G., Alden, L.E., & Paulhus, D.L. (2000). Is acculturation unidimensional or bidimensional? A head-to-head comparison in the prediction of personality, self-identity, and adjustment. Journal of Personality and Social Psychology , 79, 49-65.
32.
Schmidt, F.L., & Hunter, J.E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology , 62, 529-540.
33.
*Stephenson, M. (2000). Development and validation of the Stephenson Multigroup Acculturation Scale (SMAS). Psychological Assessment, 12, 77-88.
34.
Suinn, R.M., Rickard-Figueroa, K., Lew, S., & Vigil, P. (1987). The Suinn-Lew Asian Self-Identity Acculturation Scale (SL-ASIA). Educational and Psychological Measurement , 47, 401-407.
35.
*Swagler, M.A., & Jome, L.R.M. (2005). The effects of personality and acculturation on the adjustment of North American sojourners in Taiwan. Journal of Counseling Psychology, 52, 527-536.
36.
Toyama, K.M. (2005). Self construal of Japanese-born women in the US: Examining egalitarian sex-role attitudes, self-esteem, acculturation and independence/interdependence. Unpublished doctoral dissertation, New York University .
37.
*Tsai, J.L. (2001). Cultural orientation of Hmong young adults. Journal of Human Behavior in the Social Environment, 3, 99-114.
38.
*Tsai, J.L., Chentsova-Dutton, Y., Freire-Bebeau, L., & Przymus, D.E. (2002). Emotional expression and physiology in European Americans and Hmong Americans. Emotion, 2, 380-397.
39.
*Tsai, J.L., Knutson, B., & Fung, H.H. (2006). Cultural variation in affect valuation. Journal of Personality and Social Psychology, 90, 288-307.
40.
*Tsai, J.L., Mortensen, H., Wong, Y., & Hess, D. (2002). What does "Being American" mean? A comparison of Asian American and European American young adults. Cultural Diversity and Ethnic Minority Psychology, 8, 257-273.
41.
*Tsai, J.L., Simeonova, D.I., & Watanabe, J.T. (2004). Somatic and social: Chinese Americans talk about emotion. Personality and Social Psychology Bulletin, 30, 1226-1238.
42.
*Tsai, J.L., Ying, Y.-W., & Lee, P.A. (2000). The meaning of "being Chinese" and "being American": Variation among Chinese American young adults. Journal of Cross-Cultural Psychology, 31, 302-331.
43.
*Tsoh, J.Y., Lam, J.N., Delucchi, K.L., & Hall, S.M. (2003). Smoking and depression in Chinese Americans. American Journal of the Medical Sciences, 326, 187-191.
44.
Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6-20.
45.
Vacha-Haase, T., Henson, R., & Caruso, J.C. (2002). Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562-569.
46.
*Varte, C.L., & Zokaitluangi, L. (2006). Aspects of identity and symptoms of adjustment related problems in the acculturating Mizo students . Social Science International, 22, 111-132.
47.
*Vergara, D. (2006). Culture, parental attachment, and trait anxiety: A comparison of Latino- and Caucasian-Americans. Manuscript submitted for publication.
48.
Whittington, D. (1998). How well do researchers report their measures? An evaluation of measurement in published educational research. Educational and Psychological Measurement, 58, 21-37.
49.
Wilkinson, L., & the American Psychological Association Task Force on Statistical Inference (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
50.
*Winograd, G. (2005). Predictors of counseling expectations among students in an opportunity program (Doctoral dissertation, The City University of New York, 2005). Dissertation Abstracts International, 66, 898.
51.
*Wong, S.L. (2001). Depression level in inner-city Asian American adolescents: The contributions of cultural orientation and interpersonal relationships . Journal of Human Behavior in the Social Environment, 3, 49-64.
52.
Zane, N., & Mak, W. (2003). Major approaches to the measurement of acculturation among ethnic minority populations: A content analysis and an alternative empirical strategy. In K. M. Chun, P. B. Organista, & G. Marín (Eds.), Acculturation: Advances in theory, measurement, and applied research (pp. 39-60). Washington, DC: American Psychological Association.
