Although study of clinical phenomena in individuals from different ethnic backgrounds has improved over the years, African American and Asian American individuals continue to be underrepresented in research samples. Without adequate psychometric data about how questionnaires perform in individuals from different ethnic samples, findings from both within and across groups are arguably uninterpretable. Analyses based on item response theory (IRT) allow us to make fine-grained comparisons of the ways individuals from different ethnic groups respond to clinical measures. This study compared response patterns of African American and Asian American undergraduates to White undergraduates on measures of depression, social anxiety, and worry. On the Beck Depression Inventory—II, response patterns for African American participants were roughly equivalent to the response patterns of White participants. On measures of worry and social anxiety, there were substantial differences, suggesting that the use of these measures in African American and Asian American populations may lead to biased conclusions.
Alegria, M., Vila, D., Woo, M., Canino, G., Takeuchi, D., Vera, M., et al. (2004). Cultural relevance and equivalence in the NLAAS instrument: Integrating etic and emic in the development of cross-cultural measures for a psychiatric epidemiology and services study of Latinos. International Journal of Methods in Psychiatric Research, 13, 270-288.
2.
Beck, A.T., Steer, R.A., Ball, R., & Ranieri, W.F. ( 1996). Comparison of Beck Depression Inventories-IA and -II in psychiatric outpatients. Journal of Personality Assessment , 67, 588-597.
3.
Beck, A.T., Steer, R.A., & Brown, G.K. ( 1996). Manual for the Beck Depression Inventory (2nd ed.). San Antonio, TX: Psychological Corporation.
4.
Bedi, R.P., Maraun, M.D., & Chrisjohn, R.D. (2001). A multi-sample item response theory analysis of the Beck Depression Inventory-1A. Canadian Journal of Behavioural Science, 33, 176-185.
5.
Benjamini, Y., & Hochberg, Y. ( 1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57, 289-300. Bentler, P.M. ( 1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
6.
Bentler, P.M. ( 1995). EQS: Structural equations program manual, Version 5.0 . Los Angeles: BMDP Statistical Software. Brislin, R.W., Lonner, W.J., & Thorndike , R.M. (1973). Cross-cultural research methods. New York: Wiley.
7.
Brown, T.A. ( 2003). Confirmatory factor analysis of the Penn State Worry Questionnaire: Multiple factors or method effects? Behaviour Research and Therapy, 41, 1411-1426.
8.
Brown, T.A., Antony, M.M., & Barlow, D.H. ( 1992). Psychometric properties of the Penn State Worry Questionnaire in a clinical anxiety disorders sample. Behaviour Research and Therapy, 30, 33-37.
9.
Carmody, D.P. ( 2005). Psychometric characteristics of the Beck Depression Inventory-II with college students of diverse ethnicity. International Journal of Psychiatry in Clinical Practice, 9, 22-28.
10.
Carter, M.M., Sbrocco, T., Miller, O., Jr., Suchday, S., Lewis, E.L., & Freedman, R.E.K. (2005). Factor structure, reliability, and validity of the Penn State Worry Questionnaire: Differences between African-American and White-American college students. Journal of Anxiety Disorders , 19, 827-843.
11.
Dutton, G.R., Grothe, K.B., & Jones, G.N., Whitehead, D., Kendra, K., & Brantley, P.J. (2004). Use of the Beck Depression Inventory-II with African American primary care patients. General Hospital Psychiatry, 26, 437-442.
12.
DeNavas-Walt, C., Proctor, B.D., & Lee, C.H. ( 2006). Income, poverty, and health insurance coverage in the United States: 2005. Washington, DC: Government Printing Office.
13.
Embretson, S.E., & Reise, S.P. ( 2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
14.
Fresco, D.M., Heimberg, R.G., Mennin, D.S., & Turk, C.L. ( 2002). Confirmatory factor analysis of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 40, 313-323.
15.
Gillis, M.M., Haaga, D.A.F., & Ford, G.T. ( 1995). Normative values for the Beck Anxiety Inventory, Fear Questionnaire, Penn State Worry Questionnaire, and Social Phobia and Anxiety Inventory. Psychological Assessment, 7, 450-455.
16.
Grothe, K.B., Dutton, G.R., & Jones, G.N. ( 2005). Validation of the Beck Depression Inventory-II in a low-income African American sample of medical outpatients. Psychological Assessment, 17, 110-114.
17.
Hazlett-Stevens, H., Ullman, J.B., & Craske, M.G. ( 2004). Factor structure of the Penn State Worry Questionnaire: Examination of a method factor. Assessment, 11, 361-370.
18.
Heimberg, R.G., & Turk, C.L. ( 2002). Assessment of social phobia. In R. G. Heimberg & E. Becker (Eds.), Cognitive-behavioral group therapy for social phobia: Basic mechanisms and clinical strategies (pp. 107-126). New York, NY: Guilford Press.
19.
Helms, J.E., Jernigan, M., & Mascher, J. ( 2005). The meaning of race in psychology and how to change it: A methodological perspective. American Psychologist, 60, 27-36.
20.
Hong, J.J., & Woody, S.R. ( 2007). Cultural mediators of self-reported social anxiety. Behaviour Research and Therapy, 45, 1779-1789.
21.
Horng, B., & Coles, M.E. ( 2004, March). Investigating the link between social anxiety and maladaptive perfectionism in Asian Americans. Poster presented at the annual meeting of the Anxiety Disorders Association of America, Miami, FL.
22.
Hu, L., & Bentler, P.M. ( 1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
23.
Jöreskog, K.G., & Sörbom, D. (1981). LISREL V: Analysis of linear structural relationships by the method of maximum likelihood. Chicago: National Educational Resources.
24.
Kessler, R.C., Berglund, P., Demler, O., Jin, R., Merikangas, K.R., & Walters, E.E. ( 2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey replication. Archives of General Psychiatry, 62, 593-602.
25.
Kim, S., & Cohen, A.S. ( 1995). A comparison of Lord’s chisquare, Raju’s area measures, and the likelihood ratio test on detection of differential item functioning. Applied Measurement in Education, 8, 291-312.
26.
Kim, Y., Pilkonis, P.A., Frank, E., Thase, M.E., & Reynolds, C.F. (2002). Differential functioning of the Beck Depression Inventory in late-life patients: Use of item response theory. Psychology and Aging, 17, 379-391.
27.
Lam, C.Y., Pepper, C.M., & Ryabchenko, K.A. (2004). Case identification of mood disorders in Asian American and Caucasian American college students. Psychiatric Quarterly, 75, 361-373.
28.
Lee, M.R., Okazaki, S. & Yoo, H.C. ( 2006). Frequency and intensity of social anxiety in Asian Americans andEuropean Americans. Cultural Diversity and Ethnic Minority Psychology, 12, 291-305.
29.
Mattick, R.P., & Clarke, J.C. ( 1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36, 455-470.
30.
Meyer, T.J., Miller, M.L., Metzger, R.L., & Borkovec, T.D. (1990). Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 28, 487-495.
Neal, A., & Turner, S. ( 1991). Anxiety disorders research with African Americans: Current status. Psychological Bulletin, 109, 400-410.
33.
Okazaki, S. ( 1997). Sources of ethnic differences between Asian American and White American college students on measures of depression and social anxiety . Journal of Abnormal Psychology, 106, 52-60.
34.
Okazaki, S. ( 2000). Asian American-White American difference on affective distress symptoms: Do symptom reports differ across reporting methods? Journal of Cross-Cultural Psychology, 31, 603-625.
35.
Okazaki, S., Liu, J.F., & Longworth, S.L. (2002). Asian American-White American differences in expressions of social anxiety: A replication and extension . Cultural Diversity and Ethnic Minority Psychology, 8, 234-247.
36.
Rodebaugh, T.L., Woods, C.M., & Heimberg, R.G. (2007). The reverse of social anxiety is not always the opposite: The reverse-scored items of the Social Interaction Anxiety Scale do not belong. Behavior Therapy, 38, 192-206.
37.
Rodebaugh, T.L., Woods, C.M., Heimberg, R.G., Liebowitz, M.R., & Schneier, F.R. (2006). The factor structure and screening utility of the Social Interaction Anxiety Scale. Psychological Assessment, 18, 231-237.
38.
Rubin, D.B. ( 1987). Multiple imputation for nonresponse in surveys. New York: Wiley.
39.
Samejima, F. ( 1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4 Pt. 2), 100.
40.
Samejima, F. ( 1997). Departure from normal assumptions: A promise for future psychometrics with substantive mathematical modeling. Psychometrika , 62, 471-493.
41.
Scott, E.L., Eng, W., & Heimberg, R.G. (2002). Ethnic differences in worry in a nonclinical population. Depression and Anxiety, 15, 79-82.
42.
Snowden, L.R. ( 2001). Barriers to effective mental health services for African Americans. Mental Health Services Research, 3, 181-187.
43.
Spector, P.E., Van Katwyk, P.T., Brannick, M.T., & Chen, P.Y. ( 1997). When two factors don‘t reflect two constructs: How item characteristics can produce artifactual factors. Journal of Management, 23, 659-677.
44.
Steiger, J.H., & Lind, J.C. ( 1980, May). Statistically-based tests for the number of factors . Paper presented at the annual spring meeting of the Psychometric Society, Iowa City, IA.
45.
Thissen, D. ( 2001). IRTLRDIF v2.0b: Software for the computation of the statistics involved in item response theory likelihood-ratio tests for differential item functioning. University of North Carolina at Chapel Hill: L. L. Thurstone Psyhometric Laboratory.
46.
Thissen, D., Steinberg, L., & Gerrard, M. ( 1986). Beyond group-mean differences: The concept of item bias . Psychological Bulletin, 99, 118-128.
47.
Thissen, D., Steinberg, L., & Kuang, D. ( 2002). Quick and easy implementation of the Benjamini-Hochberg procedure for controlling the false positive rate in multiple comparisons . Journal of Educational and Behavioral Statistics, 27, 77-83.
48.
Thissen, D., & Wainer, H. (Eds.). (2001). Test scoring. Mahwah, NJ: Lawrence Erlbaum.
49.
Tucker, L.R., & Lewis, C. ( 1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10.
50.
U.S. Census Bureau. (2007a). The American community: Asians: 2004. Retrieved May 16, 2007 , from http://www.census.gov/prod/2007pubs/acs-05.pdf
51.
U.S. Census Bureau. (2007b). The American community: Blacks: 2004. Retrieved May 16, 2007 from http://www.census.gov/prod/2007pubs/acs-04.pdf
52.
Ward, L.C. ( 2006). Comparison of factor structure models for the Beck Depression Inventory-II. Psychological Assessment, 18, 81-88.
53.
Wells, K., Klap, R., Koike, A., & Sherbourne C. ( 2001). Ethnic disparities in unmet need for alcoholism, drug abuse, and mental health care. American Journal of Psychiatry , 158, 2027-2032.
