There have been over 30 studies and two meta-analyses comparing social anxiety between Asian Americans and European Americans. However, few have investigated the invariance of social anxiety measures that would make these comparisons appropriate. In the current study, we systematically examined psychometric properties and configural, metric, and scalar invariance of five social anxiety measures and four short forms that have been used more than once to compare Asian Americans (n = 232) and European Americans (n = 193). We found that four (i.e., SPS-6, SIAS-6, SPS, and SPAI-18) of the nine scales were scalar invariant, three scales (i.e., SIAS, SPAI, and B-FNES) only achieved configural invariance, and two scales (i.e., FNES and SADS) failed to achieve configural invariance. Latent mean comparisons based on the scalar invariant measures revealed higher social anxiety scores for Asian Americans than European Americans. The findings are discussed with regard to the issues and challenges when comparing social anxiety among different cultural and ethnic groups.
AderkaI. M.NickersonA.BøeH. J.HofmannS. G. (2012). Sudden gains during psychological treatments of anxiety and depression: A meta-analysis. Journal of Consulting and Clinical Psychology, 80, 93-101. doi:10.1037/a0026455
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: Author.
3.
BeidelD. C.TurnerS. M.StanleyM. A.DancuC. V. (1989). The Social Phobia and Anxiety Inventory: Concurrent and external validity. Behavior Therapy, 20, 417-427. doi:10.1016/S0005-7894(89)80060-7
4.
BlancoC.OkudaM.WrightC.HasinD. S.GrantB. F.LiuS.-M.OlfsonM. (2008). Mental health of college students and their non-college-attending peers. Archives of General Psychiatry, 65, 1429-1437. doi:10.1001/archpsyc.65.12.1429
5.
BlantonH.JaccardJ. (2006). Arbitrary metrics in psychology. The American Psychologist, 61, 27–41. doi:10.1037/0003-066X.61.1.62
6.
BrownT. A. (2006). Confirmatory factor analysis for applied research. New York: The Guilford Press.
7.
ByrneB. M.ShavelsonR. J.MuthénB. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466. doi:10.1037/0033-2909.105.3.456
8.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. doi:10.1207/S15328007SEM0902_5
9.
ChinD.KameokaV. A. (2006). Sociocultural influences. In AndrasikF. (Ed.), Comprehensive handbook of personality and psychopathology: Vol. 2: Adult Psychopathology (pp. 67-84). Hoboken, NJ: John Wiley.
10.
ClarkD. M.WellsA. (1995). A cognitive model of social phobia. In HeimbergR. G.LiebowitzM. R.HopeD. A.SchneierF. R. (Eds.), Social phobia: Diagnosis, assessment, and treatment (pp. 69-93). New York, NY: Guilford Press.
11.
CohenJ. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
12.
ConditC. S.CarterM. M.TangD.RothsteinL. A. (2015). Cultural validity and the measurement of social anxiety: Asian American groups are not psychometrically equivalent. Journal of Depression and Anxiety, 4, 174-182. doi:10.4172/2167-1044.1000174
13.
de VenteW.MajdandžićM.VonckenM. J.BeidelD. C.BögelsS. M. (2014). The SPAI-18, a brief version of the Social Phobia and Anxiety Inventory: Reliability and validity in clinically referred and non-referred samples. Journal of Anxiety Disorders, 28, 140-147. doi:10.1016/j.janxdis.2013.05.003
14.
Doucette-GatesA.Brooks-GunnJ.Chase-LansdaleP. L. (1998). The role of bias and equivalence in the study of race, class, and ethnicity. In McLoydV. C.SteinbergL. (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 211-236). Mahwah, NJ: Lawrence Erlbaum.
15.
EndersC. K.BandalosD. L. (2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling, 8, 430-457. doi:10.1207/S15328007SEM0803_5
16.
FergusT. A.ValentinerD. P.KimH.-S.McGrathP. B. (2014). The Social Interaction Anxiety Scale (SIAS) and the Social Phobia Scale (SPS): A comparison of two short-form versions. Psychological Assessment, 26, 1281-1291. doi:10.1037/a0037313
17.
GotlibI. H. (1984). Depression and general psychopathology in university students. Journal of Abnormal Psychology, 93, 19-30. doi:10.1037/0021-843X.93.1.19
18.
GreenfieldP. M. (1997). You can’t take it with you: Why ability assessments don’t cross cultures. American Psychologist, 52, 1115-1124. doi:10.1037/0003-066X.52.10.1115
19.
HambrickJ. P.RodebaughT. L.BalsisS.WoodsC. M.MendezJ. L.HeimbergR. G. (2010). Cross-ethnic measurement equivalence of measures of depression, social anxiety, and worry. Assessment, 17, 155-171. doi:10.1177/1073191109350158
20.
HardinE. E.LeongF. T. (2005). Optimism and pessimism as mediators of the relations between self-discrepancies and distress among Asian and European Americans. Journal of Counseling Psychology, 52, 25-35. doi:10.1037/0022-0167.52.1.25
21.
HeeneM.HilbertS.FreudenthalerH. H.BühnerM. (2012). Sensitivity of SEM fit indexes with respect to violations of uncorrelated errors. Structural Equation Modeling, 19, 36-50. doi:10.1080/10705511.2012.634710
22.
HeimbergR. G.BrozovichF. A.RapeeR. M. (2010). A cognitive behavioral model of social anxiety disorder: Update and extension. In DiBartoloS. G.HofmannP. M. (Eds.), Social anxiety: Clinical, developmental, and social perspectives (2nd ed., pp. 395-422). San Diego, CA: Elsevier Academic Press. doi:10.1016/b978-0-12-375096-9.00015-8
23.
HongJ. J.WoodyS. R. (2007). Cultural mediators of self-reported social anxiety. Behaviour Research and Therapy, 45, 1779-1789. doi:10.1016/j.brat.2007.01.011
24.
HsuL.AldenL. E. (2007). Social anxiety in Chinese- and European-heritage students: The effect of assessment format and judgments of impairment. Behavior Therapy, 38, 120-131. doi:10.1016/j.beth.2006.06.006
25.
HsuL.WoodyS. R.LeeH.-J.PengY.ZhouX.RyderA. G. (2012). Social anxiety among East Asians in North America: East Asian socialization or the challenge of acculturation?Cultural Diversity & Ethnic Minority Psychology, 18, 181-191. doi:10.1037/a0027690
26.
HuL.BentlerP. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453. doi:10.1037/1082-989X.3.4.424
27.
HurleyA. E.ScanduraT. A.SchriesheimC. A.BrannickM. T.SeersA.VandenbergR. J.WilliamsL. J. (1997). Exploratory and confirmatory factor analysis: Guidelines, issues, and alternatives. Journal of Organizational Behavior, 18, 667-683. doi:10.1002/(SICI)1099-1379(199711)18:6<667::AID-JOB874>3.0.CO;2-T
28.
JöreskogK. G. (1990). New developments in LISREL: Analysis of ordinal variables using polychoric correlations and weighted least squares. Quality & Quantity, 24, 387-404. doi:10.1007/bf00152012
29.
KesslerR. C.GreenbergP. E. (2002). The economic burden of anxiety and stress disorders. Neuropsychopharmacology, 67, 982-992.
30.
KesslerR. C.SteinM. B.BerglundP. (1998). Social phobia subtypes in the National Comorbidity Survey. American Journal of Psychiatry, 155, 613-619. doi:10.1176/ajp.155.5.613
31.
KnightG. P.HillN. E. (1998). Measurement equivalence in research involving minority adolescents. In McLoydV.SteinbergL. (Eds.), Studying minority adolescents: Conceptual, methodological and theoretical issues (pp. 183-210). Hillsdale, NJ: Lawrence Erlbaum.
32.
KriegA.XuY. (2015). Ethnic differences in social anxiety between individuals of Asian heritage and European heritage: A meta-analytic review. Asian American Journal of Psychology, 6, 66-80. doi:10.1037/a0036993
33.
LauA. S.FungJ.WangS.KangS.-M. (2009). Explaining elevated social anxiety among Asian Americans: Emotional attunement and a cultural double bind. Cultural Diversity & Ethnic Minority Psychology, 15, 77-85. doi:10.1037/a0012819
34.
Le BlancA. L.BruceL. C.HeimbergR. G.HopeD. A.BlancoC.SchneierF. R.LiebowitzM. R. (2014). Evaluation of the psychometric properties of two short forms of the Social Interaction Anxiety Scale and the Social Phobia Scale. Assessment, 21, 312-323. doi:10.1177/1073191114521279
35.
LearyM. R. (1983). A brief version of the Fear of Negative Evaluation Scale. Personality and Social Psychology Bulletin, 9, 371-375. doi:10.1177/0146167283093007
36.
LeeM. R.OkazakiS.YooH. C. (2006). Frequency and intensity of social anxiety in Asian Americans and European Americans. Cultural Diversity & Ethnic Minority Psychology, 12, 291-305. doi:10.1037/1099-9809.12.2.291
37.
LiebowitzM. R. (1987). Social phobia. Modern Problems of Pharmacopsychiatry, 22, 141-173. doi:10.1159/000414022
38.
LittleT. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76. doi:10.1207/s15327906mbr3201_3
39.
MakW. W. S.LawR. W.TengY. (2011). Cultural model of vulnerability to distress: The role of self-construal and sociotropy on anxiety and depression among Asian Americans and European Americans. Journal of Cross-Cultural Psychology, 42, 75-88. doi:10.1177/0022022110361713
40.
MarkusH. R.KitayamaS. (1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review, 98, 224-253. doi:10.1037/0033-295x.98.2.224
41.
MarsellaA. J.YamadaA. M. (2007). Culture and psychopathology: Foundations, issues, and directions. In CohenS. K. D. (Ed.), Handbook of cultural psychology (pp. 797-818). New York, NY: Guilford Press.
42.
MarshH. W.HocevarD. (1985). Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. Psychological Bulletin, 97, 562-582. doi:10.1037/0033-2909.97.3.562
43.
MattickR. P.ClarkeJ. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36, 455-470. doi:10.1016/s0005-7967(97)10031-6
44.
MelkaS. E.LancasterS. L.AdamsL. J.HowarthE. A.RodriguezB. F. (2010). Social anxiety across ethnicity: A confirmatory factor analysis of the FNE and SAD. Journal of Anxiety Disorders, 24, 680-685. doi:10.1016/j.janxdis.2010.04.011
MoscovitchD. A.RodebaughT. L.HeschB. D. (2012). How awkward! Social anxiety and the perceived consequences of social blunders. Behaviour Research and Therapy, 50, 142-149. doi:10.1016/j.brat.2011.11.002
47.
MuthénB. O.du ToitS. H.SpisicD. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Psychometrika, 75, 49. doi:10.2139/ssrn.201668
48.
NortonP. J.WeeksJ. W. (2009). A multi-ethnic examination of socioevaluative fears. Journal of Anxiety Disorders, 23, 904-908. doi:10.1016/j.janxdis.2009.05.008
49.
OkazakiS. (1997). Sources of ethnic differences between Asian American and White American college students on measures of depression and social anxiety. Journal of Abnormal Psychology, 106, 52-60. doi:10.1037/0021-843x.106.1.52
50.
OkazakiS.LiuJ. F.LongworthS. L.MinnJ. Y. (2002). Asian American-White American differences in expressions of social anxiety: A replication and extension. Cultural Diversity & Ethnic Minority Psychology, 8, 234-247. doi:10.1037/1099-9809.8.3.234
51.
OkazakiS.SueS. (1995). Methodological issues in assessment research with ethnic minorities. Psychological Assessment, 7, 367-375. doi:10.1037/1040-3590.7.3.367
52.
OsmanA.BarriosF. X.AukesD.OsmanJ. R. (1995). Psychometric evaluation of the social phobia and anxiety inventory in college students. Journal of Clinical Psychology, 51, 235-243. doi:10.1002/1097-4679(199503)51:2<235::AID-JCLP2270510213>3.0.CO;2-R
53.
OsmanA.GutierrezP. M.BarriosF. X.KopperB. A.ChirosC. E. (1998). The Social Phobia and Social Interaction Anxiety Scales: Evaluation of psychometric properties. Journal of Psychopathology and Behavioral Assessment, 20, 249-264. doi:10.1023/A:1023067302227
54.
OysermanD.CoonH. M.KemmelmeierM. (2002). Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses. Psychological Bulletin, 128, 3-72. doi:10.1037/0033-2909.128.1.3
55.
ParkI. J. K.SulaimanC.SchwartzS. J.KimS. Y.HamL. S.ZamboangaB. L. (2011). Self-construals and social anxiety among Asian American college students: Testing emotion suppression as a mediator. Asian American Journal of Psychology, 2, 39-50. doi:10.1037/a0023183
56.
PaulhusD. L.DuncanJ. H.YikM. S. M. (2002). Patterns of shyness in East-Asian and European-heritage students. Journal of Research in Personality, 36, 442-462. doi:10.1016/S0092-6566(02)00005-3
57.
PetersL.SunderlandM.AndrewsG.RapeeR. M.MattickR. P. (2011). Development of a short form Social Interaction Anxiety (SIAS) and Social Phobia Scale (SPS) using nonparametric item response theory: The SIAS-6 and the SPS-6. Psychological Assessment, 24, 66-76. doi:10.1037/a0024544
58.
PinelesS. L.MinekaS. (2005). Attentional biases to internal and external sources of potential threat in social anxiety. Journal of Abnormal Psychology, 114, 314-318. doi:10.1037/0021-843X.114.2.314
59.
RapeeR. M.HeimbergR. G. (1997). A cognitive-behavioral model of anxiety in social phobia. Behaviour Research and Therapy, 35, 741-756. doi:10.1016/s0005-7967(97)00022-3
60.
RosseelY. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1-36.
61.
RuscioA. M.BrownT. A.ChiuW. T.SareenJ.SteinM. B.KesslerR. C. (2008). Social fears and social phobia in the USA: Results from the National Comorbidity Survey Replication. Psychological Medicine, 38, 15-28. doi:10.1017/s0033291707001699
62.
SassD. A. (2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29, 347-363. doi:10.1177/0734282911406661
63.
SpokasM.LuterekJ. A.HeimbergR. G. (2009). Social anxiety and emotional suppression: The mediating role of beliefs. Journal of Behavior Therapy and Experimental Psychiatry, 40, 283-291. doi:10.1016/j.jbtep.2008.12.004
64.
SueD. M.SueD. M.InoS. (1983). Nonassertiveness of Asian Americans: An inaccurate assumption?Journal of Counseling Psychology, 30, 581-588. doi:10.1037/0022-0167.30.4.581
65.
TajanN. (2015). Social withdrawal and psychiatry: A comprehensive review of Hikikomori. Neuropsychiatrie de l’Enfance et de l’Adolescence, 63, 324-331. doi:10.1016/j.neurenf.2015.03.008
66.
TurnerS. M.BeidelD. C. (1989). Social phobia: Clinical syndrome, diagnosis, and comorbidity. Clinical Psychology Review, 9, 3-18. doi:10.1016/0272-7358(89)90043-3.
67.
TurnerS. M.BeidelD. C.DancuC. V. (1996). Social Phobia and Anxiety Inventory: Manual. Toronto, Ontario, Canada: Multi-Health Systems.
68.
TurnerS. M.BeidelD. C.DancuC. V.StanleyM. A. (1989). An empirically derived inventory to measure social fears and anxiety: The Social Phobia and Anxiety Inventory. Psychological Assessment, 1, 35-40. doi:10.1037//1040-3590.1.1.35
69.
van BuurenS.BrandJ. P. L.Groothuis-OudshoornC. G. M.RubinD. B. (2006). Fully conditional specification in multivariate imputation. Journal of Statistical Computation and Simulation, 76, 1049-1064. doi:10.1080/10629360600810434
70.
van BuurenS.Groothuis-OudshoomK. (2011). mice: Multivariate Imputation by Chained Equations in R. Journal of Statistical Software, 45, 1-67.
71.
VandenbergR. J. (2002). Toward a further understanding of an improvement in measurement invariance methods and procedures. Organizational Research Methods, 5, 139-158. doi:10.1177/1094428102005002001
72.
VandenbergR. J.LanceC. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70. doi:10.1177/109442810031002
73.
WatsonD.FriendR. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448-457. doi:10.1037/h0027806
74.
WittchenH-U. U.BelochE. (1996). The impact of social phobia on quality of life. International Clinical Psychopharmacology, 11, 15-23. doi:10.1097/00004850-199606003-00004
75.
WoodyS. R.MiaoS.Kellman-McFarlaneK. (2015). Cultural differences in social anxiety: A meta-analysis of Asian and European heritage samples. Asian American Journal of Psychology, 6, 47-55. doi:10.1037/a0036548
76.
XuY.SchneierF.HeimbergR. G.PrincisvalleK.LiebowitzM. R.WangS.BlancoC. (2012). Gender differences in social anxiety disorder: Results from the national epidemiologic sample on alcohol and related conditions. Journal of Anxiety Disorders, 26, 12-19. doi:10.1016/j.janxdis.2011.08.006
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
