The Research Domain Criteria define cognitive and emotional processes (e.g., rumination, intolerance of uncertainty, anxiety sensitivity, emotion dysregulation) as key transdiagnostic elements of psychopathology. However, there is currently a dearth of construct equivalence studies on measures of these processes. We thus aimed to validate the latent structures of five transdiagnostic constructs using established and newer measures: two-factor Rumination–Reflection Questionnaire, six-factor Perseverative Cognitions Questionnaire, two-factor Intolerance of Uncertainty Scale, three-factor Anxiety Sensitivity Index–3, two-factor Cognitive and Behavioral Processes Questionnaire (CBPQ). Measurement equivalence was examined across 292 American and 144 Singaporean undergraduates. Cross-cultural confirmatory factor analyses revealed strict invariance for all measures, with interfactor association differences on the Perseverative Cognitions Questionnaire and CBPQ. Across gender, full invariance was found on all measures except the CBPQ. Theoretical and clinical implications are discussed.
AldaoA.GeeD. G.De Los ReyesA.SeagerI. (2016). Emotion regulation as a transdiagnostic factor in the development of internalizing and externalizing psychopathology: Current and future directions. Development and Psychopathology, 28, 927-946. doi:10.1017/S0954579416000638
2.
AngR. P.KlassenR. M.ChongW. H.HuanV. S.WongI. Y. F.YeoL. S.KrawchukL. L. (2009). Cross-cultural invariance of the Academic Expectations Stress Inventory: Adolescent samples from Canada and Singapore. Journal of Adolescence, 32, 1225-1237. doi:10.1016/j.adolescence.2009.01.009
3.
AranaF. G.RiceK. G. (2020). Cross-cultural validity of the Ruminative Responses Scale in Argentina and the United States. Assessment, 27(2), 309-320. doi:10.1177/1073191117729204
4.
BeckA. T.HaighE. A. (2014). Advances in cognitive theory and therapy: The generic cognitive model. Annual Review of Clinical Psychology, 10, 1-24. doi:10.1146/annurev-clinpsy-032813-153734
5.
BentlerP. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246. doi:10.1037/0033-2909.107.2.238
6.
BoehmJ. K.LyubomirskyS.SheldonK. M. (2011). A longitudinal experimental study comparing the effectiveness of happiness-enhancing strategies in Anglo Americans and Asian Americans. Cognition and Emotion, 25, 1263-1272. doi:10.1080/02699931.2010.541227
7.
BollenK. A. (1989). Structural equations with latent variables. New York, NY: Wiley.
8.
BoswellJ. F.FarchioneT. J.Sauer-ZavalaS.MurrayH. W.FortuneM. R.BarlowD. H. (2013). Anxiety sensitivity and interoceptive exposure: A transdiagnostic construct and change strategy. Behavior Therapy, 44, 417-431. doi:10.1016/j.beth.2013.03.006
9.
BottesiG.GhisiM.NovaraC.BertocchiJ.BoidoM.De DominicisI.FreestonM. H. (2015). Intolerance of Uncertainty Scale (IUS-27 e IUS-12): Due studi preliminari. Psicoterapia Cognitiva e Comportmentale, 21, 345-365.
10.
BrowneM. W.CudeckR. (1993). Alternate ways of assessing model fit. In BollenK. A.LongJ. S. (Eds.), Testing equation models (pp. 136-162). Newbury Park, CA: Sage.
11.
BuhrK.DugasM. J. (2002). The Intolerance of Uncertainty Scale: Psychometric properties of the English version. Behaviour Research and Therapy, 40, 931-946. doi:10.1016/S0005-7967(01)00092-4
12.
ByrneB. M. (2012). Testing the equivalence of latent factor means: Analysis of mean and covariance structures. In ByrneB. M. (Ed.), Structural equation modeling with Mplus: Basic concepts, applications, and programming (pp. 227-257). New York, NY: Routledge.
13.
CaiW.DongW.PanY.WeiC.ZhangS.TianB.. . . DengG. (2018). Reliability, validation and norms of the Chinese version of Anxiety Sensitivity Index–3 in a sample of military personnel. PLoS ONE, 13, e0201778. doi:10.1371/journal.pone.0201778
14.
CarterJ. A. (2010). Worry and rumination: measurement invariance across gender (Doctoral dissertation). Retrieved from https://digitalcommons.usu.edu/etd/805/
15.
ChangE. C.TsaiW.SannaL. J. (2010). Examining the relations between rumination and adjustment: Do ethnic differences exist between Asian and European Americans?Asian American Journal of Psychology, 1, 46-56. doi:10.1037/a0018821
16.
ChenF. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, 464-504. doi:10.1080/10705510701301834
17.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9, 233-255. doi:10.1207/S15328007SEM0902_5
18.
CrutzenR.PetersG.-J. Y. (2017). Scale quality: Alpha is an inadequate estimate and factor-analytic evidence is needed first of all. Health Psychology Review, 11, 242-247. doi:10.1080/17437199.2015.1124240
19.
CurhanK. B.SimsT.MarkusH. R.KitayamaS.KarasawaM.KawakamiN.. . . RyffC. D. (2014). Just how bad negative affect is for your health depends on culture. Psychological Science, 25, 2277-2280. doi:10.1177/0956797614543802
20.
CuthbertB. N. (2015). Research Domain Criteria (RDoC): Toward future psychiatric nosologies. Dialogues in Clinical Neuroscience, 17, 89-97.
21.
De BeuckelaerA.SwinnenG. (2011). Biased latent variable mean comparisons due to measurement non-invariance: A simulation study. In DavidovE.SchmidtP.BillietJ. (Eds.), Methods and applications in cross-cultural analysis (pp. 117-148). New York, NY: Taylor & Francis.
22.
DekkersL. M. S.JansenB. R. J.SaleminkE.HuizengaH. M. (2017). Intolerance of Uncertainty Scale: Measurement invariance among adolescent boys and girls and relationships with anxiety and risk taking. Journal of Behavior Therapy and Experimental Psychiatry, 55, 57-65. doi:10.1016/j.jbtep.2016.11.009
23.
DunnT. J.BaguleyT.BrunsdenV. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105, 399-412. doi:doi:10.1111/bjop.12046
24.
EbesutaniC.McLeishA. C.LubertoC. M.YoungJ.MaackD. J. (2014). A bifactor model of anxiety sensitivity: Analysis of the Anxiety Sensitivity Index-3. Journal of Psychopathology and Behavioral Assessment, 36, 452-464. doi:10.1007/s10862-013-9400-3
25.
FernandezK. C.JazaieriH.GrossJ. J. (2016). Emotion regulation: A transdiagnostic perspective on a new RDoC domain. Cognitive Therapy and Research, 40, 426-440. doi:10.1007/s10608-016-9772-2
26.
FloraD. B.CurranP. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491. doi:10.1037/1082-989X.9.4.466
27.
FreestonM. H.RheaumeJ.LetarteH.DugasM. J.LadouceurR. (1994). Why do people worry?Personality and Individual Differences, 17, 791-802. doi:10.1016/0191-8869(94)90048-5
28.
GhisiM.BottesiG.AltoeG.RazzettiE.MelliG.SicaC. (2016). Factor structure and psychometric properties of the Anxiety Sensitivity Index-3 in an Italian community sample. Frontiers in Psychology, 7, 160. doi:10.3389/fpsyg.2016.00160
29.
GillettC. B.BilekE. L.HannaG. L.FitzgeraldK. D. (2018). Intolerance of uncertainty in youth with obsessive-compulsive disorder and generalized anxiety disorder: A transdiagnostic construct with implications for phenomenology and treatment. Clinical Psychology Review, 60, 100-108. doi:10.1016/j.cpr.2018.01.007
30.
GregorichS. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44, S78-S94. doi:10.1097/01.mlr.0000245454.12228.8f
31.
HongR. Y.CheungM. W.-L. (2015). The structure of cognitive vulnerabilities to depression and anxiety: Evidence for a common core etiologic process based on a meta-analytic review. Clinical Psychological Science, 3, 892-912. doi:10.1177/2167702614553789
32.
HongR. Y.LeeS. S. M. (2015). Further clarifying prospective and inhibitory intolerance of uncertainty: Factorial and construct validity of test scores from the Intolerance of Uncertainty Scale. Psychological Assessment, 27, 605-620. doi:10.1037/pas0000074
33.
HongR. Y.RiskindJ. H.CheungM. W. L.CalveteE.González-DíezZ.AtalayA. A.. . . KleimanE. M. (2017). The Looming Maladaptive Style Questionnaire: Measurement invariance and relations to anxiety and depression across 10 countries. Journal of Anxiety Disorders, 49, 1-11. doi:10.1016/j.janxdis.2017.03.004
34.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
35.
HueyS. J.Jr.TilleyJ. L.JonesE. O.SmithC. A. (2014). The contribution of cultural competence to evidence-based care for ethnically diverse populations. Annual Review of Clinical Psychology, 10, 305-338. doi:10.1146/annurev-clinpsy-032813-153729
36.
InselT.CuthbertB.GarveyM.HeinssenR.PineD. S.QuinnK.. . . WangP. (2010). Research Domain Criteria (RDoC): Toward a new classification framework for research on mental disorders. American Journal of Psychiatry, 167, 748-751. doi:10.1176/appi.ajp.2010.09091379
37.
JoseP.KramarK.HouY. (2014). Does brooding rumination moderate the stress to depression relationship similarly for Chinese and New Zealand adolescents?Journal of Educational and Developmental Psychology, 4, 114-127. doi:10.5539/jedp.v4n1p114
38.
KimE. S.YoonM. (2011). Testing measurement invariance: A comparison of multiple-group categorical CFA and IRT. Structural Equation Modeling: A Multidisciplinary Journal, 18, 212-228. doi:10.1080/10705511.2011.557337
39.
KlassenR. M.BongM.UsherE. L.ChongW. H.HuanV. S.WongI. Y. F.GeorgiouT. (2009). Exploring the validity of a teachers’ self-efficacy scale in five countries. Contemporary Educational Psychology, 34, 67-76. doi:10.1016/j.cedpsych.2008.08.001
40.
KlineR. B. (2016a). Estimation and local fit testing. In KlineR. B. (Ed.), Principles and practice of structural equation modeling (pp. 231-261). New York, NY: Guilford Press.
41.
KlineR. B. (2016b). Global fit testing. In KlineR. B. (Ed.), Principles and practice of structural equation modeling (pp. 262-299). New York, NY: Guilford Press.
42.
KwonH.YoonK. L.JoormannJ.KwonJ.-H. (2013). Cultural and gender differences in emotion regulation: Relation to depression. Cognition and Emotion, 27, 769-782. doi:10.1080/02699931.2013.792244
43.
LeeM.MorrisP. (2016). Lifelong learning, income inequality and social mobility in Singapore. International Journal of Lifelong Education, 35, 286-312. doi:10.1080/02601370.2016.1165747
44.
LiuW.ChenL.TuX. (2017). Chinese adaptation of Emotion Regulation Questionnaire for Children and Adolescents (ERQ-CCA): A psychometric evaluation in Chinese children. International Journal of Psychology, 52, 398-405. doi:10.1002/ijop.12233
45.
LoweP. A.AngR. P. (2012). Cross-cultural examination of test anxiety among US and Singapore students on the Test Anxiety Scale for Elementary Students (TAS-E). Educational Psychology, 32, 107-126. doi:10.1080/01443410.2011.625625
46.
LoweP. A.AngR. P. (2016). Examination of measurement invariance across culture and gender on the RCMAS-2 short form among Singapore and U.S. adolescents. Journal of Psychoeducational Assessment, 34, 192-198. doi:10.1177/0734282915599106
47.
LuoW.HoganD.ParisS. G. (2011). Predicting Singapore students’ achievement goals in their English study: Self-construal and classroom goal structure. Learning and Individual Differences, 21, 526-535. doi:10.1016/j.lindif.2011.07.002
48.
MalgadyR. G. (1996). The question of cultural bias in assessment and diagnosis of ethnic minority clients: Let’s reject the null hypothesis. Professional Psychology, Research and Practice, 27, 73-77. doi:10.1037/0735-7028.27.1.73
49.
MansellW.HarveyA.WatkinsE.ShafranR. (2009). Conceptual foundations of the transdiagnostic approach to CBT. Journal of Cognitive Psychotherapy, 23, 6-19. doi:10.1891/0889-8391.23.1.6
50.
MantarA.YemezB.AlkinT. (2010). The validity and reliability of the Turkish version of the Anxiety Sensitivity Index-3. Turk Psikiyatri Derg, 21, 225-234.
51.
MarkusH. R.KitayamaS. (2010). Cultures and selves: A cycle of mutual constitution. Perspectives on Psychological Science, 5, 420-430. doi:10.1177/1745691610375557
52.
McDonaldR. P.MarshH. W. (1990). Choosing a multivariate model: Noncentrality and goodness of fit. Psychological Bulletin, 107, 247-255. doi:10.1037/0033-2909.107.2.247
53.
McEvoyP. M.Erceg-HurnD. M. (2016). The search for universal transdiagnostic and trans-therapy change processes: Evidence for intolerance of uncertainty. Journal of Anxiety Disorders, 41, 96-107. doi:10.1016/j.janxdis.2016.02.002
54.
McLeanC. P.AndersonE. R. (2009). Brave men and timid women? A review of the gender differences in fear and anxiety. Clinical Psychology Review, 29, 496-505. doi:10.1016/j.cpr.2009.05.003
55.
MeadeA. W.BauerD. J. (2007). Power and precision in confirmatory factor analytic tests of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, 611-635. doi:10.1080/10705510701575461
56.
MeadeA. W.JohnsonE. C.BraddyP. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568-592. doi:10.1037/0021-9010.93.3.568
MuthénL.MuthénB. (2013). Mplus: Statistical analysis with latent variables: User’s guide (Version 7.11). Los Angeles, CA: Muthén & Muthén.
59.
Naragon-GaineyK. (2010). Meta-analysis of the relations of anxiety sensitivity to the depressive and anxiety disorders. Psychological Bulletin, 136, 128-150. doi:10.1037/a0018055
60.
Nolen-HoeksemaS.MorrowJ. (1991). A prospective study of depression and posttraumatic stress symptoms after a natural disaster: The 1989 Loma Prieta earthquake. Journal of Personality and Social Psychology, 61, 115-121. doi:10.1037/0022-3514.61.1.115
NortonP. J. (2005). A psychometric analysis of the Intolerance of Uncertainty Scale among four racial groups. Journal of Anxiety Disorders, 19, 699-707. doi:10.1016/j.janxdis.2004.08.002
63.
NortonP. J.PaulusD. J. (2017). Transdiagnostic models of anxiety disorder: Theoretical and empirical underpinnings. Clinical Psychology Review, 56, 122-137. doi:10.1016/j.cpr.2017.03.004
64.
NussbeckF. W.EidM.LischetzkeT. (2006). Analysing multitrait–multimethod data with structural equation models for ordinal variables applying the WLSMV estimator: What sample size is needed for valid results?British Journal of Mathematical and Statistical Psychology, 59, 195-213. doi:10.1348/000711005X67490
65.
OsmanA.GutierrezP. M.SmithK.FangQ.LozanoG.DevineA. (2010). The Anxiety Sensitivity Index–3: Analyses of dimensions, reliability estimates, and correlates in nonclinical samples. Journal of Personality Assessment, 92, 45-52. doi:10.1080/00223890903379332
66.
OwenJ.WongY. J.RodolfaE. (2009). Empirical search for psychotherapists’ gender competence in psychotherapy. Psychotherapy: Theory, Research, Practice, Training, 46, 448-458. doi:10.1037/a0017958
67.
PatelT.MansellW.VealeD. (2015). The Cognitive Behavioral Processes Questionnaire: A preliminary analysis within student, mixed clinical and community samples and the identification of a core transdiagnostic process. Cognitive Therapy and Research, 39, 193-203. doi:10.1007/s10608-014-9641-9
68.
R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
69.
ReissS.PetersonR. A.GurskyD. M.McNallyR. J. (1986). Anxiety sensitivity, anxiety frequency and the predictions of fearfulness. Behaviour Research and Therapy, 24, 1-8. doi:10.1016/0005-7967(86)90143-9
70.
RhemtullaM.Brosseau-LiardP. É.SavaleiV. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354-373. doi:10.1037/a0029315
71.
RomaV. G.HopeD. A. (2017). Are we certain about which measure of intolerance of uncertainty to use yet?Cognitive Behaviour Therapy, 46, 327-338. doi:10.1080/16506073.2016.1252792
72.
RosseelY. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1-36.
73.
SandinB.ValienteR. M.ChorotP.SantedM. A. (2007). ASI-3: A new scale for the assessment of anxiety sensitivity. Spanish Journal of Clinical Psychology, 12, 91-104.
74.
SansoneR. A.SansoneL. A. (2012). Rumination: Relationships with physical health. Innovations in Clinical Neuroscience, 9, 29-34.
75.
SassD. A.SchmittT. A.MarshH. W. (2014). Evaluating model fit with ordered categorical data within a measurement invariance framework: A comparison of estimators. Structural Equation Modeling: A Multidisciplinary Journal, 21, 167-180. doi:10.1080/10705511.2014.882658
76.
ScollonC. N.KohS.AuE. W. M. (2011). Cultural differences in the subjective experience of emotion: When and why they occur. Social and Personality Psychology Compass, 5, 853-864. doi:10.1111/j.1751-9004.2011.00391.x
77.
SextonK. A.DugasM. J. (2009). Defining distinct negative beliefs about uncertainty: Validating the factor structure of the Intolerance of Uncertainty Scale. Psychological Assessment, 21, 176-186. doi:10.1037/a0015827
78.
SiegleG. J.MooreP. M.ThaseM. E. (2004). Rumination: One construct, many features in healthy individuals, depressed individuals, and individuals with lupus. Cognitive Therapy and Research, 28, 645-668. doi:10.1023/B:COTR.0000045570.62733.9f
79.
SingelisT. M. (1994). The measurement of independent and interdependent self-construals. Personality and Social Psychology Bulletin, 20, 580-591. doi:10.1177/0146167294205014
80.
SteenkampJ. M. E. M.BaumgartnerH. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78-107. doi:10.1086/209528
81.
SteigerJ. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173-180. doi:10.1207/s15327906mbr2502_4
82.
SueS. (1999). Science, ethnicity, and bias: Where have we gone wrong?American Psychologist, 54, 1070-1077. doi:10.1037/0003-066X.54.12.1070
83.
SuyiY.MeredithP.KhanA. (2017). Effectiveness of mindfulness intervention in reducing stress and burnout for mental health professionals in Singapore. Explore, 13, 319-326. doi:10.1016/j.explore.2017.06.001
84.
SzkodnyL. E.NewmanM. G. (2019). Delineating characteristics of maladaptive repetitive thought: Development and preliminary validation of the Perseverative Cognitions Questionnaire. Assessment, 26, 1084-1104. doi: 10.1177/1073191117698753
85.
TaylorS.ZvolenskyM. J.CoxB. J.DeaconB.HeimbergR. G.LedleyD. R.. . . CardenasS. J. (2007). Robust dimensions of anxiety sensitivity: Development and initial validation of the Anxiety Sensitivity Index-3. Psychological Assessment, 19, 176-188. doi:10.1037/1040-3590.19.2.176
86.
TeasdaleJ. D.GreenH. A. C. (2004). Ruminative self-focus and autobiographical memory. Personality and Individual Differences, 36, 1933-1943. doi:10.1016/j.paid.2003.08.022
87.
TjadensP.ThoennesN. (2000). Prevalence, incidence, and consequences of violence against women: Findings from the National Violence against Women Survey. Washington, DC: U.S. Department of Justice, National Institute of Justice, U.S. Department of Health and Human Services, and Centers for Disease Control and Prevention.
88.
TolinD. F. (2016). Doing CBT: A comprehensive guide to working with behaviors, thoughts, and emotions. New York, NY: Guilford Press.
89.
TrapnellP. D.CampbellJ. D. (1999). Private self-consciousness and the five-factor model of personality: Distinguishing rumination from reflection. Journal of Personality and Social Psychology, 76, 284-304.
90.
TreynorW.GonzalezR.Nolen-HoeksemaS. (2003). Rumination reconsidered: A psychometric analysis. Cognitive Therapy and Research, 27, 247-259. doi:10.1023/A:1023910315561
91.
WangM.RussellS. S. (2005). Measurement equivalence of the Job Descriptive Index across Chinese and American workers: Results from confirmatory factor analysis and item response theory. Educational and Psychological Measurement, 65, 709-732. doi:10.1177/0013164404272494
92.
WangW. C.CunninghamE. G. (2005). Comparison of alternative estimation methods in confirmatory factor analyses of the General Health Questionnaire. Psychological Reports, 97, 3-10. doi:10.2466/pr0.97.1.3-10
93.
WheatonM. G.DeaconB. J.McGrathP. B.BermanN. C.AbramowitzJ. S. (2012). Dimensions of anxiety sensitivity in the anxiety disorders: Evaluation of the ASI-3. Journal of Anxiety Disorders, 26, 401-408. doi:10.1016/j.janxdis.2012.01.002
94.
WhismanM. A.JuddC. M.WhitefordN. T.GelhornH. L. (2013). Measurement invariance of the Beck Depression Inventory–Second edition (BDI-II) across gender, race, and ethnicity in college students. Assessment, 20, 419-428. doi:10.1177/1073191112460273
95.
WhismanM. A.MirandaR.FrescoD. M.HeimbergR. G.JeglicE. L.WeinstockL. M. (2020). Measurement invariance of the Ruminative Responses Scale across gender. Assessment, 27(3), 508-517. doi:10.1177/1073191118774131
96.
WilsnackR. W.WilsnackS. C.KristjansonA. F.Vogeltanz-HolmN. D.GmelG. (2009). Gender and alcohol consumption: Patterns from the multinational GENACIS project. Addiction, 104, 1487-1500. doi:doi:10.1111/j.1360-0443.2009.02696.x
97.
WirtzD.ChiuC.-y.DienerE.OishiS. (2009). What constitutes a good life? Cultural differences in the role of positive and negative affect in subjective well-being. Journal of Personality, 77, 1167-1196. doi:10.1111/j.1467-6494.2009.00578.x
98.
ZhangL. J.GuP. Y.HuG. (2008). A cognitive perspective on Singaporean primary school pupils’ use of reading strategies in learning to read in English. British Journal of Educational Psychology, 78, 245-271. doi:10.1348/000709907X218179
99.
ZhangW. (2002). Singapore’s modernization: Westernization and modernizing confucian manifestations. New York, NY: Nova Science.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
