Recent approaches have aimed to represent the dimensional structure of psychopathology, but relatively little research has rigorously tested subdimensions within internalizing psychopathology. Using adult samples harmonized across three sites (N = 427), this study tested preregistered models of the dimensional structure of internalizing psychopathology and their relations with current and lifetime depressive and anxiety disorders diagnostic data. Across S-1 bifactor and hierarchical models, we found converging evidence for both general and specific internalizing dimensions. Depression, generalized anxiety disorder (GAD), social anxiety disorder (SAD), and panic attacks were all associated with a general internalizing factor that we posit primarily represents motivational anhedonia. GAD was also associated with a specific anxious apprehension factor, and SAD was associated with specific anxious apprehension and low positive affect factors. We suggest that dimensional approaches capturing shared and specific internalizing symptom facets more accurately describe the structure of internalizing psychopathology and provide useful alternatives to categorical diagnoses to advance clinical science.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.).
2.
BaderM.MoshagenM. (2022). No probifactor model fit index bias, but a propensity toward selecting the best model. Journal of Psychopathology and Clinical Science, 131(6), 689–695. https://doi.org/10.1037/abn0000685
3.
BanichM. T.SmithL. L.SmolkerH. R.HankinB. L.SiltonR. L.HellerW.SnyderH. R. (2020). Common and specific dimensions of internalizing disorders are characterized by unique patterns of brain activity on a task of emotional cognitive control. International Journal of Psychophysiology, 151, 80–93.
4.
BarlowD. H. (1991). Disorders of emotion. Psychological Inquiry, 2, 58–71.
5.
BredemeierK.SpielbergJ. M.SiltonR. L.BerenbaumH.HellerW.MillerG. A. (2010). Screening for depressive disorders using the Mood and Anxiety Symptoms Questionnaire Anhedonic Depression Scale: A receiver-operating characteristic analysis. Psychological Assessment, 22, 702–710.
6.
BrownT. A.AntonyM. M.BarlowD. H. (1992). Psychometric properties of the Penn State Worry Questionnaire in a clinical anxiety disorders sample. Behaviour Research and Therapy, 30, 33–37.
7.
BrownT. A.BarlowD. H. (2005). Dimensional versus categorical classification of mental disorders in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders and beyond: Comment on the special section. Journal of Abnormal Psychology, 114(4), 551–556.
ChenF. F.HayesA.CarverC. S.LaurenceauJ.-P.ZhangZ. (2012). Modeling general and specific variance in multifaceted constructs: A comparison of the bifactor model to other approaches. Journal of Personality, 80, 219–251.
11.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255.
12.
ClarkL. A.WatsonD. (1991). Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100, 316–336.
13.
CoghillD.Sonuga-BarkeE. J. (2012). Categories versus dimensions in the classification and conceptualization of child and adolescent mental disorders: Implications of recent empirical study. Journal of Child Psychology and Psychiatry and Allied Disciplines, 53, 469–489.
14.
ConwayC. C.ForbesM. K.ForbushK. T.FriedE. I.HallquistM. N.KotovR.Mullins-SweattS. N.ShackmanA. J.SkodolA. E.SouthS. C.SunderlandM.WaszczukM. A.ZaldD. H.AfzaliM. H.BornovalovaM. A.CarragherN.DochertyA. R.JonasK. G.KruegerR. F.. . . EatonN. R. (2019). A Hierarchical Taxonomy of Psychopathology can transform mental health research. Perspectives on Psychological Science, 14(3), 419–436.
15.
ConwayC. C.ForbesM. K.SouthS. C. (2022). A Hierarchical Taxonomy of Psychopathology (HiTOP) primer for mental health researchers. Current Directions in Psychological Science, 10(2), 236–258.
16.
CrockerL. D.HellerW.SpielbergJ. M.WarrenS. L.BredemeierK.SuttonB. P.BanichM. T.MillerG. A. (2012). Neural mechanisms of attentional control differentiate trait and state negative affect. Frontiers in Psychology, 3, Article 298. https://doi.org/10.3389/fpsyg.2012.00298
17.
CuthbertB. N.MillerG. A.SanislowC.VaidyanathanU. (in press). The Research Domain Criteria Project: integrative translation for psychopathology. In BlaneyP. H.KruegerR. F. (Eds.), Oxford textbook of psychopathology (3rd ed.). Oxford University Press.
18.
den Hollander-GijsmanM. E.WardenaarK. J.de BeursE.van der WeeN. J. A.MooijaartA.van BuurenS.ZitmanF. G. (2012). Distinguishing symptom dimensions of depression and anxiety: An integrative approach. Journal of Affective Disorders, 136, 693–701.
19.
EidM. (2020). Multi-faceted constructs in abnormal psychology: Implications of the bifactor S - 1 model for individual clinical assessment. Journal of Abnormal Child Psychology, 48, 895–900.
20.
EngelsA. S.HellerW.MohantyA.HerringtonJ. D.BanichM. T.WebbA. G.MillerG. A. (2007). Specificity of regional brain activity in anxiety types during emotion processing. Psychophysiology, 44, 352–363.
21.
EngelsA. S.HellerW.SpielbergJ. M.WarrenS. L.SuttonB. P.BanichM. T.MillerG. A. (2010). Co-occurring anxiety influences patterns of brain activity in depression. Cognitive, Affective & Behavioral Neuroscience, 10, 141–156.
22.
Fassett-CarmanA. N.DiDomenicoG. E.von SteigerJ.SnyderH. R. (2020). Clarifying stress-internalizing associations: Stress frequency and appraisals of severity and controllability are differentially related to depression-specific, anxiety-specific, and transdiagnostic internalizing factors. Journal of Affective Disorders, 260, 638–645.
23.
FavaG. A.RuiniC.BelaiseC. (2007). The concept of recovery in major depression. Psychological Medicine, 37, 307–317.
24.
FirstM. B.WilliamsJ. B. W.KargR. S.SpitzerR. L. (2015). Structured clinical interview for DSM-5—research version. American Psychiatric Association.
25.
FriedE. I.GreeneA. L.EatonN. R. (2021). The p factor is the sum of its parts, for now. World Psychiatry, 20, 69–70.
26.
GreeneA. L.EatonN. R.LiK.ForbesM. K.KruegerR. F.MarkonK. E.WaldmanI. D.CiceroD. C.ConwayC. C.DochertyA. R.FriedE. I.IvanovaM. Y.JonasK. G.LatzmanR. D.PatrickC. J.ReininghausU.TackettJ. L.WrightA. G. C.KotovR. (2019). Are fit indices used to test psychopathology structure biased? A simulation study. Journal of Abnormal Psychology, 128, 740–764.
27.
GrisanzioK. A.Goldstein-PiekarskiA. N.WangM. Y.Rashed AhmedA. P.SamaraZ.WilliamsL. M. (2018). Transdiagnostic symptom clusters and associations with brain, behavior, and daily function in mood, anxiety, and trauma disorders. JAMA Psychiatry, 75, 201–209.
28.
GuhaA.SpielbergJ. M.LakeJ.PopovT.HellerW.YeeC. M.MillerG. A. (2020). Effective connectivity between Broca’s area and amygdala as a mechanism of top-down control in worry. Clinical Psychological Science, 8(1), 84–98.
29.
HankinB. L.SnyderH. R.GulleyL. D.SchweizerT. H.BijttebierP.NelisS.TohG.VaseyM. W. (2016). Understanding comorbidity among internalizing problems: Integrating latent structural models of psychopathology and risk mechanisms. Development and Psychopathology, 28, 987–1012.
30.
HellerW. (1990). The neuropsychology of emotion: Developmental patterns and implications for psychopathology. In SteinN. L.LeventhalB.TrabassoT. R. (Eds.), Psychological and biological approaches to emotion (pp. 67–211). Taylor & Francis.
31.
HellerW.NitschkeJ. B. (1998). The puzzle of regional brain activity in depression and anxiety: The importance of subtypes and comorbidity. Cognition and Emotion, 12, 421–447.
32.
HellerW.NitschkeJ. B.EtienneM. A.MillerG. A. (1997). Patterns of regional brain activity differentiate types of anxiety. Journal of Abnormal Psychology, 106, 376–385.
33.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.
34.
HurJ.HellerW.KernJ. L.BerenbaumH. (2017). A bi-factor approach to modeling the structure of worry and rumination. Journal of Experimental Psychopathology, 8, 252–264.
35.
HusainM.RoiserJ. P. (2018). Neuroscience of apathy and anhedonia: A transdiagnostic approach. Nature Reviews Neuroscience, 19, 470–484.
36.
HymanS. E. (2010). The diagnosis of mental disorders: The problem of reification. Annual Review of Clinical Psychology, 6, 155–179.
37.
InselT. R.CuthbertB. N. (2009). Endophenotypes: Bridging genomic complexity and disorder heterogeneity. Biological Psychiatry, 66, 988–989.
38.
JohnsonP. L.FedericiL. M.ShekharA. (2014). Etiology, triggers and neurochemical circuits associated with unexpected, expected, and laboratory-induced panic attacks. Neuroscience and Biobehavioral Reviews, 46, 429–454.
39.
JoinerT. E. (1996). A confirmatory factor-analytic investigation of the tripartite model of depression and anxiety in college students. Cognitive Therapy and Research, 20, 521–539.
40.
JuddL. L. (2012). Dimensional paradigm of the long-term course of unipolar major depressive disorder. Depression and Anxiety, 29, 167–171.
41.
KendlerK. S.ZacharP.CraverC. (2011). What kinds of things are psychiatric disorders?Psychological Medicine, 41, 1143–1150.
KertzS. J.LeeJ.BjörgvinssonT. (2014). Psychometric properties of abbreviated and ultra-brief versions of the Penn State Worry Questionnaire. Psychological Assessment, 26, 1146–1154.
44.
KesslerR. C.PetukhovaM.SampsonN. A.ZaslavskyA. M.WittchenH. U. (2012). Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. International Journal of Methods in Psychiatric Research, 21, 169–184.
45.
KochT.HoltmannJ.BohnJ.EidM. (2018). Explaining general and specific factors in longitudinal, multimethod, and bifactor models: Some caveats and recommendations. Psychological Methods, 23, 505–523.
46.
KotovR.KruegerR. F.WatsonD.AchenbachT. M.AlthoffR. R.BagbyR. M.BrownT. A.CarpenterW. T.CaspiA.ClarkL. A.EatonN. R.ForbesM. K.ForbushK. T.GoldbergD.HasinD.HymanS. E.IvanovaM. Y.LynamD. R.MarkonK.. . . ZimmermanM. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126, 454–477.
47.
KozakM. J.CuthbertB. N. (2016). The NIMH Research Domain Criteria initiative: Background, issues, and pragmatics. Psychophysiology, 53, 286–297.
48.
KruegerR. F. (1999). The structure of common mental disorders. Archives of General Psychiatry, 56, 921–926.
49.
KumariV.MitterschiffthalerM. T.TeasdaleJ. D.MalhiG. S.BrownR. G.GiampietroV.BrammerM. J.PoonL.SimmonsA.WilliamsS. C. R.CheckleyS. A.SharmaT. (2003). Neural abnormalities during cognitive generation of affect in treatment-resistant depression. Biological Psychiatry, 54, 777–791.
50.
LaheyB. B.KruegerR. F.RathouzP. J.WaldmanI. D.ZaldD. H. (2017). Validity and utility of the general factor of psychopathology. World Psychiatry, 16, 142–144.
51.
LinA.YungA. R.WigmanJ. T. W.KillackeyE.BaksheevG.WardenaarK. J. (2014). Validation of a short adaptation of the Mood and Anxiety Symptoms Questionnaire (MASQ) in adolescents and young adults. Psychiatry Research, 215, 778–783.
52.
LohJ. M. I.SchutteN. S.ThorsteinssonE. B. (2014). Be happy: The role of resilience between characteristic affect and symptoms of depression. Journal of Happiness Studies, 15, 1125–1138.
53.
MansolfM.ReiseS. P. (2017). When and why the second-order and bifactor models are distinguishable. Intelligence, 61, 120–129.
54.
MeyerT. J.MillerM. L.MetzgerR. L.BorkovecT. D. (1990). Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 28, 487–495.
55.
MillerG. A.RockstrohB. S.HamiltonH. K.YeeC. M. (2016). Psychophysiology as a core strategy in RDoC. Psychophysiology, 53(3), 410–414.
56.
MoffittT. E.HarringtonH.CaspiA.Kim-CohenJ.GoldbergD.GregoryA. M.PoultonR. (2007). Depression and generalized anxiety disorder: Cumulative and sequential comorbidity in a birth cohort followed prospectively to age 32 years. Archives of General Psychiatry, 64, 651–660.
57.
MuthénL. K.MuthénB. O. (2017). Mplus user’s guide (8th ed.).
58.
NewmanM. G.LleraS. J.EricksonT. M.PrzeworskiA.CastonguayL. G. (2013). Worry and generalized anxiety disorder: A review and theoretical synthesis of evidence on nature, etiology, mechanisms, and treatment. Annual Review of Clinical Psychology, 9, 275–297.
59.
NguyenD.NaffzigerE. E.BerridgeK. C. (2021). Positive affect: Nature and brain bases of liking and wanting. Current Opinion in Behavioral Sciences, 39, 72–78.
60.
NitschkeJ. B.HellerW. (2005). Distinguishing neural substrates of heterogeneity among anxiety disorders. International Review of Neurobiology, 67, 1–42.
61.
NitschkeJ. B.HellerW.ImigJ. C.McDonaldR. P.MillerG. A. (2001). Distinguishing dimensions of anxiety and depression. Cognitive Therapy and Research, 25, 1–22.
62.
NitschkeJ. B.HellerW.PalmieriP. A.MillerG. A. (1999). Contrasting patterns of brain activity in anxious apprehension and anxious arousal. Psychophysiology, 36, 628–637.
63.
OlatunjiB. O.Wolitzky-TaylorK. B.SawchukC. N.CiesielskiB. G. (2010). Worry and the anxiety disorders: A meta-analytic synthesis of specificity to GAD. Applied and Preventive Psychology, 14, 1–24.
64.
OsórioF. L.LoureiroS. R.HallakJ. E. C.Machado-de-SousaJ. P.UshirohiraJ. M.BaesC. V. W.ApolinarioT. D.DonadonM. F.BolsoniL. M.GuimarãesT.FraconV. S.Silva-RodriguesA. P. C.PizetaF. A.SouzaR. M.SanchesR. F.Dos SantosR. G.Martin-SantosR.CrippaJ. A. S. (2019). Clinical validity and interrater and test-retest reliability of the Structured Clinical Interview for DSM-5 - Clinician Version (SCID-5-CV). Psychiatry and Clinical Neurosciences, 73, 754–760.
65.
PineD. S.CohenE.CohenP.BrookJ. (1999). Adolescent depressive symptoms as predictors of adult depression: Moodiness or mood disorder?American Journal of Psychiatry, 156, 133–135.
66.
RicheyJ. A.BrewerJ. A.Sullivan-TooleH.StregeM. V.Kim-SpoonJ.WhiteS. W.OllendickT. H. (2019). Sensitivity shift theory: A developmental model of positive affect and motivational deficits in social anxiety disorder. Clinical Psychology Review, 72, Article 101756. https://doi.org/10.1016/j.cpr.2019.101756
67.
RodriguezA.ReiseS. P.HavilandM. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21, 137–150.
68.
RuscioA. M. (2019). Normal versus pathological mood: Implications for diagnosis. Annual Review of Clinical Psychology, 15, 179–205.
69.
SharpP. B.MillerG. A.HellerW. (2015). Transdiagnostic dimensions of anxiety: Neural mechanisms, executive functions, and new directions. International Journal of Psychophysiology, 98, 365–377.
70.
SiltonR. L.HellerW.EngelsA. S.TowersD. N.SpielbergJ. M.EdgarJ. C.SassS. M.StewartJ. L.SuttonB. P.BanichM. T.MillerG. A. (2011). Depression and anxious apprehension distinguish frontocingulate cortical activity during top-down attentional control. Journal of Abnormal Psychology, 120, 272–285.
71.
SimmsL. J.PrisciandaroJ. J.KruegerR. F.GoldbergD. P. (2012). The structure of depression, anxiety and somatic symptoms in primary care. Psychological Medicine, 42, 15–28.
72.
SimmsL. J.WrightA. G. C.CiceroD.KotovR.Mullins-SweattS. N.SellbomM.WatsonD.WidigerT. A.ZimmermannJ. (2022). Development of measures for the Hierarchical Taxonomy of Psychopathology (HiTOP): A collaborative scale development project. Assessment, 29(1), 3–16.
73.
StarcevicV.BerleD.MilicevicD.HannanA.LamplughC.EslickG. D. (2007). Pathological worry, anxiety disorders and the impact of co-occurrence with depressive and other anxiety disorders. Journal of Anxiety Disorders, 21, 1016–1027.
74.
TaylorM. M.SnyderH. R. (2021). Repetitive negative thinking shared across rumination and worry predicts symptoms of depression and anxiety. Journal of Psychopathology and Behavioral Assessment, 43, 904–915.
75.
TeachmanB. A.SiedleckiK. L.MageeJ. C. (2007). Aging and symptoms of anxiety and depression: Structural invariance of the tripartite model. Psychology and Aging, 22, 160–170.
76.
TreadwayM. T.ZaldD. H. (2011). Reconsidering anhedonia in depression: Lessons from translational neuroscience. Neuroscience & Biobehavioral Reviews, 35, 537–555.
77.
VandeleurC. L.FassassiS.CastelaoE.GlausJ.StrippoliM.-P. F.LasserreA. M.RudazD.GebreabS.PistisG.AubryJ.-M.AngstJ.PreisigM. (2017). Prevalence and correlates of DSM-5 major depressive and related disorders in the community. Psychiatry Research, 250, 50–58.
78.
VerstraetenK.VaseyM. W.RaesF.BijttebierP. (2009). Temperament and risk for depressive symptoms in adolescence: Mediation by rumination and moderation by effortful control. Journal of Abnormal Child Psychology, 37, 349–361.
79.
VolleberghW. A.IedemaJ.BijlR. V.de GraafR.SmitF.OrmelJ. (2001). The structure and stability of common mental disorders: The NEMESIS study. Archives of General Psychiatry, 58, 597–603.
80.
WardenaarK. J.GiltayE. J.van VeenT.ZitmanF. G.PenninxB. W. J. H. (2012). Symptom dimensions as predictors of the two-year course of depressive and anxiety disorders. Journal of Affective Disorders, 136, 1198–1203.
81.
WarrenS. L.CrockerL. D.SpielbergJ. M.EngelsA. S.BanichM. T.SuttonB. P.MillerG. A.HellerW. (2013). Cortical organization of inhibition-related functions and modulation by psychopathology. Frontiers in Human Neuroscience, 7, Article 271. https://doi.org/10.3389/fnhum.2013.00271
82.
WatsonD. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM-V. Journal of Abnormal Psychology, 114(4), 522–536.
83.
WatsonD.ClarkL. A.CareyG. (1988). Positive and negative affectivity and their relation to anxiety and depressive disorders. Journal of Abnormal Psychology, 97, 346–353.
84.
WatsonD.ForbesM. K.Levin-AspensonH. F.RuggeroC. J.KotelnikovaY.KhooS.BagbyR. M.SunderlandM.PatalayP.KotovR. (2022). The development of preliminary HiTOP internalizing spectrum scales. Assessment, 29(1), 17–33.
85.
WatsonD.Naragon-GaineyK. (2010). On the specificity of positive emotional dysfunction in psychopathology: Evidence from the mood and anxiety disorders and schizophrenia/schizotypy. Clinical Psychology Review, 30, 839–848.
86.
WatsonD.WeberK.AssenheimerJ. S.ClarkL. A.StraussM. E.McCormickR. A. (1995). Testing a tripartite model: I. Evaluating the convergent and discriminant validity of anxiety and depression symptom scales. Journal of Abnormal Psychology, 104, 3–14.
87.
WattsA. L.LaneS. P.BonifayW.SteinleyD.MeyerF. A. (2020). Building theories on top of, and not independent of, statistical models: The case of the p-factor. Psychological Inquiry, 31, 310–320.
88.
WattsA. L.PooreH. E.WaldmanI. D. (2019). Riskier tests of the validity of the bifactor model of psychopathology. Clinical Psychological Science, 7, 1285–1303.
89.
WidigerT. A.SamuelD. B. (2005). Diagnostic categories or dimensions? A question for the Diagnostic and Statistical Manual of Mental Disorders—fifth edition. Journal of Abnormal Psychology, 114(4), 494–504.
90.
WilcoxH. C.AnthonyJ. C. (2004). Child and adolescent clinical features as forerunners of adult-onset major depressive disorder: Retrospective evidence from an epidemiological sample. Journal of Affective Disorders, 82, 9–20.
91.
WilliamsonR. J.NealeB. M.SterneA.PrinceM.ShamP. (2005). The value of four mental health self-report scales in predicting interview-based mood and anxiety disorder diagnoses in sibling pairs. Twin Research and Human Genetics, 8, 101–107.
92.
YeeC. M.JavittD. C.MillerG. A. (2015). Replacing DSM categorical analyses with dimensional analyses in psychiatry research. JAMA Psychiatry, 72, 1159–1160.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
