Much of the knowledge about the relationships among domains of psychopathology is built on the diagnostic categories described in the Diagnostic and Statistical Manual of Mental Disorders (DSM), and relatively little research has examined the symptom-level structure of psychopathology. The aim of this study was to delineate a detailed hierarchical model of psychopathology—from individual symptoms up to a general factor of psychopathology—allowing both higher- and lower-order dimensions to depart from the structure of the DSM. We explored the hierarchical structure of hundreds of symptoms spanning 18 DSM disorders in two large samples—one from the general population in Australia (n = 3,175) and the other a treatment-seeking clinical sample from the United States (n = 1,775). There was marked convergence between the two samples, offering new perspectives on higher-order dimensions of psychopathology. We also found several noteworthy departures from the structure of the DSM in the symptom-level data.
AchenbachT. M.EdelbrockC. S. (1978). The classification of child psychopathology: A review and analysis of empirical efforts. Psychological Bulletin, 85, 1275–1301.
2.
AfzaliM. H.SunderlandM.CarragherN.ConrodP. (2018). The structure of psychopathology in early adolescence: Study of a Canadian sample [La structure de la psychopathologie au debut de l’adolescence: Etude d’un echantillon canadine]. The Canadian Journal of Psychiatry, 63, 223–230.
BaillieA. J.RapeeR. M. (2005). Panic attacks as risk markers for mental disorders. Social Psychiatry and Psychiatric Epidemiology, 40, 240–244.
7.
BatterhamP. J.BrewerJ. L.TjhinA.SunderlandM.CarragherN.CalearA. L. (2015). Systematic item selection process applied to developing item pools for assessing multiple mental health problems. Journal of Clinical Epidemiology, 68, 913–919.
8.
BatterhamP. J.SunderlandM.CarragherN.CalearA. L. (2016). Development and community-based validation of eight item banks to assess mental health. Psychiatry Research, 243, 453–462.
BorsboomD. (2002). The structure of the DSM. Archives of General Psychiatry, 59, 569–570.
11.
CarragherN.TeessonM.SunderlandM.NewtonN. C.KruegerR. F.ConrodP. J.. . . SladeT. (2016). The structure of adolescent psychopathology: A symptom-level analysis. Psychological Medicine, 46, 981–994.
12.
CarverC. S.JohnsonS. L.TimpanoK. R. (2017). Toward a functional view of the p factor in psychopathology. Clinical Psychological Science, 5, 880–889.
13.
CaspiA.HoutsR. M.BelskyD. W.Goldman-MellorS. J.HarringtonH.IsraelS.. . . PoultonR. (2014). The p factor one general psychopathology factor in the structure of psychiatric disorders?Clinical Psychological Science, 2, 119–137.
14.
CaspiA.MoffittT. E. (2018). All for one and one for all: Mental disorders in one dimension. American Journal of Psychiatry, 175, 831–844.
15.
CattellR. B. (1943). The description of personality: Basic traits resolved into clusters. Journal of Abnormal and Social Psychology, 38, 476–506. doi:10.1037/h0054116
16.
ClarkL. A.WatsonD. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31, 1412–1427. doi:10.1037/pas0000626
17.
ConwayC. C.BrownT. A. (2018). Evaluating dimensional models of psychopathology in outpatients diagnosed with emotional disorders: A cautionary tale. Depression and Anxiety, 35, 898–902.
18.
ConwayC. C.ForbesM. K.ForbushK. T.FriedE. I.HallquistM. N.KotovR.. . . EatonN. R. (2019). A hierarchical taxonomy of psychopathology can transform mental health research. Perspectives on Psychological Science, 14, 419–436.
19.
DalrympleK.MartinezJ.TepeE.YoungD.ChelminskiI.MorganT.ZimmermanM. (2013). A clinically useful social anxiety disorder outcome scale. Comprehensive Psychiatry, 54, 758–765.
20.
de la CruzL. F.Vidal-RibasP.ZahreddineN.MathiassenB.BrøndboP. H.SimonoffE.. . . StringarisA. (2018). Should clinicians split or lump psychiatric symptoms? The structure of psychopathology in two large pediatric clinical samples from England and Norway. Child Psychiatry & Human Development, 49, 607–620.
21.
DeYoungC. G.KruegerR. F. (2018). A cybernetic theory of psychopathology. Psychological Inquiry, 29, 117–138.
22.
Dornbach-BenderA.RuggeroC. J.WaszczukM. A.GamezW.WatsonD.KotovR. (2017). Mapping internalizing psychopathology at the finest level: Convergent validity and structure based on alternative measures. Comprehensive Psychiatry, 79, 31–39.
23.
FaureK.ForbesM. K. (2021). Clarifying the placement of obsessive-compulsive disorder in the empirical structure of psychopathology. Journal of Psychopathology and Behavioral Assessment. Advance online publication. doi:10.1007/s10862-021-09868-1
24.
ForbesM. K. (2020). Extending Goldberg’s bass-ackwards method for developing hierarchical structural models. doi:10.31219/osf.io/ksxwv
25.
ForbesM. K.KotovR.RuggeroC. J.WatsonD.ZimmermanM.KruegerR. F. (2017). Delineating the joint hierarchical structure of clinical and personality disorders in an outpatient psychiatric sample. Comprehensive Psychiatry, 79, 19–30. doi:10.1016/j.comppsych.2017.04.006
26.
ForbesM. K.RapeeR. M.KruegerR. F. (2019). Opportunities for the prevention of mental disorders by reducing general psychopathology in early childhood. Behaviour Research and Therapy, 119, Article 103411. doi:10.1016/j.brat.2019.103411
27.
ForbushK. T.SouthS. C.KruegerR. F.IaconoW. G.ClarkL. A.KeelP. K.. . . WatsonD. (2010). Locating eating pathology within an empirical diagnostic taxonomy: Evidence from a community-based sample. Journal of Abnormal Psychology, 119, 282–292.
28.
FriedE. I.NesseR. M. (2015). Depression is not a consistent syndrome: An investigation of unique symptom patterns in the STAR* D study. Journal of Affective Disorders, 172, 96–102.
29.
GoldbergL. R. (2006). Doing it all bass-ackwards: The development of hierarchical factor structures from the top down. Journal of Research in Personality, 40, 347–358. doi:10.1016/j.jrp.2006.01.001
30.
GootzeitJ.MarkonK.WatsonD. (2015). Measuring dimensions of posttraumatic stress disorder: The Iowa traumatic response inventory. Assessment, 22, 152–166.
31.
GreeneA. L.EatonN. R. (2016). Panic disorder and agoraphobia: A direct comparison of their multivariate comorbidity patterns. Journal of Affective Disorders, 190, 75–83.
32.
GrisanzioK. A.Goldstein-PiekarskiA. N.WangM. Y.AhmedA. P. R.SamaraZ.WilliamsL. M. (2018). Transdiagnostic symptom clusters and associations with brain, behavior, and daily function in mood, anxiety, and trauma disorders. JAMA Psychiatry, 75, 201–209.
33.
HaltiganJ. D.AitkenM.SkillingT.HendersonJ.HawkeL.BattagliaM.. . . AndradeB. F. (2018). “P” and “DP:” Examining symptom-level bifactor models of psychopathology and dysregulation in clinically referred children and adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 57, 384–396.
34.
HopwoodC. J.BagbyR. M.GralnickT.RoE.RuggeroC.Mullins-SweattS.. . . ZimmermannJ. (2020). Integrating psychotherapy with the hierarchical taxonomy of psychopathology (HiTOP). Journal of Psychotherapy Integration, 30, 477–497. doi:10.1037/int0000156
35.
HymanS. E. (2007). Can neuroscience be integrated into the DSM-V?Nature Reviews Neuroscience, 8, 725–732.
36.
KesslerR. C.ÜstünT. B. (2004). The world mental health (WMH) survey initiative version of the world health organization (WHO) composite international diagnostic interview (CIDI). International Journal of Methods in Psychiatric Research, 13, 93–121.
37.
KotovR.FotiD.LiK.BrometE. J.HajcakG.RuggeroC. J. (2016). Validating dimensions of psychosis symptomatology: Neural correlates and 20-year outcomes. Journal of Abnormal Psychology, 125, 1103–1119.
38.
KotovR.KruegerR. F.WatsonD.AchenbachT. M.AlthoffR. R.BagbyR. M.. . . EatonN. R. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126, 454–477.
39.
KotovR.PerlmanG.GámezW.WatsonD. (2015). The structure and short-term stability of the emotional disorders: A dimensional approach. Psychological Medicine, 45, 1687–1698.
40.
KotovR.RuggeroC. J.KruegerR. F.WatsonD.YuanQ.ZimmermanM. (2011). New dimensions in the quantitative classification of mental illness. JAMA Psychiatry, 68, 1003–1011.
41.
KotovR.RuggeroC. J.KruegerR. F.WatsonD.ZimmermanM. (2018). The perils of hierarchical exclusion rules: A further word of caution. Depression and Anxiety, 35, 903–904. doi:10.1002/da.22826
42.
KozakM. J.CuthbertB. N. (2016). The NIMH research domain criteria initiative: Background, issues, and pragmatics. Psychophysiology, 53, 286–297.
43.
KruegerR. F.CaspiA.MoffittT. E.SilvaP. A. (1998). The structure and stability of common mental disorders (DSM-III-R): A longitudinal-epidemiological study. Journal of Abnormal Psychology, 107, 216–227.
44.
KruegerR. F.Chentsova-DuttonY. E.MarkonK. E.GoldbergD.OrmelJ. (2003). A cross-cultural study of the structure of comorbidity among common psychopathological syndromes in the general health care setting. Journal of Abnormal Psychology, 112, 437–447.
45.
KruegerR. F.DerringerJ.MarkonK. E.WatsonD.SkodolA. E. (2012). Initial construction of a maladaptive personality trait model and inventory for DSM-5. Psychological Medicine, 42, 1879–1890.
46.
KruegerR. F.KotovR.WatsonD.ForbesM. K.EatonN. R.RuggeroC. J.. . . ZimmermanJ. (2018). Progress in achieving quantitative classification of psychopathology. World Psychiatry, 17, 282–293.
47.
KruegerR. F.MarkonK. E. (2006). Reinterpreting comorbidity: A model-based approach to understanding and classifying psychopathology. Annual Review of Clinical Psychology, 2, 111–133.
48.
KruegerR. F.MarkonK. E.PatrickC. J.BenningS. D.KramerM. D. (2007). Linking antisocial behavior, substance use, and personality: An integrative quantitative model of the adult externalizing spectrum. Journal of Abnormal Psychology, 116, 645–666.
49.
LaceulleO. M.VolleberghW. A.OrmelJ. (2015). The structure of psychopathology in adolescence: Replication of a general psychopathology factor in the TRAILS study. Clinical Psychological Science, 3, 850–860.
50.
LaheyB. B.ApplegateB.HakesJ. K.ZaldD. H.HaririA. R.RathouzP. J. (2012). Is there a general factor of prevalent psychopathology during adulthood?Journal of Abnormal Psychology, 121, 971–977.
51.
LaheyB. B.RathouzP. J.Van HulleC.UrbanoR. C.KruegerR. F.ApplegateB.. . . WaldmanI. D. (2008). Testing structural models of DSM-IV symptoms of common forms of child and adolescent psychopathology. Journal of Abnormal Child Psychology, 36, 187–206.
52.
LoehlinJ. C.GoldbergL. R. (2014). Do personality traits conform to lists or hierarchies?Personality and Individual Differences, 70, 51–56.
53.
Lorenzo-SevaU.ten BergeJ. M. F. (2006). Tucker’s congruence coefficient as a meaningful index of factor similarity. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 2, 57–64. doi:10.1027/1614-2241.2.2.57
54.
LovibondP. F.RapeeR. M. (1993). The representation of feared outcomes. Behaviour Research and Therapy, 31, 595–608.
55.
MarkonK. E. (2010). Modeling psychopathology structure: A symptom-level analysis of Axis I and II disorders. Psychological Medicine, 40, 273–288.
56.
OlfsonM.MojtabaiR.MerikangasK. R.ComptonW. M.WangS.GrantB. F.BlancoC. (2017). Reexamining associations between mania, depression, anxiety and substance use disorders: Results from a prospective national cohort. Molecular Psychiatry, 22, 235–241.
57.
PilkonisP. A.ChoiS. W.ReiseS. P.StoverA. M.RileyW. T.CellaD., & PROMIS Cooperative Group. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger. Assessment, 18, 263–283.
58.
PilkonisP. A.YuL.DoddsN. E.JohnstonK. L.LawrenceS. M.DaleyD. C. (2016). Validation of the alcohol use item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS®). Drug and Alcohol Dependence, 161, 316–322.
59.
R Core Team. (2019). R: A language and environment for statistical computing (Version 3.6.2) [Computer software]. Vienna, Austria: R Foundation for Statistical Computing.
60.
RapeeR. M.SpenceS. H. (2004). The etiology of social phobia: Empirical evidence and an initial model. Clinical Psychology Review, 24, 737–767. doi:10.1016/j.cpr.2004.06.004
61.
RevelleW. (1979). Hierarchical cluster analysis and the internal structure of tests. Multivariate Behavioral Research, 14, 57–74.
62.
RevelleW. (2019). psych: Procedures for psychological, psychometric, and personality research (Version 1.8.12) [Computer software] Retrieved from https://CRAN.R-project.org/package=psych
63.
RuggeroC. J.KotovR.HopwoodC. J.FirstM.ClarkL. A.SkodolA. E.Mullins-SweattS. N.. . . ZimmermanJ. (2019). Integrating the Hierarchical Taxonomy of Psychopathology (HiTOP) into clinical practice. Journal of Consulting and Clinical Psychology, 87, 1069–1084.
64.
SimmsL. J.PrisciandaroJ. J.KruegerR. F.GoldbergD. P. (2012). The structure of depression, anxiety and somatic symptoms in primary care. Psychological Medicine, 42, 15–28.
65.
SmithG. T.AtkinsonE. A.DavisH. A.RileyE. N.OltmannsJ. R. (2020). The general factor of psychopathology. Annual Review of Clinical Psychology, 16, 75–98.
66.
Sonuga-BarkeE. J. (2016). Editorial: Distinguishing between the challenges posed by surface and deep forms of heterogeneity to diagnostic systems: Do we need a new approach to subtyping of child and adolescent psychiatric disorders?Journal of Child Psychology and Psychiatry, 57, 1–3.
67.
StantonK.KhooS.WatsonD.GruberJ.ZimmermanM.WeinstockL. M. (2019). Unique and transdiagnostic symptoms of hypomania/mania and unipolar depression. Clinical Psychological Science, 7, 471–487.
68.
SteelC.FowlerD.HolmesE. A. (2005). Trauma-related intrusions and psychosis: An information processing account. Behavioural and Cognitive Psychotherapy, 33, 139–152.
69.
SunderlandM.BatterhamP.CarragherN.CalearA.SladeT. (2019). Developing and validating a computerized adaptive test to measure broad and specific factors of internalizing in a community sample. Assessment, 26, 1030–1045.
70.
SunderlandM.SladeT.KruegerR. F.MarkonK. E.PatrickC. J.KramerM. D. (2017). Efficiently measuring dimensions of the externalizing spectrum model: Development of the Externalizing Spectrum Inventory – Computerized Adaptive Test. Psychological Assessment, 29, 868–880.
71.
U.S. Census Bureau. (2010). Profile of general population and housing characteristics: 2010. Retrieved from https://www.census.gov/quickfacts/RI
72.
WardJ. H.Jr. (1963). Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association, 58, 236–244.
73.
WaszczukM. A.EatonN. R.KruegerR. F.ShackmanA. J.WaldmanI. D.ZaldD. H.. . . KotovR. (2020). Redefining phenotypes to advance psychiatric genetics: Implications from hierarchical taxonomy of psychopathology. Journal of Abnormal Psychology, 129, 143–161.
74.
WaszczukM. A.KotovR.RuggeroC.GamezW.WatsonD. (2017). Hierarchical structure of emotional disorders: From individual symptoms to the spectrum. Journal of Abnormal Psychology, 126, 613–634.
75.
WatsonD. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM-V. Journal of Abnormal Psychology, 114, 522–536.
76.
WatsonD.WuK. D.CutshallC. (2004). Symptom subtypes of obsessive-compulsive disorder and their relation to dissociation. Journal of Anxiety Disorders, 18, 435–458.
77.
WidigerT. A.OltmannsJ. R. (2017). The general factor of psychopathology and personality. Clinical Psychological Science, 5, 182–183. doi:10.1177/2167702616657042
78.
WrightA. G.KruegerR. F.HobbsM. J.MarkonK. E.EatonN. R.SladeT. (2013). The structure of psychopathology: Toward an expanded quantitative empirical model. Journal of Abnormal Psychology, 122, 281–294.
79.
WrightA. G.SimmsL. J. (2015). A metastructural model of mental disorders and pathological personality traits. Psychological Medicine, 45, 2309–2319. doi:10.1017/S0033291715000252
80.
ZaldD. H.LaheyB. B. (2017). Implications of the hierarchical structure of psychopathology for psychiatric neuroimaging. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2, 310–317.
81.
ZhangR.LarsenJ. T.Kuja-HalkolaR.ThorntonL.YaoS.LarssonH.. . . BergenS. E. (2020). Familial co-aggregation of schizophrenia and eating disorders in Sweden and Denmark. Molecular Psychiatry. Advance online publication. doi:10.1038/s41380-020-0749-x
82.
ZimmermanM. (2016). A review of 20 years of research on overdiagnosis and underdiagnosis in the Rhode Island Methods to Improve Diagnostic Assessment and Services (MIDAS) Project. The Canadian Journal of Psychiatry, 61, 71–79.
83.
ZimmermanM.ChelminskiI.McGlincheyJ. B.PosternakM. A. (2008). A clinically useful depression outcome scale. Comprehensive Psychiatry, 49, 131–140.
84.
ZimmermanM.ChelminskiI.YoungD.DalrympleK. (2010). A clinically useful anxiety outcome scale. The Journal of Clinical Psychiatry, 71, 534–542.
85.
ZimmermanM.MattiaJ. I. (2001). The Psychiatric Diagnostic Screening Questionnaire: Development, reliability and validity. Comprehensive Psychiatry, 42, 175–189. doi:10.1053/comp.2001.23126
86.
ZinbargR. E.BarlowD. H. (1996). Structure of anxiety and the anxiety disorders: A hierarchical model. Journal of Abnormal Psychology, 105, 181–193.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
