Person-centered analyses of mental disorder comorbidity typically identify a single optimal latent group structure. We took an alternate approach, modeling every estimable comorbidity class model in a nationally representative sample (N = 34,653) and integrating them into a single overarching hierarchy, providing a full multilevel accounting of various person-centered comorbidity structures. We then investigated the structural stability of this hierarchy across two waves of data collection, and the stability of, and transition between, comorbidity classes over time using latent transition analysis. Findings suggested that comorbidity classes were structured into an interpretable hierarchy. Evidence for robust structural stability of the hierarchy over time was found, regardless of assessment time points and diagnostic time frames used. Latent transition analysis provided evidence for both continuity and change of comorbidity group membership. We discuss how person- and variable-centered models provide complementary perspectives toward empirically supported classification.
AborayaA. (2007). The reliability of psychiatric diagnoses: POINT—Our psychiatric diagnoses are still unreliable. Psychiatry (Edgmont), 4, 22–25.
2.
AborayaA.RankinE.FranceC.El-MissiryA.JohnC. (2006). The reliability of psychiatric diagnosis revisited. Psychiatry, 3, 41–50.
3.
AkaikeH. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716–723.
4.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
5.
AndrewsG. (2001). Should depression be managed as a chronic disease?BMJ, 322, 419.
6.
BarlowD. H.FarchioneT. J.FairholmeC. P.EllardK. K.BoisseauC. L.AllenL. B.MayJ. T. E. (2010). Unified protocol for transdiagnostic treatment of emotional disorders: Therapist guide. Oxford, England: Oxford University Press.
7.
BastenM. M.AlthoffR. R.TiemeierH.JaddoeV. W.HofmanA.HudziakJ. J.. . . van der EndeJ. (2013). The dysregulation profile in young children: Empirically defined classes in the Generation R study. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 841–850.
8.
BeckerS. J.NargisoJ. E.WolffJ. C.UhlK. M.SimonV. A.SpiritoA.PrinsteinM. J. (2012). Temporal relationship between substance use and delinquent behavior among young psychiatrically hospitalized adolescents. Journal of Substance Abuse Treatment, 43, 251–259.
9.
BlancoC.KruegerR. F.HasinD. S.LiuS.-M.WangS.KerridgeB. T.. . . OlfsonM. (2013). Mapping common psychiatric disorders: Structure and predictive validity in the National Epidemiologic Survey on Alcohol and Related Conditions. JAMA Psychiatry, 70, 199–207.
10.
BonadioF. T.DynesM.LackeyJ.TompsettC.AmrheinK. (2016). Grouping youth with similar symptoms: A person-centered approach to transdiagnostic subgroups. Journal of Clinical Psychology, 72, 676–688.
11.
BrownT. A.Di NardoP. A.LehmanC. L.CampbellL. A. (2001). Reliability of DSM–IV anxiety and mood disorders: Implications for the classification of emotional disorders. Journal of Abnormal Psychology, 110, 49–58.
12.
CarragherN.KruegerR. F.EatonN. R.MarkonK. E.KeyesK. M.BlancoC.. . . HasinD. S. (2014). ADHD and the externalizing spectrum: Direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample. Social Psychiatry and Psychiatric Epidemiology, 49, 1307–1317.
13.
CaspiA.HoutsR. M.BelskyD. W.Goldman-MellorS. J.HarringtonH.IsraelS.. . . PoultonR. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders?Clinical Psychological Science, 2, 119–137.
14.
CeleuxG.SoromenhoG. (1996). An entropy criterion for assessing the number of clusters in a mixture model. Journal of Classification, 13, 195–212.
15.
ClarkL. A. (2005). Stability and change in personality pathology: Revelations of three longitudinal studies. Journal of Personality Disorders, 19, 524–532.
16.
CollinsL. M.WugalterS. E. (1992). Latent class models for stage-sequential dynamic latent variables. Multivariate Behavioral Research, 27, 131–157.
17.
CosgroveV. E.RheeS. H.GelhornH. L.BoeldtD.CorleyR. C.EhringerM. A.. . . HewittJ. K. (2011). Structure and etiology of co-occurring internalizing and externalizing disorders in adolescents. Journal of Abnormal Child Psychology, 39, 109–123. doi:10.1007/s10802–010–9444–8.
18.
EatonN. R. (2014). Transdiagnostic psychopathology factors and sexual minority mental health: Evidence of disparities and associations with minority stressors. Psychology of Sexual Orientation and Gender Diversity, 1, 244–254.
19.
EatonN. R.KeyesK. M.KruegerR. F.BalsisS.SkodolA. E.MarkonK. E.. . . HasinD. S. (2012). An invariant dimensional liability model of gender differences in mental disorder prevalence: Evidence from a national sample. Journal of Abnormal Psychology, 121, 282–288.
20.
EatonN. R.KruegerR. F.KeyesK. M.SkodolA. E.MarkonK. E.GrantB. F.HasinD. S. (2011). Borderline personality disorder co-morbidity: Relationship to the internalizing-externalizing structure of common mental disorders. Psychological Medicine, 41, 1041–1050.
21.
EatonN. R.KruegerR. F.MarkonK. E.KeyesK. M.SkodolA. E.WallM.. . . GrantB. F. (2013). The structure and predictive validity of the internalizing disorders. Journal of Abnormal Psychology, 122, 86–92.
22.
EatonN. R.Rodriguez-SeijasC.CarragherN.KruegerR. F. (2015). Transdiagnostic factors of psychopathology and substance use disorders: A review. Social Psychiatry and Psychiatric Epidemiology, 50, 171–182.
23.
EatonN. R.SouthS. C.KruegerR. F. (2010). The meaning of comorbidity among common mental disorders. In MillonT.KruegerR. F.SimonsenE. (Eds.), Contemporary directions in psychopathology: Scientific foundations of the DSM–V and ICD–11 (pp. 223–241). New York, NY: Guilford.
24.
El-GabalawyR.TsaiJ.Harpaz-RotemI.HoffR.SareenJ.PietrzakR. H. (2013). Predominant typologies of psychopathology in the United States: A latent class analysis. Journal of Psychiatric Research, 47, 1649–1657.
25.
ForsmanM.LichtensteinP.AndershedH.LarssonH. (2008). Genetic effects explain the stability of psychopathic personality from mid- to late adolescence. Journal of Abnormal Psychology, 117, 606–617.
26.
GoldbergL. R. (2006). Doing it all bass-ackwards: The development of hierarchical factor structures from the top down. Journal of Research in Personality, 40, 347–358.
27.
GrantB. F.DawsonD. A.StinsonF. S.ChouP. S.KayW.PickeringR. (2003). The Alcohol Use Disorder and Associated Disabilities Interview Schedule-IV (AUDADIS-IV): Reliability of alcohol consumption, tobacco use, family history of depression and psychiatric diagnostic modules in a general population sample. Drug and Alcohol Dependence, 71(1), 7–16.
28.
GrantB. F.HarfordT. C.DawsonD. A.ChouP. S.PickeringR. P. (1995). The Alcohol Use Disorder and Associated Disabilities Interview Schedule (AUDADIS): Reliability of alcohol and drug modules in a general population sample. Drug and alcohol dependence, 39(1), 37–44.
29.
GrantB. F.HasinD. S.StinsonF. S.DawsonD. A.ChouS. P.RuanW. J.HuangB. (2005). Co-occurrence of 12-month mood and anxiety disorders and personality disorders in the US: Results from the National Epidemiologic Survey on Alcohol and Related Conditions. Journal of Psychiatric Research, 39, 1–9.
30.
GrantB. F.StinsonF. S.DawsonD. A.ChouS. P.RuanW. J. (2005). Co-occurrence of DSM–IV personality disorders in the United States: Results from the National Epidemiologic Survey on Alcohol and Related Conditions. Comprehensive Psychiatry, 46, 1–5.
31.
GrantB. F.StinsonF. S.DawsonD. A.ChouS. P.RuanW. J.PickeringR. P. (2004). Co-occurrence of 12-month alcohol and drug use disorders and personality disorders in the United States: Results from the National Epidemiologic Survey on Alcohol and Related Conditions. Archives of General Psychiatry, 61, 361–368.
32.
Guarino-GhezziS.LoughranE. J. (2005). Balancing juvenile justice. New Brunswick, NJ: Transaction.
33.
HasinD. S.GoodwinR. D.StinsonF. S.GrantB. F. (2005). Epidemiology of major depressive disorder: Results from the National Epidemiologic Survey on Alcoholism and Related Conditions. Archives of General Psychiatry, 62, 1097–1106.
34.
HasinD.KilcoyneB. (2012). Comorbidity of psychiatric and substance use disorders in the United States: Current issues and findings from the NESARC. Current Opinion in Psychiatry, 25, 165–171.
35.
HawkeJ. M.KaminerY.BurkeR.BurlesonJ. A. (2008). Stability of comorbid psychiatric diagnosis among youths in treatment and aftercare for alcohol use disorders. Substance Abuse, 29, 33–41.
36.
HirschfeldR. M. (2001). The comorbidity of major depression and anxiety disorders: Recognition and management in primary care. Primary Care Companion to the Journal of Clinical Psychiatry, 3, 244–254.
37.
KamphausR. W.HubertyC. J.DiStefanoC.PetoskeyM. D. (1997). A typology of teacher-rated child behavior for a national US sample. Journal of Abnormal Child Psychology, 25, 453–463.
38.
KamphausR. W.PetoskeyM. D.CodyA. H.RoweE. W.HubertyC. J.ReynoldsC. R. (1999). A typology of parent rated child behavior for a national US sample. Journal of Child Psychology and Psychiatry, 40, 607–616.
39.
KesslerR. C.BerglundP.DemlerO.JinR.MerikangasK. R.WaltersE. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM–IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 593–602.
40.
KesslerR. C.ChiuW. T.DemlerO.WaltersE. E. (2005). Prevalence, severity, and comorbidity of 12-month DSM–IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 617–627.
41.
KeyesK. M.EatonN. R.KruegerR. F.McLaughlinK. A.WallM. M.GrantB. F.HasinD. S. (2012). Childhood maltreatment and the structure of common psychiatric disorders. British Journal of Psychiatry, 200, 107–115.
42.
KeyesK.EatonN.KruegerR.SkodolA.WallM.GrantB.. . . HasinD. (2013). Thought disorder in the meta-structure of psychopathology. Psychological Medicine, 43, 1673–1683.
43.
KimH.EatonN. R. (2015). The hierarchical structure of common mental disorders: Connecting multiple levels of comorbidity, bifactor models, and predictive validity. Journal of Abnormal Psychology, 124, 1064–1078.
44.
KotovR.KruegerR. F.WatsonD.AchenbachT. M.AlthoffR. R.BagbyM.. . . ZimmermanM. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology. Advance online publication. doi:10.1037/abn0000258
45.
KruegerR. F. (1999). The structure of common mental disorders. Archives of General Psychiatry, 56, 921–926.
46.
KruegerR. F. (2005). Continuity of Axes I and II: Toward a unified model of personality, personality disorders, and clinical disorders. Journal of Personality Disorders, 19, 233–261.
47.
KruegerR. F.CaspiA.MoffittT.SilvaP. (1998). The structure and stability of common mental disorders (DSM–III-R): A longitudinal-epidemiological study. Journal of Abnormal Psychology, 107, 216–227.
48.
KruegerR. F.EatonN. R. (2015). Transdiagnostic factors of mental disorders. World Psychiatry, 14, 27–29.
49.
KruegerR. F.MarkonK. E. (2006a). Reinterpreting comorbidity: A model-based approach to understanding and classifying psychopathology. Annual Review of Clinical Psychology, 2, 111–133.
50.
KruegerR. F.MarkonK. E. (2006b). Understanding psychopathology melding behavior genetics, personality, and quantitative psychology to develop an empirically based model. Current Directions in Psychological Science, 15, 113–117.
51.
KushnerS. C.TackettJ. L.BagbyR. M. (2012). The structure of internalizing disorders in middle childhood and evidence for personality correlates. Journal of Psychopathology and Behavioral Assessment, 34, 22–34.
52.
LaheyB. B.ZaldD. H.HakesJ. K.KruegerR. F.RathouzP. J. (2014). Patterns of heterotypic continuity associated with the cross-sectional correlational structure of prevalent mental disorders in adults. JAMA Psychiatry, 71, 989–996.
53.
LatackJ. A.Rodriguez-SeijasC.StohlM.BlancoC.HasinD. S.EatonN. R. (2015). Transdiagnostic psychopathology mediates the relationship between childhood sexual abuse and HIV/AIDS and other sexually transmitted infections in adulthood. Comprehensive Psychiatry, 62, 71–79.
54.
LavigneJ. V.ArendR.RosenbaumD.BinnsH. J.ChristoffelK. K.GibbonsR. D. (1998). Psychiatric disorders with onset in the preschool years: I. Stability of diagnoses. Journal of the American Academy of Child and Adolescent Psychiatry, 37, 1246–1254.
55.
LinksP. S.EynanR. (2013). The relationship between personality disorders and axis I psychopathology: Deconstructing comorbidity. Annual Review of Clinical Psychology, 9, 529–554.
56.
LinksP. S.HeslegraveR. J.MittonJ. E.van ReekumR.PatrickJ. (1995). Borderline psychopathology and recurrences of clinical disorders. Journal of Nervous and Mental Disease, 183, 582–586.
57.
LiuJ. (2004). Childhood externalizing behavior: Theory and implications. Journal of Child and Adolescent Psychiatric Nursing, 17, 93–103.
58.
LoY.MendellN. R.RubinD. B. (2001). Testing the number of components in a normal mixture. Biometrika, 88, 767–778.
59.
LoeberR.FarringtonD. P. (Eds.). (1998). Serious and violent juvenile offenders: Risk factors and successful interventions. Thousand Oaks, CA: Sage.
60.
LöselF.BenderD. (2003). Resilience and protective factors. In FarringtonD.CoidJ. (Eds.), Early prevention of adult antisocial behaviour (pp. 130–204). New York, NY: Cambridge University Press.
61.
LynamD. R.CharnigoR.MoffittT. E.RaineA.LoeberR.Stouthamer-LoeberM. (2009). The stability of psychopathy across adolescence. Development and Psychopathology, 21, 1133–1153.
62.
MagidsonJ. F.BlashillA. J.WallM. M.BalanI. C.WangS.LejuezC.BlancoC. (2014). Relationship between psychiatric disorders and sexually transmitted diseases in a nationally representative sample. Journal of Psychosomatic Research, 76, 322–328.
63.
MartelM. M.Goth-OwensT.Martinez-TorteyaC.NiggJ. T. (2010). A person-centered personality approach to heterogeneity in attention-deficit/hyperactivity disorder (ADHD). Journal of Abnormal Psychology, 119, 186–196.
64.
McCutcheonA. L. (1987). Latent class analysis (No. 64). Thousand Oaks, CA: Sage.
65.
McGlashanT. H.GriloC. M.SkodolA. E.GundersonJ. G.SheaM. T.MoreyL. C.. . . StoutR. L. (2000). The Collaborative Longitudinal Personality Disorders Study: Baseline Axis I/II and II/II diagnostic co-occurrence. Acta Psychiatrica Scandinavica, 102, 256–264.
66.
MoffittT. E. (1993). Adolescence-limited and life-course-persistent antisocial behavior: A developmental taxonomy. Psychological Review, 100, 674–701.
67.
MuthénL. K.MuthénB. O. (1998–2015). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
68.
NylundK. L.AsparouhovT.MuthénB. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14, 535–569.
69.
NylundK. L.MuthénB.NishinaA.BellmoreA.GrahamS. (2006). Stability and instability of peer victimization during middle school: Using latent transition analysis with covariates, distal outcomes, and modeling extensions. Unpublished manuscript.
70.
OfratS.KruegerR. F.EatonN. R.KeyesK. M.SkodolA. E.GrantB. F.HasinD. S. (2014). Nonmedical prescription drug use comorbidity: Developing a cohesive risk model. Journal of Psychopathology and Behavioral Assessment, 36, 371–379.
71.
OldhamJ. M.SkodolA. E.KellmanH. D.HylerS. E.DoidgeN.RosnickL.GallaherP. E. (1995). Comorbidity of axis I and axis II disorders. American Journal of Psychiatry, 152, 571–578.
72.
OlfsonM.FiremanB.WeissmanM. M.LeonA. C.SheehanD. V.KatholR. G.. . . FarberL. (1997). Mental disorders and disability among patients in a primary care group practice. American Journal of Psychiatry, 154, 1734–1740.
73.
OlinoT. M.KleinD. N.FarmerR. F.SeeleyJ. R.LewinsohnP. M. (2012). Examination of the structure of psychopathology using latent class analysis. Comprehensive Psychiatry, 53, 323–332.
74.
PalmerR.YoungS.CorleyR.HopferC.StallingsM.HewittJ. (2013). Stability and change of genetic and environmental effects on the common liability to alcohol, tobacco, and cannabis DSM–IV dependence symptoms. Behavior Genetics, 43, 374–385.
75.
PearcyM. T.CloptonJ. R.PopeA. W. (1993). Influences on teacher referral of children to mental health services gender, severity, and internalizing versus externalizing problems. Journal of Emotional and Behavioral Disorders, 1, 165–169.
76.
PiantaR. C.CastaldiJ. (1989). Stability of internalizing symptoms from kindergarten to first grade and factors related to instability. Development and Psychopathology, 1, 305–316.
77.
RobinsL. N.PriceR. K. (1991). Adult disorders predicted by childhood conduct problems: Results from the NIMH Epidemiologic Catchment Area project. Psychiatry, 54, 116–132.
78.
RoselliniA. J.CoffeyS. F.TracyM.GaleaS. (2014). A person-centered analysis of posttraumatic stress disorder symptoms following a natural disaster: Predictors of latent class membership. Journal of Anxiety Disorders, 28, 16–24.
79.
Roy-ByrneP. P.StangP.WittchenH.-U.UstunB.WaltersE.KesslerR. C. (2000). Lifetime panic-depression comorbidity in the National Comorbidity Survey. British Journal of Psychiatry, 176, 229–235.
80.
SchwarzG. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461–464.
81.
ShawD. S.WinslowE. B. (1997). Precursors and correlates of antisocial behavior from infancy to preschool. In StoffD. M.BreilingJ.MaserJ. D.StoffD. M.BreilingJ.MaserJ. D. (Eds.), Handbook of antisocial behavior (pp. 148–158). Hoboken, NJ: Wiley.
82.
SheaM. T.StoutR. L.YenS.PaganoM. E.SkodolA. E.MoreyL. C.. . . SanislowC. A. (2004). Associations in the course of personality disorders and Axis I disorders over time. Journal of Abnormal Psychology, 113, 499.
83.
SladeT.WatsonD. (2006). The structure of common DSM–IV and ICD–10 mental disorders in the Australian general population. Psychological Medicine, 36, 1593–1600.
84.
SoggieN. (2008). Professional handbook for mood and anxiety disorders. Lanham, MD: University Press of America.
85.
SpinhovenP.de RooijM.HeiserW.SmitJ. H.PenninxB. W. (2012). Personality and changes in comorbidity patterns among anxiety and depressive disorders. Journal of Abnormal Psychology, 121, 874–884.
86.
StemmlerM.LöselF. (2012). The stability of externalizing behavior in boys from preschool age to adolescence: A person-oriented analysis. Psychological Test and Assessment Modeling, 54, 195–207.
87.
SullivanP. F.KesslerR. C.KendlerK. S. (1998). Latent class analysis of lifetime depressive symptoms in the national comorbidity survey. American Journal of Psychiatry, 155, 1398–1406.
88.
ThompsonK. D.LeadbeaterB. J.AmesM. E. (2015). Reciprocal effects of internalizing and oppositional defiance symptoms on heavy drinking and alcohol-related harms in young adulthood. Substance Abuse: Research and Treatment, 9(Suppl. 1), 21–31.
89.
TolanP. H.HenryD. (1996). Patterns of psychopathology among urban poor children: Comorbidity and aggression effects. Journal of Consulting and Clinical Psychology, 64, 1094–1099.
90.
VaidyanathanU.PatrickC. J.IaconoW. G. (2011). Patterns of comorbidity among mental disorders: A person-centered approach. Comprehensive Psychiatry, 52, 527–535.
91.
VaidyanathanU.PatrickC. J.IaconoW. G. (2012). Examining the overlap between bipolar disorder, nonaffective psychosis, and common mental disorders using latent class analysis. Psychopathology, 45, 361–365.
92.
VolleberghW. A.IedemaJ.BijlR. V.de GraafR.SmitF.OrmelJ. (2001). The structure and stability of common mental disorders: The NEMESIS study. Archives of General Psychiatry, 58, 597–603.
93.
VriezeS. I.PerlmanG.KruegerR. F.IaconoW. G. (2012). Is the continuity of externalizing psychopathology the same in adolescents and middle-aged adults? A test of the externalizing spectrum’s developmental coherence. Journal of Abnormal Child Psychology, 40, 459–470.
94.
VuongQ. H. (1989). Likelihood ratio tests for model selection and non-nested hypotheses. Econometrica: Journal of the Econometric Society, 57, 307–333.
95.
WaltonK. E.OrmelJ.KruegerR. F. (2011). The dimensional nature of externalizing behaviors in adolescence: Evidence from a direct comparison of categorical, dimensional, and hybrid models. Journal of Abnormal Child Psychology, 39, 553–561.
96.
WatsonD. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM–V. Journal of Abnormal Psychology, 114, 522–536.
97.
WeichS.McBrideO.HusseyD.ExeterD.BrughaT.McManusS. (2011). Latent class analysis of co-morbidity in the Adult Psychiatric Morbidity Survey in England 2007: Implications for DSM–5 and ICD–11. Psychological Medicine, 41, 2201–2212.
98.
WittchenH.-U. (1988). Natural course and spontaneous remissions of untreated anxiety disorders: Results of the Munich Follow-up Study (MFS). Panic and Phobias, 2, 3–17.
99.
WittchenH.-U.LiebR.PfisterH.SchusterP. (2000). The waxing and waning of mental disorders: Evaluating the stability of syndromes of mental disorders in the population. Comprehensive Psychiatry, 41, 122–132.
100.
World Health Organization. (2004). International statistical classification of diseases and health related problems. Geneva, Switzerland: Author.
101.
WrightA. G.KruegerR. F.HobbsM. J.MarkonK. E.EatonN. R.SladeT. (2013). The structure of psychopathology: Toward an expanded quantitative empirical model. Journal of Abnormal Psychology, 122, 281–294.
102.
ZanariniM. C.FrankenburgF. R.HennenJ.ReichD. B.SilkK. R. (2004). Axis I comorbidity in patients with borderline personality disorder: 6–year follow-up and prediction of time to remission. American Journal of Psychiatry, 161, 2108–2114.
103.
ZhangX.TomblinJ. B. (2003). Explaining and controlling regression to the mean in longitudinal research designs. Journal of Speech, Language, and Hearing Research, 46, 1340–1351.
104.
ZimmermanM.RothschildL.ChelminskiI. (2005). The prevalence of DSM–IV personality disorders in psychiatric outpatients. American Journal of Psychiatry, 162, 1911–1918.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
