Bifactor analyses have become a popular way to model a general psychopathology factor (or p factor) that accounts for correlations among higher order internalizing, externalizing, and thought-disorder dimensions. However, to advance dimensional nosology and construct validation of the p factor, this body of research needs to be synthesized. This study focuses on the p factor as a substantive construct by testing its consistency across samples and models. Bifactor analyses were run for three large epidemiological and clinical data sets: National Comorbidity Survey, Collaborative Psychiatric Epidemiology Surveys, and Methods to Improve Diagnostic Assessment and Services. Despite generally good model fit and strong factor congruence, interpretation of the p factor varied across samples and methods. This limited consistency suggests a lack of clear, generalizable operationalization of the p factor for applications such as measure development. Results are interpreted in terms of implications for the p factor as a substantive construct.
AchenbachT. M.IvanovaM. Y.RescorlaL. A. (2017). Empirically based assessment and taxonomy of psychopathology for ages 1½-90+ years: Developmental, multi-informant, and multicultural findings. Comprehensive Psychiatry, 79(November), 4-18. https://doi.org/10.1016/j.comppsych.2017.03.006
2.
American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed.). Author.
3.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed.). Author.
4.
ArmourC.TsaiJ.DurhamT. A.CharakR.BiehnT. L.ElhaiJ. D.PietrzakR. H. (2015). Dimensional structure of DSM-5 posttraumatic stress symptoms: Support for a hybrid Anhedonia and Externalizing Behaviors model. Journal of Psychiatric Research, 61(February), 106-113. https://doi.org/10.1016/j.jpsychires.2014.10.012
BeauchaineT. P.ZisnerA. (2017). Motivation, emotion regulation, and the latent structure of psychopathology: An integrative and convergent historical perspective. International Journal of Psychophysiology, 119(September), 108-118. https://doi.org/10.1016/j.ijpsycho.2016.12.014
7.
BerenbaumH. (2013). Classification and psychopathology research. Journal of Abnormal Psychology, 122(3), 894-901. https://doi.org/10.1037/a0033096
8.
BöhnkeJ. R.CroudaceT. J. (2015). Factors of psychological distress: Clinical value, measurement substance, and methodological artifacts. Social Psychiatry and Psychiatric Epidemiology, 50(4), 515-524. https://doi.org/10.1007/s00127-015-1022-5
9.
BonifayW.LaneS. P.ReiseS. P. (2017). Three concerns with applying a bifactor model as a structure of psychopathology. Clinical Psychological Science, 5(1), 184-186. https://doi.org/10.1177/2167702616657069
10.
CarragherN.KruegerR. F.EatonN. R.SladeT. (2015). Disorders without borders: Current and future directions in the meta-structure of mental disorders. Social Psychiatry and Psychiatric Epidemiology, 50(3), 339-350. https://doi.org/10.1007/s00127-014-1004-z
11.
CarragherN.TeessonM.SunderlandM.NewtonN. C.KruegerR. F.ConrodP. J.BarrettE. L.ChampionK. E.NairN. K.SladeT. (2016). The structure of adolescent psychopathology: A symptom-level analysis. Psychological Medicine, 46(5), 981-994. https://doi.org/10.1017/S0033291715002470
12.
CarverC. S.JohnsonS. L.TimpanoK. R. (2017). Toward a functional view of the p factor in psychopathology. Clinical Psychological Science, 5(5), 880-889. https://doi.org/10.1177/2167702617710037
13.
CaspiA.HoutsR. M.BelskyD. W.Goldman-MellorS. J.HarringtonH.IsraelS.MeierM. H.RamrakhaS.ShalevI.PoultonR.MoffittT. E. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders?Clinical Psychological Science, 2(2), 119-137. https://doi.org/10.1177/2167702613497473
14.
CaspiA.MoffittT. E. (2018). All for one and one for all: Mental disorders in one dimension. American Journal of Psychiatry, 175(9), 831-844. https://doi.org/10.1176/appi.ajp.2018.17121383
15.
Castellanos-RyanN.BrièreF. N.O’Leary-BarrettM.BanaschewskiT.BokdeA.BrombergU.BüchelC.FlorH.FrouinV.GallinatJ.GaravanH.MartinotJ.-L.NeesF.PausT.PausovaZ.RietschelM.SmolkaM. N.RobbinsT. W.WhelanR.… IMAGEN ConsortiumT. I. (2016). The structure of psychopathology in adolescence and its common personality and cognitive correlates. Journal of Abnormal Psychology, 125(8), 1039-1052. https://doi.org/10.1037/abn0000193
16.
ChenF. F.HayesA.CarverC. S.LaurenceauJ. P.ZhangZ. (2012). Modeling general and specific variance in multifaceted constructs: A comparison of the bifactor model to other approaches. Journal of Personality, 80(1), 219-251. https://doi.org/10.1111/j.1467-6494.2011.00739.x
17.
ClarkL. A.CuthbertB.Lewis-FernándezR.NarrowW. E.ReedG. M. (2017). Three approaches to understanding and classifying mental disorder: ICD-11, DSM-5, and the National Institute of Mental Health’s Research Domain Criteria (RDoC). Psychological Science in the Public Interest, 18(2), 72-145. https://doi.org/10.1177/1529100617727266
18.
ConwayC. C.ForbesM. K.ForbushK. T.FriedE. I.HallquistM. N.KotovR.Mullins-SweattS. N.ShackmanA. J.SkodolA. E.SouthS. C.SunderlandM.WaszczukM. A.ZaldD. H.AfzaliM. H.BornovalovaM. A.CarragherN.DochertyA. R.JonasK. G.KruegerR. F.… EatonN. R. (2019). A hierarchical taxonomy of psychopathology can transform mental health research. Perspectives on Psychological Science, 14(3), 419-436. https://doi.org/10.1177/1745691618810696
19.
ConwayC. C.StarrL. R.EspejoE. P.BrennanP. A.HammenC. (2016). Stress responsivity and the structure of common mental disorders: Transdiagnostic internalizing and externalizing dimensions are associated with contrasting stress appraisal biases. Journal of Abnormal Psychology, 125(8), 1079-1089. https://doi.org/10.1037/abn0000163
20.
CurranP. J.HussongA. M. (2009). Integrative data analysis: The simultaneous analysis of multiple data sets. Psychological Methods, 14(2), 81-100. https://doi.org/10.1037/a0015914
21.
EatonN. R.Rodriguez-SeijasC.CarragherN.KruegerR. F. (2015). Transdiagnostic factors of psychopathology and substance use disorders: A review. Social Psychiatry and Psychiatric Epidemiology, 50(2), 171-182. https://doi.org/10.1007/s00127-014-1001-2
22.
EidM.GeiserC.KochT.HeeneM. (2017). Anomalous results in G-factor models: Explanations and alternatives. Psychological Methods, 22(3), 541-562. https://doi.org/10.1037/met0000083
23.
FirstM. B.SpitzerR. L.GibbonM.WilliamsJ. B. W. (1995). Structured clinical interview for DSM-IV Axis I disorders—Patient edition (SCID-I/P, Version 2.0). Biometrics Research Department, New York State Psychiatric Institute.
24.
ForbesM. K.KotovR.RuggeroC. J.WatsonD.ZimmermanM.KruegerR. F. (2017). Delineating the joint hierarchical structure of clinical and personality disorders in an outpatient psychiatric sample. Comprehensive Psychiatry, 79(November), 19-30. https://doi.org/10.1016/j.comppsych.2017.04.006
25.
ForbesM. K.TackettJ. L.MarkonK. E.KruegerR. F. (2016). Beyond comorbidity: Toward a dimensional and hierarchical approach to understanding psychopathology across the life span. Development and Psychopathology, 28(4pt1), 971-986. https://doi.org/10.1017/S0954579416000651
26.
ForbushK. T.WatsonD. (2013). The structure of common and uncommon mental disorders. Psychological Medicine, 43(1), 97-108. https://doi.org/10.1017/S0033291712001092
27.
GignacG. E.WatkinsM. W. (2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48(5), 639-662. https://doi.org/10.1080/00273171.2013.804398
28.
GoldbergL. R. (2006). Doing it all bass-ackwards: The development of hierarchical factor structures from the top down. Journal of Research in Personality, 40(4), 347-358. https://doi.org/10.1016/j.jrp.2006.01.001
29.
GreeneA. L.EatonN. R. (2017). The temporal stability of the bifactor model of comorbidity: An examination of moderated continuity pathways. Comprehensive Psychiatry, 72(January), 74-82. https://doi.org/10.1016/j.comppsych.2016.09.010
30.
HamlatE. J.SnyderH. R.YoungJ. F.HankinB. L. (2019). Pubertal timing as a transdiagnostic risk for psychopathology in youth. Clinical Psychological Science, 7(3), 411-429. https://doi.org/10.1177/2167702618810518
31.
HancockG. R.MuellerR. O. (2001). Rethinking construct reliability within latent variable systems. In CudeckR.du ToitS.SorbomD. (Eds.), Structural equation modeling: Present and future—A Festschrift in honor of Karl Joreskog (pp. 195-216). Scientific Software International.
32.
HankinB. L.PoggiE.SnyderH.YoungJ. F.GlynnM.SandmanC. A. (2017). Temperament factors and dimensional, latent bifactor models of child psychopathology: Transdiagnostic and specific associations in two youth samples. Psychiatry Research, 252(2), 139-146. https://doi.org/10.1111/j.1467-8330.1974.tb00606.x
33.
HankinB. L.SnyderH. R.GulleyL. D.SchweizerT. H.BijttebierP.NelisS.TohG.VaseyM. W. (2016). Understanding comorbidity among internalizing problems: Integrating latent structural models of psychopathology and risk mechanisms. Development and Psychopathology, 28(4), 987-1012. https://doi.org/10.1017/S0954579416000663
34.
HeeringaS. G.WagnerJ.TorresM.DuanN.AdamsT.BerglundP. (2004). Sample designs and sampling methods for the Collaborative Psychiatric Epidemiology Studies (CPES). International Journal of Methods in Psychiatric Research, 13(4), 221-240. https://doi.org/10.1002/mpr.179
35.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
36.
HylandP.MurphyJ.ShevlinM.CareyS.VallièresF.MurphyD.ElklitA. (2018). Correlates of a general psychopathology factor in a clinical sample of childhood sexual abuse survivors. Journal of Affective Disorders, 232(January), 109-115. https://doi.org/10.1016/j.jad.2018.02.048
37.
KesslerR.McGonagleK. A.ZhaoS.NelsonC. B.HughesM.EshlemanS.WittchenH.-U.KendlerK. S. (1994). Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States: Results from the National Comorbidity Survey. Archive of General Psychiatry, 51(1), 8-19. https://doi.org/10.1001/archpsyc.1994.03950010008002
38.
KesslerR.ÜstünT. (2004). The World Mental Health (WMH) Survey Initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). International Journal of Methods in Psychiatric Research, 13(2), 93-121. https://doi.org/10.1002/mpr.168
39.
KimH.EatonN. R. (2015). The hierarchical structure of common mental disorders: Connecting multiple levels of comorbidity, bifactor models, and predictive validity. Journal of Abnormal Psychology, 124(4), 1064-1078. https://doi.org/10.1037/abn0000113
40.
KotovR.KruegerR. F.WatsonD.AchenbachT. M.AlthoffR. R.BagbyR. M.BrownT. A.CarpenterW. T.CaspiA.ClarkL. A.EatonN. R.ForbesM. K.ForbushK. T.GoldbergD.HasinD.HymanS. E.IvanovaM. Y.LynamD. R.MarkonK.… ZimmermanM. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126(4), 454-477. https://doi.org/10.1037/abn0000258
LaceulleO. M.VolleberghW. A. M.OrmelJ. (2015). The structure of psychopathology in adolescence: Replication of a general psychopathology factor in the TRAILS study. Clinical Psychological Science, 3(6), 850-860. https://doi.org/10.1177/2167702614560750
43.
LaheyB. B.ApplegateB.HakesJ. K.ZaldD. H.HaririA. R.RathouzP. J. (2012). Is there a general factor of prevalent psychopathology during adulthood?Journal of Abnormal Psychology, 121(4), 971-977. https://doi.org/10.1037/a0028355
44.
LaheyB. B.KruegerR. F.RathouzP. J.WaldmanI. D.ZaldD. H. (2017). A hierarchical causal taxonomy of psychopathology across the life span. Psychological Bulletin, 143(2), 142-186. https://doi.org/10.1037/bul0000069
45.
LaheyB. B.RathouzP. J.KeenanK.SteppS. D.LoeberR.HipwellA. E. (2015). Criterion validity of the general factor of psychopathology in a prospective study of girls. Journal of Child Psychology and Psychiatry, 56(4), 415-422. https://doi.org/10.1111/jcpp.12300
46.
LockwoodE.ForbesD. (2014). Posttraumatic stress disorder and comorbidity: Untangling the Gordian knot. Psychological Injury and Law, 7(2), 108-121. https://doi.org/10.1007/s12207-014-9189-8
47.
Lorenzo-SevaU.ten BergeJ. M. F. (2006). Tucker’s congruence coefficient as a meaningful index of factor similarity. Methodology, 2(2), 57-64. https://doi.org/10.1027/1614-2241.2.2.57
48.
MarkonK. E. (2015). Ontology, measurement, and other fundamental problems of scientific inference. Psychological Inquiry, 26(3), 259-262. https://doi.org/10.1080/1047840X.2015.1039921
49.
MartelM. M.PanP. M.HoffmannM. S.GadelhaA.do RosárioM. C.MariJ. J.ManfroG. G.MiguelE. C.PausT.BressanR. A.RohdeL. A.SalumG. A. (2017). A general psychopathology factor (p factor) in children: Structural model analysis and external validation through familial risk and child global executive function. Journal of Abnormal Psychology, 126(1), 137-148. https://doi.org/10.1037/abn0000205
McElroyE.BelskyJ.CarragherN.FearonP.PatalayP. (2018). Developmental stability of general and specific factors of psychopathology from early childhood to adolescence: Dynamic mutualism or p-differentiation?Journal of Child Psychology and Psychiatry, 59(6), 667-675. https://doi.org/10.1111/jcpp.12849
52.
MoffittT. E.CaspiA.TaylorA.KokauaJ.MilneB. J.PolanczykG.PoultonR. (2010). How common are common mental disorders: Evidence that lifetime prevalence rates are doubled by prospective versus retrospective assessment. Psychological Medicine, 40(6), 899-909. https://doi.org/10.1017/S0033291709991036
53.
MurrayA. L.EisnerM.RibeaudD. (2016). The development of the general factor of psychopathology “p factor” through childhood and adolescence. Journal of Abnormal Child Psychology, 44(8), 1573-1586. https://doi.org/10.1007/s10802-016-0132-1
NeumannA.PappaI.LaheyB. B.VerhulstF. C.Medina-GomezC.JaddoeV. W.Bakermans-KranenburgM. J.TerrieE.MoffittT. E.van IJzendoornM. H.TiemeierH. (2016). Single nucleotide polymorphism heritability of a general psychopathology factor in children. Journal of the American Academy of Child & Adolescent Psychiatry, 55(12), 1038-1045. https://doi.org/10.1016/j.jaac.2016.09.498
56.
NoordhofA.KruegerR. F.OrmelJ.OldehinkelA. J.HartmanC. A. (2015). Integrating autism-related symptoms into the dimensional internalizing and externalizing model of psychopathology: The TRAILS study. Journal of Abnormal Child Psychology, 43(3), 577-587. https://doi.org/10.1007/s10802-014-9923-4
57.
OlinoT. M.BufferdS. J.DoughertyL. R.DysonM. W.CarlsonG. A.KleinD. N. (2018). The development of latent dimensions of psychopathology across early childhood: Stability of dimensions and moderators of change. Journal of Abnormal Child Psychology, 46(7), 1373-1383. https://doi.org/10.1007/s10802-018-0398-6
58.
OlinoT. M.DoughertyL. R.BufferdS. J.CarlsonG. A.KleinD. N. (2014). Testing models of psychopathology in preschool-aged children using a structured interview-based assessment. Journal of Abnormal Child Psychology, 42(7), 1201-1211. https://doi.org/10.1007/s10802-014-9865-x
59.
OltmannsJ. R.SmithG. T.OltmannsT. F.WidigerT. A. (2018). General factors of psychopathology, personality, and personality disorder: Across domain comparisons. Clinical Psychological Science, 6(4), 581-589. https://doi.org/10.1177/2167702617750150
60.
PatalayP.FonagyP.DeightonJ.BelskyJ.VostanisP.WolpertM. (2015). A general psychopathology factor in early adolescence. British Journal of Psychiatry, 207(1), 15-22. https://doi.org/10.1192/bjp.bp.114.149591
61.
PetterssonE.LaheyB. B.LarssonH.LichtensteinP. (2018). Criterion validity and utility of the general factor of psychopathology in childhood: Predictive associations with independently measured severe adverse mental health outcomes in adolescence. Journal of the American Academy of Child & Adolescent Psychiatry, 57(6), 372-383. https://doi.org/10.1016/j.jaac.2017.12.016
62.
PetterssonE.TurkheimerE.HornE. E.MenattiA. R. (2012). The general factor of personality and evaluation. European Journal of Personality, 26(5), 292-302. https://doi.org/10.1016/j.paid.2012.04.027
63.
PfohlB.BlumN.ZimmermanM. (1997). Structured interview for DSM-IV personality. American Psychiatric Press.
64.
PinneauS. R.NewhouseA. (1964). Measures of invariance and comparability in factor analysis for fixed variables. Psychometrika, 29(3), 271-281. https://doi.org/10.1007/BF02289724
ReiseS. P.BonifayW. E.HavilandM. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129-140. https://doi.org/10.1080/00223891.2012.725437
67.
RodriguezA.ReiseS. P.HavilandM. G. (2016). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223-237. https://doi.org/10.1080/00223891.2015.1089249
68.
SimmsL. J.WatsonD.DoebbelingB. N. (2002). Confirmatory factor analyses of posttraumatic stress symptoms in deployed and nondeployed veterans of the Gulf War. Journal of Abnormal Psychology, 111(4), 637-647. https://doi.org/10.1037/0021-843X.111.4.637
69.
SnyderH. R.YoungJ. F.HankinB. L. (2017). Strong homotypic continuity in common psychopathology-, internalizing-, and externalizing-specific factors over time in adolescents. Clinical Psychological Science, 5(1), 98-110. https://doi.org/10.1177/2167702616651076
70.
TackettJ. L.LaheyB. B.van HulleC.WaldmanI.KruegerR. F.RathouzP. J. (2013). Common genetic influences on negative emotionality and a general psychopathology factor in childhood and adolescence. Journal of Abnormal Psychology, 122(4), 1142-1153. https://doi.org/10.1037/a0034151
71.
van BorkR.EpskampS.RhemtullaM.BorsboomD.van der MaasH. L. J. (2017). What is the p-factor of psychopathology? Some risks of general factor modeling. Theory & Psychology, 27(6), 759-773. https://doi.org/10.1177/0959354317737185
72.
WaldmanI. D.PooreH. E.van HulleC.RathouzP. J.LaheyB. B. (2016). External validity of a hierarchical dimensional model of child and adolescent psychopathology: Tests using confirmatory factor analyses and multivariate behavior genetic analyses. Journal of Abnormal Psychology, 125(8), 1053-1066. https://doi.org/10.1037/abn0000183
73.
WattsA. L.PooreH. E.WaldmanI. D. (2019). Riskier tests of the validity of the bifactor model of psychopathology. Clinical Psychological Science, 5(1), 3-13. https://doi.org/10.1177/2167702616673363
74.
WidigerT. A.OltmannsJ. R. (2017). The general factor of psychopathology and personality. Clinical Psychological Science, 5(1), 182-183. https://doi.org/10.1177/2167702616657042
75.
WittchenH. U.KesslerR. C.ZhaoS.AbelsonJ. (1995). Reliability and clinical validity of UMCIDI DSM-III-R generalized anxiety disorder. Psychological Medicine, 29(2), 95-110. https://doi.org/10.1016/0022-3956(94)00044-R
76.
ZaldD. H.LaheyB. B. (2017). Implications of the hierarchical structure of psychopathology for psychiatric neuroimaging. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2(4), 310-317. https://doi.org/10.1016/j.bpsc.2017.02.003
77.
ZimmermanM. (2003). Integrating the assessment methods of researchers in routine clinical practice: The Rhode Island Methods to Improve Diagnostic Assessment and Services (MIDAS) project. In FirstM. B. (Ed.), Standardized evaluation in clinical practice (pp. 29-74). American Psychiatric Press.
78.
ZimmermanM. (2016). A review of 20 years of research on overdiagnosis and underdiagnosis in the Rhode Island Methods to Improve Diagnostic Assessment and Services (MIDAS) project. Canadian Journal of Psychiatry, 61(2), 71-79. https://doi.org/10.1177/0706743715625935
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
