The Multidimensional Behavioral Health Screen (MBHS) is a brief screening measure of behavioral health symptoms. Although the measure was first developed for primary care, it is likely to have clinical utility in other settings. This study examined the MBHS’s factor structure and psychometric properties with a university undergraduate and graduate student sample (n = 602, 58.6% female, 75.9% White, primarily aged 20–24) during the COVID-19 pandemic. MBHS subscale scores demonstrated internal consistency reliability and both convergent and discriminant relations with external, criterion variables. Confirmatory factor analyses supported a 7-subscale factor structure of the MBHS and did not find evidence of higher order factors. Clinical and theoretical implications, as well as future research directions, are discussed.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.).
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.).
3.
AuerbachR. P.MortierP.BruffaertsR.AlonsoJ.BenjetC.CuijpersP.DemyttenaereK.EbertD. D.GreenJ. G.HaskingP.MurrayE.NockM. K.Pinder-AmakerS.SampsonN. A.SteinD. J.VilagutG.ZaslavskyA. M.KesslerR. C., & WHO WMH-ICS Collaborators. (2018). WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders. Journal of Abnormal Psychology, 127(7), 623–638. https://doi.org/10.1037/abn0000362
4.
BaborT. F.Higgins-BiddleJ. C.SaundersJ. B.MonteiroM. G. (1992). The Alcohol Use Disorders Identification Test: Guidelines for use in primary care. World Health Organization.
5.
BastienC. H.VallièresA.MorinC. M. (2001). Validation of the Insomnia Severity Index as an outcome measure for insomnia research. Sleep Medicine, 2(4), 297–307. https://doi.org/10.1016/S1389-9457(00)00065-4
6.
BeardC.HsuK. J.RifkinL. S.BuschA. B.BjörgvinssonT. (2016). Validation of the PHQ-9 in a psychiatric sample. Journal of Affective Disorders, 193, 267–273. https://doi.org/10.1016/j.jad.2015.12.075
7.
Ben-PorathY. S.TellegenA. (2008). MMPI-2-RF, Minnesota Multiphasic Personality Inventory-2 Restructured Form: Manual for administration, scoring and interpretation. University of Minnesota Press.
8.
Ben-PorathY. S.TellegenA. (2020). Minnesota Multiphasic Personality Inventory-3 (MMPI-3): Manual for administration, scoring, and interpretation. University of Minnesota Press.
9.
CarterA. C.BrandonK. O.GoldmanM. S. (2010). The college and non-college experience: A review of the factors that influence drinking behavior in young adulthood. Journal of Studies on Alcohol and Drugs, 71(5), 742–750. https://doi.org/10.15288/jsad.2010.71.742
10.
CellaD.ChoiS. W.CondonD. M.SchaletB.HaysR. D.RothrockN. E.YountS.CookK. F.GershonR. C.AmtmannD.DeWaltD. A.PilkonisP. A.StoneA. A.WeinfurtK.ReeveB. B. (2019). PROMIS® adult health profiles: Efficient short-form measures of seven health domains. Value in Health, 22(5), 537–544. https://doi.org/10.1016/j.jval.2019.02.004
11.
CellaD.RileyW.StoneA.RothrockN.ReeveB.YountS.AmtmannD.BodeR.BuysseD.ChoiS.CookK.DeVellisR.DeWaltD.FriesJ. F.GershonR.HahnE. A.LaiJ.PilkonisP.RevickiD., & PROMIS Cooperative Group. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. https://doi.org/10.1016/j.jclinepi.2010.04.011
12.
CohenJ. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.
13.
ColbyS. M.SwantonD. N.ColbyJ. J. (2012). College students’ evaluations of heavy drinking: The influence of gender, age, and college status. Journal of College Student Development, 53(6), 797–810. https://doi.org/10.1353/csd.2012.0080
DawsonD. A.GrantB. F.StinsonF. S.ChouP. S. (2005). Psychopathology associated with drinking and alcohol use disorders in the college and general adult populations. Drug and Alcohol Dependence, 77(2), 139–150. https://doi.org/10.1016/j.drugalcdep.2004.07.012
16.
DodgeM. C. (2022). Enhanced screening for suicide risk in primary medical care settings (Publication No. 28490218) [Master’s thesis, Western Carolina University]. ProQuest Dissertations and Theses database.
17.
EisenbergD.HuntJ.SpeerN. (2013). Mental health in American colleges and universities: Variation across student subgroups and across campuses. The Journal of Nervous and Mental Disease, 201(1), 60–67. https://doi.org/10.1097/NMD.0b013e31827ab077
18.
ErzenE.ÇikrikciÖ. (2018). The effect of loneliness on depression: A meta-analysis. International Journal of Social Psychiatry, 64(5), 427–435. https://doi.org/10.1177/0020764018776349
19.
FalkenbergI.ValmaggiaL.ByrnesM.FrascarelliM.JonesC.RocchettiM.StraubeB.BadgerS.McGuireP.Fusar-PoliP. (2015). Why are help-seeking subjects at ultra-high risk for psychosis help-seeking?Psychiatry Research, 228(3), 808–815. https://doi.org/10.1016/j.psychres.2015.05.018
20.
ForbushK. T.WatsonD. (2013). The structure of common and uncommon mental disorders. Psychological Medicine, 43(1), 97–108. https://doi.org/10.1017/S0033291712001092
21.
Fortier-BrochuÉ.Beaulieu-BonneauS.IversH.MorinC. M. (2012). Insomnia and daytime cognitive performance: A meta-analysis. Sleep Medicine Reviews, 16(1), 83–94. https://doi.org/10.1016/j.smrv.2011.03.008
22.
FridgenG. J.AstonJ.GschwandtnerU.PfluegerM.ZimmermannR.StuderusE.StieglitzR.Riecher-RösslerA. (2013). Help-seeking and pathways to care in the early stages of psychosis. Social Psychiatry and Psychiatric Epidemiology, 48, 1033–1043. https://doi.org/10.1007/s00127-012-0628-0
HäfnerH.MaurerK.LöfflerW.Riecher-RösslerA. (1993). The influence of age and sex on the onset and early course of schizophrenia. The British Journal of Psychiatry, 162(1), 80–86. https://doi.org/10.1192/bjp.162.1.80
25.
HallW.SaundersJ. B.BaborT. F.AaslandO. G.AmundsenA.HodgsonR.GrantM. (1993). The structure and correlates of alcohol dependence: WHO collaborative project on the early detection of persons with harmful alcohol consumption—III. Addiction, 88(12), 1627–1636. https://doi.org/10.1111/j.1360-0443.1993.tb02037.x
26.
HayesA. F.CouttsJ. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But…. Communication Methods and Measures, 14(1), 1–24. https://doi.org/10.1080/19312458.2020.1718629
27.
HaysR. D.BjornerJ. B.RevickiD. A.SpritzerK. L.CellaD. (2009). Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Quality of Life Research, 18(7), 873–880. https://doi.org/10.1007/s11136-009-9496-9
28.
HaysR. D.SpritzerK. L.SchaletB. D.CellaD. (2018). PROMIS®-29 v2.0 profile physical and mental health summary scores. Quality of Life Research, 27(7), 1885–1891. https://doi.org/10.1007/s11136-018-1842-3
29.
KesslerR. C.AmmingerG. P.Aguilar-GaxiolaS.AlonsoJ.LeeS.ÜstünT. B. (2007). Age of onset of mental disorders: A review of recent literature. Current Opinion in Psychiatry, 20(4), 359–364. https://doi.org/10.1097/YCO.0b013e32816ebc8c
30.
KesslerR. C.AndrewsG.ColpeL. J.HiripiE.MroczekD. K.NormandS.-L. T.WaltersE. E.ZaslavskyA. M. (2002). Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychological Medicine, 32(6), 959–976. https://doi.org/10.1017/S0033291702006074
31.
KesslerR. C.BarkerP. R.ColpeL. J.EpsteinJ. F.GfroererJ. C.HiripiE.HowesM. J.NormandS. T.ManderscheidR. W.WaltersE. E.ZaslavskyA. M. (2003). Screening for serious mental illness in the general population. Archives of General Psychiatry, 60(2), 184–189. https://doi.org/10.1001/archpsyc.60.2.184
32.
KlineR. B. (2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.
33.
KotovR.KruegerR. F.WatsonD. (2018). A paradigm shift in psychiatric classification: The Hierarchical Taxonomy of Psychopathology (HiTOP). World Psychiatry, 17(1), 24–25. https://doi.org/10.1002/wps.20478
34.
KremyarA. J.TarescavageA. M.Ben-PorathY. S. (2020). The construct validity of distress intolerance: Is it distinct from demoralization and negative emotionality?Journal of Psychopathology and Behavioral Assessment, 42(2), 340–353. https://doi.org/10.1007/s10862-019-09764-9
35.
KroenkeK.SpitzerR. L.WilliamsJ. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
36.
KruegerR. F.MarkonK. E. (2006). Reinterpreting comorbidity: A model-based approach to understanding and classifying psychopathology. Annual Review of Clinical Psychology, 2, 111–133. https://doi.org/10.1146/annurev.clinpsy.2.022305.095213
37.
LoganJ. A.JiangH.HelsabeckN.Yeomans-MaldonadoG. (2022). Should I allow my confirmatory factors to correlate during factor score extraction? Implications for the applied researcher. Quality & Quantity, 56, 2107–2131. https://doi.org/10.1007/s11135-021-01202-x
38.
MackenzieS.WiegelJ. R.MundtM.BrownD.SaewycE.HeiligensteinE.HarahanB.FlemingM. (2011). Depression and suicide ideation among students accessing campus health care. American Journal of Orthopsychiatry, 81(1), 101–107. https://doi.org/10.1111/j.1939-0025.2010.01077.x
39.
McCordD. M. (2020). The Multidimensional Behavioral Health Screen 1.0: A translational tool for primary medical care. Journal of Personality Assessment, 102(2), 164–174. https://doi.org/10.1080/00223891.2019.1683019
40.
MichelN. M.RowaK.YoungL.McCabeR. E. (2016). Emotional distress tolerance across anxiety disorders. Journal of Anxiety Disorders, 40, 94–103. https://doi.org/10.1016/j.janxdis.2016.04.009
41.
MitchellH. G.FrayneD.WyattB.GollerH.McCordD. M. (2020). Comparing the PHQ-9 to the Multidimensional Behavioral Health Screen in predicting depression-related symptomatology in a primary medical care sample. Journal of Personality Assessment, 102(2), 175–182. https://doi.org/10.1080/00223891.2019.1693388
42.
MorinC. M. (1993). Insomnia: Psychological assessment and management. The Guilford Press.
43.
MorinC. M.BellevilleG.BélangerL.IversH. (2011). The Insomnia Severity Index: Psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep, 34(5), 601–608. https://doi.org/10.1093/sleep/34.5.601
44.
PedrelliP.NyerM.YeungA.ZulaufC.WilensT. (2015). College students: Mental health problems and treatment considerations. Academic Psychiatry, 39, 503–511. https://doi.org/10.1007/s40596-014-0205-9
45.
PiccinelliM.TessariE.BortolomasiM.PiasereO.SemenzinM.GarzottoN.TansellaM. (1997). Efficacy of the alcohol use disorders identification test as a screening tool for hazardous alcohol intake and related disorders in primary care: A validity study. BMJ, 314(7078), 420. https://doi.org/10.1136/bmj.314.7078.420
46.
PilkonisP. A.ChoiS. W.ReiseS. P.StoverA. M.RileyW. T.CellaD., & PROMIS Cooperative Group. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283. https://doi.org/10.1177/1073191111411667
47.
RashidT.OstermannR. F. (2009). Strength-based assessment in clinical practice. Journal of Clinical Psychology, 65(5), 488–498. https://doi.org/10.1002/jclp.20595
48.
RasmussenA.VerkuilenJ.JayawickremeN.WuZ.McCluskeyS. T. (2019). When did posttraumatic stress disorder get so many factors? Confirmatory factor models since DSM-5. Clinical Psychological Science, 7(2), 234–248. https://doi.org/10.1177/2167702618809370
49.
RobitzschA. (2020). Why ordinal variables can (almost) always be treated as continuous variables: Clarifying assumptions of robust continuous and ordinal factor analysis estimation methods. Frontiers in Education, 5, 589965.
50.
RogersT. A.BardeenJ. R.FergusT. A.BenferN. (2020). Factor structure and incremental utility of the Distress Tolerance Scale: A bifactor analysis. Assessment, 27(2), 297–308. https://doi.org/10.1177/1073191118789496
51.
RussellD. W. (1996). UCLA Loneliness Scale (Version 3): Reliability, validity, and factor structure. Journal of Personality Assessment, 66(1), 20–40. https://doi.org/10.1207/s15327752jpa6601_2
52.
SatorraA.BentlerP. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In von EyeA.CloggC. C. (Eds.), Latent variables analysis: Applications for developmental research (pp. 399–419). Sage.
53.
SaundersJ. B.AaslandO. G.BaborT. F.De La FuenteJ. R.GrantM. (1993). Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption-II. Addiction, 88(6), 791–804. https://doi.org/10.1111/j.1360-0443.1993.tb02093.x
54.
SeligmanM. E.RashidT.ParksA. C. (2006). Positive psychotherapy. American Psychologist, 61(8), 774–788.
55.
SellbomM.Ben-PorathY. S.BagbyR. M. (2008). On the hierarchical structure of mood and anxiety disorders: Confirmatory evidence and elaboration of a model of temperament markers. Journal of Abnormal Psychology, 117(3), 576–590. https://doi.org/10.1037/a0012536
56.
SharmaL.MarkonK. E.ClarkL. A. (2014). Toward a theory of distinct types of “impulsive” behaviors: A meta-analysis of self-report and behavioral measures. Psychological Bulletin, 140(2), 374–408. https://doi.org/10.1037/a0034418
57.
SimonsJ. S.GaherR. M. (2005). The Distress Tolerance Scale: Development and validation of a self-report measure. Motivation and Emotion, 29(2), 83–102. https://doi.org/10.1007/s11031-005-7955-3
58.
SmithB. W.DalenJ.WigginsK.TooleyE.ChristopherP.BernardJ. (2008). The brief resilience scale: Assessing the ability to bounce back. International Journal of Behavioral Medicine, 15(3), 194–200. https://doi.org/10.1080/10705500802222972
59.
SoehnerA. M.HarveyA. G. (2012). Prevalence and functional consequences of severe insomnia symptoms in mood and anxiety disorders: Results from a nationally representative sample. Sleep, 35(10), 1367–1375. https://doi.org/10.5665/sleep.2116
TellegenA.Ben-PorathY. S.McNultyJ. L.ArbisiP. A.GrahamJ. R.KaemmerB. (2003). MMPI-2 Restructured Clinical (RC) scales: Development, validation, and interpretation. University of Minnesota Press.
63.
UmucuE.FortunaK.JungH.BialunskaA.LeeB.MangaduT.StormM.ErgunG.MozerD. A.BrooksJ. (2022). A national study to assess validity and psychometrics of the short Kessler psychological distress scale (K6). Rehabilitation Counseling Bulletin, 65(2), 140–149. https://doi.org/10.1177/00343552211043261
64.
WallerN. G. (2023). Breaking our silence on factor score indeterminacy. Journal of Educational and Behavioral Statistics, 48(2), 244–261. https://doi.org/10.3102/10769986221128810
65.
WangP. S.AngermeyerM.BorgesG.BruffaertsR.ChiuW. T.De GirolamoG.FayyadJ.GurejeO.HaroJ. M.HuangY.KesslerR. C.KovessV.LevinsonD.NakaneY.Oakley BrownM. A.OrmelJ. H.Posada-VillaJ.Aguilar-GaxiolaS.AlonsoJ.LeeS.HeeringaS.PennellB. E.ChatterjiS.UestuenT. B. (2007). Delay and failure in treatment seeking after first onset of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry, 6(3), 177–185.
66.
WestS. G.FinchJ. F.CurranP. J. (1995). Structural equation models with non-normal variables: Problems and remedies. In HoyleR. H. (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 56–75). Sage.
67.
WhitesideS. P.LynamD. R. (2001). The five factor model and impulsivity: Using a structural model of personality to understand impulsivity. Personality and Individual Differences, 30(4), 669–689. https://doi.org/10.1016/S0191-8869(00)00064-7
68.
WidamanK. F.RevelleW. (2023). Thinking thrice about sum scores, and then some more about measurement and analysis. Behavior Research Methods, 55, 788–806. https://doi.org/10.3758/s13428-022-01849-w
69.
WinogradR. P.LittlefieldA. K.SherK. J. (2012). Do people who “Mature Out” of drinking see themselves as more mature?Alcoholism: Clinical and Experimental Research, 36(7), 1212–1218. https://doi.org/10.1111/j.1530-0277.2011.01724.x
70.
WryeB. A.PruittC. L. (2017). Perceptions of binge drinking as problematic among college students. Journal of Alcohol and Drug Education, 61(1), 71–90.
71.
ZhangJ.LamS. P.LiS. X.TangN. L.YuM. W. M.LiA. M.WingY. K. (2012). Insomnia, sleep quality, pain, and somatic symptoms: Sex differences and shared genetic components. Pain, 153(3), 666–673. https://doi.org.10.1016/j.pain.2011.12.003
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
