A significant percentage of college students discontinue mental health treatment prematurely. Using a discrete choice experiment, 909 students chose between experimentally manipulated descriptions of mental health services, selecting the option that would encourage them to stay in treatment. Latent class analysis identified three groups. The community class (36.7%) would remain in treatment at community walk-in clinics. The campus class (27.3%) would be more likely to remain in an on-campus student health service. The residence class, 36.0% of participants, would be most likely to remain in treatments at their residence. All classes would be more likely to remain in services including the option of medication, psychotherapy, or alternative treatments such as diet and exercise. Simulations predicted that most students would trade individual treatment for more cost-effective groups if students who had experienced mental health problems recommended these services and access to text messages and telephone help was included.
ArnettJ. J.ŽukauskienėR.SugimuraK. (2014). The new life stage of emerging adulthood at ages 18–29 years: Implications for mental health. The Lancet Psychiatry, 1(7), 569–576.
2.
ArriaA. M.CaldeiraK. M.AllenH. K.BugbeeB. A.VincentK. B.O’GradyK. E. (2017). Prevalence and incidence of drug use among college students: An 8-year longitudinal analysis. The American Journal of Drug and Alcohol Abuse, 43(6), 711–718.
3.
AuerbachR. P.MortierP.LeuvenU. P. C. K.AlonsoJ.BenjetC. (2018). WHO world mental health surveys international college student project: Prevalence and distribution of mental disorders. Journal of Abnormal Psychology, 127(7), 623–638. http://dx.doi.org/10.1037/abn0000362
4.
BaruchG.VrouvaI.FearonP. (2009). A follow-up study of characteristics of young people that dropout and continue psychotherapy: Service implications for a clinic in the community. Child and Adolescent Mental Health, 14(2), 69–75.
5.
BeiterR.NashR.McCradyM.RhoadesD.LinscombM.ClarahanM.SammutS. (2015). The prevalence and correlates of depression, anxiety, and stress in a sample of college students. Journal of Affective Disorders, 173(Complete), 90–96. https://doi.org/10.1016/j.jad.2014.10.054
6.
BeksT. A.CairnsS. L.SmygwatyS.Miranda OsorioO. A.HillS. J. (2018). Counsellor-in-residence: Evaluation of a residence-based initiative to promote student mental health. Canadian Journal of Higher Education/Revue canadienne d’enseignement supérieur, 48(2), 55–73.
7.
BerlinK. S.WilliamsN. A.ParraG. R. (2014). An introduction to latent variable mixture modeling (part 1): Overview and cross-sectional latent class and latent profile analyses. Journal of Pediatric Psychology, 39(2), 174–187. https://doi.org/10.1093/jpepsy/jst084
8.
BlackS. R.FristadM. A.ArnoldL. E.BirmaherB.FindlingR. L.YoungstromE. A.HorwitzS. M. (2018). Factors influencing emerging adults’ use of outpatient mental health services. Evidence-Based Practice in Child and Adolescent Mental Health, 4(2), 1–9.
9.
BlancoC.OkudaM.WrightC.HasinD. S.GrantB. F.LiuS. M.OlfsonM. (2008). Mental health of college students and their non-college-attending peers: Results from the national epidemiologic study on alcohol and related conditions. Archives of General Psychiatry, 65(12), 1429–1437. https://doi.org/10.1001/archpsyc.65.12.1429
10.
BridgesJ. F. P.HauberA. B.MarshallD.LloydA.ProsserL. A.RegierD. A.JohnsonF. R.MauskopfJ. (2011). Conjoint analysis applications in health—a checklist: A report of the ISPOR good research practices for conjoint analysis task force. Value in Health, 14, 403–413. https://doi.org/10.1016/j.jval.2010.11.013
11.
BruffaertsR.MortierP.AuerbachR.AlonsoJ.De la Torre HermosilloA.CuijpersP.DemyttenaereK.EbertD. D.GreenJ. G.HaskingP.SteinD. J.EnnisE.NockM. K.Pinder-AmakerS.SampsonN. A.VilagutG.ZaslavskyA. M.KesslerR. C., & WHO WMH-ICS Collaborators.(2019). Lifetime and 12-month treatment for mental disorders and suicidal thoughts and behaviors among first year college students. International Journal of Methods in Psychiatric Research, 28(2), e1764–e1764.
12.
CarusoE. M.RahnevD. A.BanajiM. R. (2009). Using conjoint analysis to detect discrimination: Revealing covert preferences from overt choices. Social Cognition, 27(1), 128–137. https://doi.org/10.1521/soco.2009.27.1.128
13.
CeleuxG.SoromenhoG. (1996). An entropy criterion for assessing the number of clusters in a mixture model. Journal of Classification, 13(2), 195–212. https://doi.org/10.1007/BF01246098
14.
ChrzanK. (2010). Using partial profile choice experiments to handle large numbers of attributes. International Journal of Market Research, 52(6), 827–840. https://doi.org/10.2501/S1470785310201673
15.
ClementS.SchaumanO.GrahamT.MaggioniF.Evans-LackoS.BezborodovsN.MorganC.RüschN.BrownJ. S.ThornicroftG. (2015). What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychological Medicine, 45(1), 11–27. https://doi.org/10.1017/S0033291714000129
16.
CrutchfieldT. M.KistlerC. E. (2017). Getting patients in the door: Medical appointment reminder preferences. Patient Preference and Adherence, 11, 141–150. https://doi.org/10.2147/PPA.S117396
17.
CuijpersP.DekkerJ.HollonS. D.AnderssonG. (2009). Adding psychotherapy to pharmacotherapy in the treatment of depressive disorders in adults: A meta-analysis. The Journal of Clinical Psychiatry, 70(9), 1219–1229.
18.
CunninghamC. E.ChenY.VaillancourtT.RimasH.DealK.CunninghamL. J.RatcliffeJ. (2015). Modeling the anti-cyberbullying preferences of university students: Adaptive choice-based conjoint analysis. Aggressive Behavior, 41(4), 369–385. https://doi.org/10.1002/ab.21560
19.
CunninghamC. E.WalkerJ.EastwoodJ.WestraH.RimasH.ChenY.MarcusM.SwinsonR. P.BrackenK., & The Mobilizing Minds Research, Group. (2013). Modeling mental health information preferences during the early adult years: A discrete choice conjoint experiment. Journal of Health Communication. https://doi.org/10.1080/10810730.2013.811324
20.
CunninghamC. E.WalkerJ.EastwoodJ.WestraH.RimasH.ChenY.MarcusM.SwinsonR. P.BrackenK., & The Mobilizing Minds Research, Group. (2014). Modeling mental health information preferences during the early adult years: A discrete choice conjoint experiment. Journal of Health Communication, 19(4), 413–440. https://doi.org/10.1007/s12310-013-9110-8
21.
CunninghamC. E.ZipurskyR.ChristensenB.BielingP.MadsenV.RimasH.MielkoS.WilsonF.FurimskyI.JeffsL.MunnC. (2017). Modeling the mental health service utilization decisions of university undergraduates: A discrete choice conjoint experiment. Journal of American College Health, 65(6), 389–399. https://doi.org/10.1080/07448481.2017.1322090
22.
de Bekker-GrobE. W.RyanM.GerardK. (2012). Discrete choice experiments in health economics: A review of the literature. Health Economics, 21(2), 145–172. https://doi.org/10.1002/hec.1697
23.
DziakJ. J.CoffmanD. L.LanzaS. T.LiR. (2019). Sensitivity and specificity of information criteria. Briefings in Bioinformatics, 1–13. https://doi.org/10.1093/bib/bbz016
24.
EbertD. D.MortierP.KaehlkeF.BruffaertsR.BaumeisterH.AuerbachR. P.AlonsoJ.VilagutG.MartínezK. I.LochnerC.CuijpersP.KuechlerA. M.GreenJ.HaskingP.LapsleyC.SampsonN. A.KesslerR. C., & WHO World Mental Health International College Student Initiative Collaborators (2019). Barriers of mental health treatment utilization among first-year college students: First cross-national results from the WHO World Mental Health International College Student Initiative. International Journal of Methods in Psychiatric Research, 28(2), e1782.
25.
EdlundM. J.WangP. S.BerglundP. A.KatzS. J.LinE.KesslerR. C. (2002). Dropping out of mental health treatment: Patterns and predictors among epidemiological survey respondents in the United States and Ontario. The American Journal of Psychiatry, 159(5), 845–851. https://doi.org/10.1176/appi.ajp.159.5.845
26.
EisenbergD.DownsM. F.GolbersteinE.ZivinK. (2009). Stigma and help seeking for mental health among college students. Medical Care Research and Review, 66, 522–541. https://doi.org/10.1177/1077558709335173
27.
EisenbergD.GolbersteinE.GollustS. E. (2007). Help-seeking and access to mental health care in a university student population. Medical Care, 45(7), 594–601. https://doi.org/10.1097/MLR.0b013e31803bb4c1
28.
EisenbergD.GollustS. E.GolbersteinE. (2007). Prevalence and correlates of depression, anxiety and suicidality in a university student population. American Journal of Orthopsychiatry, 77(4), 534–542.
29.
EisenbergD.HuntJ.SpeerN.ZivinK. (2011). Mental health service utilization among college students in the United States. The Journal of Nervous and Mental Disease, 199(5), 301–308. https://doi.org/10.1097/NMD.0b013e3182175123
30.
EisenbergD.SpeerN.HuntJ. B. (2012). Attitudes and beliefs about treatment among college students with untreated mental health problems. Psychiatric Services (Washington, D.C.), 63(7), 711–713. https://doi.org/10.1176/appi.ps.201100250
31.
GagnonM. M.GelinasB. L.FriesenL. N. (2017). Mental health literacy in emerging adults in a university setting: Distinctions between symptom awareness and appraisal. Journal of Adolescent Research, 32(5), 642–664.
32.
HallS. B.BrownN. W.HumphriesJ. R. (2018). Premature termination from outpatient psychotherapy in a university-based counseling center. Counseling Outcome Research and Evaluation, 9(1), 28–41.
33.
HauberB.GonzalezJ.Groothuis-OudshoornC.PriorT.MarshallD.CunninghamC.IJzermanM.BridgesJ. (2016). Statistical methods for the analysis of discrete-choice experiments: A report of the ISPOR conjoint analysis good research practices task force. Value in Health, 19(4), 300–315. https://doi.org/10.1016/j.jval.2016.04.004
34.
HaughtonD.LegrandP.WoolfordS. (2009). Review of three latent class cluster analysis packages: Latent gold, POLCA, and MCLUST. The American Statistician, 63(1), 81–91.
HidesL.CarrollS.CataniaL.CottonS. M.BakerA.ScaffidiA.LubmanD. I. (2010). Outcomes of an integrated cognitive BEHAVIOUR therapy (CBT) treatment program for co-occurring depression and substance misuse in young people. Journal of Affective Disorders, 121(1–2), 169–174. https://doi.org/10.1016/j.jad.2009.06.002
37.
HolmesA.SilvestriR. (2016). Rates of mental illness and associated academic impacts in Ontario’s college students. Canadian Journal of School Psychology, 31(1), 27–46.
38.
HuberJ.OrmeB. K.MillerR. (2007). Dealing with product similarity in conjoint simulations. In GustafssonA.HerrmannA.HuberF. (Eds.), Conjoint measurement: Methods and applications (4 ed., pp. 347–362). Springer.
JohnsonR.LancsarE.MarshallD.KilambiV.MuhlbacherA.RegierD. A.BresnahanB. W.KanninenB.BridgesJ. F. (2013). Constructing experimental designs for discrete-choice experiments: Report of the ISPOR conjoint analysis experimental design good research practices task force. Value in Health, 16(1), 3–13. https://doi.org/10.1016/j.jval.2012.08.2223
41.
Ketchen LipsonS.GaddisS. M.HeinzeJ.BeckK.EisenbergD. (2015). Variations in student mental health and treatment utilization across US colleges and universities. Journal of American College Health, 63(6), 388–396.
42.
LampropoulosG. K.SchneiderM. K.SpenglerP. M. (2009). Predictors of early termination in a university counseling training clinic. Journal of Counseling & Development, 87(1), 36–46.
43.
LanzaS. T.RhoadesB. L. (2013). Latent class analysis: An alternative perspective on subgroup analysis in prevention and treatment. Prevention Science, 14(2), 157–168. https://doi.org/10.1007/s11121-011-0201-1
LiGreenKesslerJ. G.SazlaskyR. C. (2010). Estimating prevalence of serious emotional disturbance in schools using a brief screening scale. International Journal of Methods in Psychiatric Research, 19(Suppl 1), 88–98.
MartinJ. M. (2010). Stigma and student mental health in higher education. Higher Education Research & Development, 29(3), 259–274. https://doi.org/10.1080/07294360903470969
48.
McLeanS. M.BoothA.GeeM.SalwayS.CobbM.BhanbhroS.NancarrowS. A. (2016). Appointment reminder systems are effective but not optimal: Results of a systematic review and evidence synthesis employing realist principles. Patient Preference and Adherence, 10, 479–499. https://doi.org/10.2147/PPA.S93046
49.
NylundK.AsparouhovT.MuthénB. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14(4), 535–569. https://doi.org/10.1080/10705510701575396
50.
OpieR. S.O’NeilA.ItsiopoulosC.JackaF. N. (2015). The impact of whole-of-diet interventions on depression and anxiety: A systematic review of randomised controlled trials. Public Health Nutrition, 18, 2074–2093. https://doi.org/10.1017/S1368980014002614
51.
OrmeB. K. (2014). Getting started with conjoint analysis: Strategies for product design and pricing research (4th ed.). Research Publishers.
52.
OswaltS. B.LedererA. M.Chestnut-SteichK. (2019). Who is willing to come back? College students’ willingness to seek help after using campus mental health services. Journal of American College Health, 67(1), 10–16.
53.
OswaltS. B.LedererA. M.Chestnut-SteichK.DayC.HalbritterA.OrtizD. (2020). Trends in college students’ mental health diagnoses and utilization of services, 2009-2015. Journal of American College Health, 68(1), 41–51. https://doi.org/10.1080/07448481.2018.1515748
54.
PrinceJ. P. (2015). University student counseling and mental health in the United States: Trends and challenges. Mental Health & Prevention, 3(1), 5–10.
55.
RosenbaumS.TiedemannA.SherringtonC.CurtisJ.WardP. B. (2014). Physical activity interventions for people with mental illness: A systematic review and meta-analysis. The Journal of Clinical Psychiatry, 75(9), 964–974. https://doi.org/10.4088/JCP.13r08765
56.
RosenthalB.WilsonW. C. (2008). Mental health services: Use and disparity among diverse college students. Journal of American College Health, 57(1), 61–68. https://doi.org/10.3200/JACH.57.1.61-68
57.
SwiftJ. K.CallahanJ. L. (2009). The impact of client treatment preferences on outcome: A meta-analysis. Journal of Clinical Psychology, 65(4), 368–381. https://doi.org/10.1002/jclp.20553
58.
SwiftJ. K.CallahanJ. L.CooperM.ParkinS. R. (2018). The impact of accommodating client preference in psychotherapy: A meta-analysis. Journal of Clinical Psychology, 74(11), 1924–1937.
59.
SwiftJ. K.GreenbergR. P. (2012). Premature discontinuation in adult psychotherapy: A meta-analysis. Journal of Consulting and Clinical Psychology, 80(4), 547.
60.
SwiftJ. K.GreenbergR. P.TompkinsK. A.ParkinS. R. (2017). Treatment refusal and premature termination in psychotherapy, pharmacotherapy, and their combination: A meta-analysis of head-to-head comparisons. Psychotherapy, 54(1), 47.
61.
SwiftJ. K.SpencerJ.GoodeJ. (2018). Improving psychotherapy effectiveness by addressing the problem of premature termination: Introduction to a special section. Psychotherapy Research, 28(5). 669–671. https://doi.org/10.180/10673220590956429
62.
VermuntJ. (2008). Latent class and finite mixture models for multilevel data sets. Statistical Methods in Medical Research, 17(1), 33–51.
VermuntJ.MagidsonJ. (2005b). Technical guide for Latent GOLD 4.0: Basic and advanced. Statistical Innovations.
65.
WhiteA.HingsonR. (2013). The burden of alcohol use: Excessive alcohol consumption and related consequences among college students. Alcohol Research: Current Reviews, 35(2), 201–218.
66.
YorgasonJ. B.LinvilleD.ZitzmanB. (2008). Mental health among college students: Do those who need services know about and use them?Journal of American College Health, 57(2), 173–182. https://doi.org/10.3200/JACH.57.2.173-182
67.
ZhouM.ThayerW. M.BridgesJ. F. P. (2018). Using latent class analysis to model preference heterogeneity in health: A systematic review. PharmacoEconomics, 36(2), 175–187. https://doi.org/10.1007/s40273-017-0575-4
68.
ZivinK.EisenbergD.GollustS. E.GolbersteinE. (2009). Persistence of mental health problems and needs in a college student population. Journal of Affective Disorders, 117(3), 180–185. https://doi.org/10.1016/j.jad.2009.01.001
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
