Restricted accessResearch articleFirst published online 2022-7
Military Background and Gender Identity in Psychological Assessment Among College Students: Factorial Invariance of the Counseling Center Assessment of Psychological Symptoms–62 (CCAPS-62)
The purpose of this study was to examine the factorial invariance of the Counseling Center Assessment of Psychological Symptoms–62 (CCAPS-62) across military background and gender identity. A sample of 2,208 military students and 2,208 nonmilitary students were chosen from a large database of university and college counseling centers. Using exploratory structural equation modeling, findings suggested the CCAPS-62 is mostly invariant across military background and gender identity. Only three item thresholds appeared to be noninvariant across groups. These results suggest comparisons of scores across military background and gender can be made. Latent mean differences across groups were also examined. After controlling for several background variables, there were some differences between males and females on subscales measuring depression, eating concerns, and generalized anxiety, but no differences between military and nonmilitary students. Implications for practice and future research are discussed.
ArbonaC.BurridgeA.OlveraN. (2017). The Center for Epidemiological Studies Depression Scale (CES-D): Measurement equivalence across gender groups. Journal of Affective Disorders, 219(September), 112-118. https://doi.org/10.1016/j.jad.2017.05.024
BachmanJ. G.SegalD. R.Freedman-DoanP.O’MalleyP. M. (2000). Who chooses military service? Correlates of propensity and enlistment in the U.S. Armed Forces. Military Psychology, 12(1), 1-30. https://doi.org/10.1207/S15327876MP1201_1
4.
BarnettS. D.HicklingE. J.SheppardS. (2018). The impact of gender on the factor structure of PTSD symptoms among active duty United States military personnel. European Journal of Trauma & Dissociation, 2(3), 117-124. https://doi.org/10.1016/j.ejtd.2018.01.002
5.
BarryA. E.WhitemanS. D.MacDermid WadsworthS. M. (2012). Implications of posttraumatic stress among military-affiliated and civilian students. Journal of American College Health, 60(8), 562-573. https://doi.org/10.1080/07448481.2012.721427
6.
BarryA. E.WhitemanS. D.MacDermid WadsworthS. M. (2014). Student service members/veterans in higher education: A systematic review. Journal of Student Affairs Research and Practice, 51(1), 30-42. https://doi.org/10.1515/jsarp-2014-0003
BlosnichJ. R.KopaczM. S.McCartenJ.BossarteR. M. (2015). Mental health and self- directed violence among student service members/veterans in postsecondary education. Journal of American College Health, 63(7), 418-426. https://doi.org/10.1080/07448481.2014.931282
9.
BodenM. T.KimerlingR.Jacobs-LentzJ.BowmanD.WeaverC.CarneyD.WalserR.TraftonJ. A. (2012). Seeking safety treatment for male veterans with a substance use disorder and post-traumatic stress disorder symptomatology. Addiction, 107(3), 578-586. https://doi.org/10.1111/j.1360-0443.2011.03658.x
10.
BorsariB.YurasekA.MillerM. B.MurphyJ. G.McDevitt-MurphyM. E.MartensM. P.CareyK. B. (2017). Student service members/veterans on campus: Challenges for reintegration. American Journal of Orthopsychiatry, 87(2), 166-175. http://dx.doi.org/10.1037/ort0000199
11.
BunnellB. E.JosephD. L.BeidelD. C. (2013). Measurement invariance of the Social Phobia and Anxiety Inventory. Journal of Anxiety Disorders, 27(1), 84-91. https://doi.org/10.1016/j.janxdis.2012.09.001
12.
ByrneB. M.ShavelsonR. J.MuthénB. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456-466. https://doi.org/10.1037/0033-2909.105.3.456
13.
CarletonR. N.ThibodeauM. A.TealeM. J.WelchP. G.AbramsM. P.RobinsonT.AsmundsonG. J. (2013). The center for epidemiologic studies depression scale: A review with a theoretical and empirical examination of item content and factor structure. PLOS ONE, 8(3), Article e58067. https://doi.org/10.1371/journal.pone.0058067
14.
CarmodyD. P. (2005). Psychometric characteristics of the Beck Depression Inventory-II with college students of diverse ethnicity. International Journal of Psychiatry in Clinical Practice, 9(1), 22-28. https://doi.org/10.1080/13651500510014800
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233-255. https://doi.org/10.1207/S15328007SEM0902_5
20.
ClevelandS. D.BranscumA. J.BovbjergV. E.ThorburnS. (2015). Mental health symptoms among student service members/veterans and civilian college students. Journal of American College Health, 63(7), 459-472. https://doi.org/10.1080/07448481.2014.983925
21.
CochranS. V.RabinowitzF. E. (2003). Gender-sensitive recommendations for assessment and treatment of depression in men. Professional Psychology Research and Practice, 34(2), 132-140. https://doi.org/10.1037/0735-7028.34.2.132
22.
CombellickJ. L.DziuraJ.PortnoyG. A.MattocksK. M.BrandtC. A.HaskellS. G. (2019). Trauma and sexual risk: Do men and women veterans differ?Women’s Health Issues, 29(S1), S74-S82. https://doi.org/10.1016/j.whi.2019.04.014
23.
DavidsonJ. R. T.BookS. W.ColketJ. T.TuplerL. A.RothS.DavidD.HertzbergM.MellmanT.BeckhamJ. C.SmithR. D.DavidsonR. M.KatzR.FeldmanM. E. (1997). Assessment of a new self-rating scale for post-traumatic stress disorder. Psychological Medicine, 27(1), 153-160. https://doi.org/10.1017/s0033291796004229
FeczerD.BjorklundP. (2009). Forever changed: Post-traumatic stress disorder in female military veterans, a case report. Perspectives in Psychiatric Care, 45(4), 278-291. https://doi.org/10.1111/j.1744-6163.2009.00230.x
26.
FletcherC. (2002). The clinical intake questionnaire: Construction and testing of a developmentally sensitive intake instrument for use with university counseling center populations. [Unpublished dissertation, University of Michigan, Ann Arbor].
27.
Ghahramanlou-HollowayM.CoxD. W.FritzE. C.GeorgeB. J. (2011). An evidence- informed guide for working with military women and veterans. Professional Psychology: Research and Practice, 42(1), 1-7. https://doi.org/10.1037/a0022322
28.
GhoshA.NilekselaC.ParhamA.JanisR. (2021). Investigating dactorial invariance of the Counseling Center Assessment of Psychological Symptoms – 34 (CCAPS-34) with military and mon-military students. Measurement and Evaluation in Counseling and Development, 54(1), 42-55. https://doi.org/10.1080/07481756.2020.1745649
29.
GuarnacciaP. J.AngelR.Lowe WorobeyJ. (1989). The factor structure of the CES-D in the Hispanic health and nutrition examination survey: The influences of ethnicity, gender and language. Social Science & Medicine, 29(1), 85-94. https://doi.org/10.1016/0277-9536(89)90131-7
30.
Holgado-TelloF. P.Chacon-MoscosoS.Barbero-GarciaI.Villa-AbadE. (2010). Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Quality & Quantity, 44(1), 153-166. http://dx.doi.org/10.1007/s11135-008-9190-y
31.
JohnstonL. D.O’MalleyP. M.BachmanJ. G.SchulenbergJ. E. (2005). Monitoring the Future National Survey Results on Drug Use, 1975–2004: Volume II: College students and adults ages 19–45 (NIH Publication 05-5728). National Institute on Drug Abuse.
32.
JinY. (2020). A note on the cutoff values of alternative fit indices to evaluate measurement invariance for ESEM models. International Journal of Behavioral Development, 44(2),166-174. https://doi.org/10.1177/0165025419866911
33.
KangY.McNeishD. M.HancockG. R. (2016). The role of measurement quality on practical guidelines for assessing measurement and structural invariance. Educational and Psychological Measurement, 76(4), 533-561. https://doi.org/10.1177/0013164415603764
34.
KeroP.LeeD. (2016). Likert is pronounced “lick-urt” not “lie-Kurt” and data are ordinal not interval. Journal of Applied Measurement, 17(4), 502-509. http://jampress.org/
35.
LapierreC. B.SchweglerA. F.LaBauveB. J. (2007). Posttraumatic stress and depression symptoms in soldiers returning from combat operations in Iraq and Afghanistan. Journal of Traumatic Stress, 20(6), 933-943. https://doi.org/10.1002/jts.20278
36.
LittleT. D. (2013). Longitudinal structural equation model. Guilford Press.
37.
LockeB. D.BuzolitzJ. S.LeiP. W.BoswellJ. F.McAleaveyA. A.SevigT. D.DowisJ. D. (2011). Development of counseling center assessment of psychological symptoms–62 (CCAPS-62). Journal of Counseling Psychology, 58(1), 97-109. https://doi.org/10.1037/a0021282
38.
LockeB. D.McAleaveyA. A.ZhaoY.LeiP. W.HayesJ. A.CastonguayL. G.LiH.TateR.LinY. C. (2012). Development and initial validation of the Counseling Center Assessment of Psychological Symptoms–34 (CCAPS-34). Measurement and Evaluation in Counseling and Development, 45(3), 151-169. https://doi.org/10.1177/0748175611432642
39.
MansfieldA. J.WilliamsJ.HouraniL. L.BabeuL. A. (2010). Measurement invariance of posttraumatic stress disorder symptoms among US military personnel. Journal of Traumatic Stress, 23(1), 91-99. https://doi.org/10.1002/jts.20492.
40.
MarshH. W.MorinA. J.ParkerP. D.KaurG. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10, 85-110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
41.
MattocksK. M.HaskellS. G.KrebsE. E.JusticeA. C.YanoE. M.BrandtC. (2012). Women at war: Understanding how women veterans cope with combat and military sexual trauma. Social Science & Medicine, 74(4), 537-545. https://doi.org/10.1016/j.socscimed.2011.10.039
42.
McDonaldS. D.BeckhamJ. C.MoreyR.MarxC.TuplerL. A.CalhounP. S. (2008). Factorial invariance of posttraumatic stress disorder symptoms across three veteran samples. Journal of Traumatic Stress, 21(3), 309-317. https://doi.org/10.1002/jts.20344
43.
MeadeA. W.JohnsonE. C.BraddyP. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93(3), 568-592. https://doi.org/10.1037/0021-9010.93.3.568
NelsonK. M.StarkebumG. A.ReiberG. E. (2007). Veterans using and uninsured Veterans not using Veterans Affairs (VA) health care. Public Health Reports, 122(1), 93-100. https://doi.org/10.1177%2F003335490712200113
47.
NormanG. (2010). Likert scales, levels of measurement and the “laws” of statistics. Advances in Health Sciences Education, 15(5), 625-632. https://doi.org/10.1007/s10459-010-9222-y
48.
OsmanA.DownsW. R.BarriosF. X.KopperB. A.GutierrezP. M.ChirosC. E. (1997). Factor structure and psychometric characteristics of the Beck Depression Inventory-II. Journal of Psychopathology and Behavioral Assessment, 19(4), 359-376. https://doi.org/10.1007/BF02229026
PosnerS.StewartA.MarinG.Perez-StableE. (2001). Factor variability of the Center for Epidemiological Studies of Depression Scale (CES-D) among urban Latinos. Ethnicity & Health, 6I(2), 137-144. https://doi.org/10.1080/13557850120068469
51.
RadloffL. S. (1977). The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385-401. https://doi.org/10.1177/014662167700100306
Rivera-MedinaC. L.CaraballoJ. N.Rodríguez-CorderoE. R.BernalG.Dávila-MarreroE. (2010). Factor structure of the CES-D and measurement invariance across gender for low-income Puerto Ricans in a probability sample. Journal of Consulting and Clinical Psychology, 78(3), 398-408. https://doi.org/10.1037/a0019054
54.
RuddM. D.GouldingJ.BryanC. J. (2011). Student veterans: A national survey exploring psychological symptoms and suicide risk. Professional Psychology: Research and Practice, 42(5), 354-360. https://doi.org/10.1037/a0025164
55.
Schermelleh-EngelK.MoosbruggerH.MüllerH. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8(2), 23-74.
56.
StanleyI. H.Buchman-SchmittJ. M.ChuC.RogersM. L.GaiA. R.WagnerR. K.GutierrezP. M.JoinerT. E. (2019). The Military Suicide Research Consortium Common Data Elements: An examination of measurement invariance across current service members and veterans. Assessment, 26(6), 963-975. https://doi.org/10.1177/1073191118777635
57.
TanielianT.JaycoxL. H.SchellT. L.MarshallG. M.BurnamM. A.EibnerC.KarneyB.MeredithL. S.RingelJ. S.VaianaM. E. (2008). Invisible wounds of war: Summary and recommendations for addressing psychological and cognitive injuries. RAND Corp. https://doi.org/10.7249/MG720.1
VandenbergR. J.LanceC. E. (2000). A review and synthesis of the measurement Invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4-70. https://doi.org/10.1177%2F109442810031002
60.
WeathersF. W.LitzB. T.HuskaJ. A.KeaneT. M. (1994). The PTSD Checklist-Civilian Version (PCL-C). National Center for PTSD.
61.
WhismanM. A.JuddC. M.WhitefordN. T.GelhornH. L. (2013). Measurement invariance of the Beck Depression Inventory–Second edition (BDI-II) across gender, race, and ethnicity in college students. Assessment, 20(4), 419-428. https://doi.org/10.1177/1073191112460273
62.
WhitemanS. D.BarryA. E. (2011). A comparative analysis of student service member/veteran and civilian student drinking motives. Journal of Student Affairs Research and Practice, 48(3), 297-313. https://doi.org/10.2202/1949-6605.6322
63.
WidamanK. F.EarlyD. R.CongerR. D. (2013). Special populations. In LittleT. (Ed.), The Oxford handbook of quantitative methods: Volume 1: Foundations (pp. 55-81). Oxford University Press.
64.
WidamanK. F.ReiseS. P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281-324). American Psychological Association. https://doi.org/10.1037/10222-009
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
