Moral injury (MI) is defined as the profound psychological distress experienced in response to perpetrating, failing to prevent, or witnessing acts that transgress personal moral standards or values. Given the elevated risk of adverse mental health outcomes in response to exposure to morally injurious experiences in military members, it is critical to implement valid and reliable measures of MI in military populations. We evaluated the reliability, convergent, and discriminant validity, as well as the factor structure of the commonly used Moral Injury Events Scale (MIES) across two separate active duty and released Canadian Armed Forces samples. In Study 1, convergent and discriminant validity were demonstrated through correlations between MIES scores and depression, anxiety, posttraumatic stress disorder, anger, adverse childhood experiences, and combat experiences. Across studies, internal consistency reliability was high. However, dimensionality of the MIES remained unclear, and model fit was poor across active and released Canadian Armed Forces samples. Practical and theoretical implications are discussed.
AfifiT. O.BoltonS. L.MotaN.MarrieR. A.SteinM. B.EnnsM. W.El-GabalawyR.BernsteinC. N.MackenzieC.VanTilL.MacLeanM. B.WangJ. L.PattenS.AsmundsonC. J. G.SareenJ. (2020). Rationale and methodology of the 2018 Canadian Armed Forces Members and Veterans Mental Health Follow-up Survey (CAFVMHS): A 16-year follow-up survey. Raison D’être Et Méthodologie De l’Enquête De Suivi Sur La Santé Mental Des Members Canadian Armed Forces and Veterans Affairs, 2018 (ESSMFACM). Canadian Journal of Psychiatry. Advance online publication. https://doi.org/10.1177/0706743720974837
2.
AndersonJ. C.GerbingD. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49(2), 155-173. https://doi.org/10.1007/BF02294170
BattagliaA. M.ProtopopescuA.BoydJ. E.LloydC.JetlyR.O’ConnorC.HoodH. K.NazarovA.RhindS. G.LaniusR. A.McKinnonM. C. (2019). The relation between adverse childhood experiences and moral injury in the Canadian Armed Forces. European Journal of Psychotraumatology, 10(1), Article 1546084. https://doi.org/10.1080/20008198.2018.1546084
5.
BlevinsC. A.WeathersF. W.DavisM. T.WitteT. K.DominoJ. L. (2015). The Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): Development and initial psychometric evaluation. Journal of Traumatic Stress, 28(6), 489-498. https://doi.org/10.1002/jts.22059
6.
BrowneM. W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111-150. https://doi.org/10.1207/S15327906MBR3601_05
7.
BryanA. O.BryanC. J.MorrowC. E.EtienneN.Ray-SannerudB. (2014). Moral injury, suicidal ideation, and suicide attempts in a military sample. Traumatology, 20(3), 154-160. https://doi.org/10.1037/h0099852
8.
BryanC. J.BryanA. B. O.AnestisM. D.AnestisJ. C.GreenB. A.EtienneN.MorrowC. E.Ray-SannerudB. (2016). Measuring moral injury: Psychometric Properties of the Moral Injury Events Scale in two military samples. Assessment, 23(5), 557-570. https://doi.org/10.1177/1073191115590855
9.
ComreyA.LeeH. (1992). A first course in factor analysis (2nd ed.). Lawrence Erlbaum.
10.
CurrierJ. M.FarnsworthJ. K.DrescherK. D.McDermottR. C.SimsB. M.AlbrightD. L. (2017). Development and evaluation of the Expressions of Moral Injury Scale–Military Version. Clinical Psychology & Psychotherapy, 25(3), 474-488. https://doi.org/10.1002/cpp.2170
11.
CurrierJ. M.HollandJ. M.DrescherK.FoyD. (2015). Initial psychometric evaluation of the Moral Injury Questionnaire–Military Version. Clinical Psychology & Psychotherapy, 22(1), 54-63. https://doi.org/10.1002/cpp.1866
12.
DrescherK. D.FoyD. W.KellyC.LeshnerA.SchutzK.LitzB. (2011). An exploration of the viability and usefulness of the construct of moral injury in war veterans. Traumatology, 17(1), 8-13. https://doi.org/10.1177/1534765610395615
13.
EdmondsonD.ChaudoirS. R.MillsM. A.ParkC. L.HolubJ.BartkowiakJ. M. (2011). From shattered assumptions to weakened worldviews: Trauma symptoms signal anxiety buffer disruption. Journal of Loss and Trauma, 16(4), 358-385. https://doi.org/10.1080/15325024.2011.572030
FelittiV. J.AndaR. F.NordenbergD.WilliamsonD. F.SpitzA. M.EdwardsV.KossM. P.MarksJ. S. (1998). Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults: The Adverse Childhood Experiences (ACE) Study. American Journal of Preventive Medicine, 14(4), 245-258. https://doi.org/10.1016/S0749-3797(98)00017-8
16.
FerrajãoP. C.OliveiraR. A. (2014). Self-awareness of mental states, self-integration of personal schemas, perceived social support, posttraumatic and depression levels, and moral injury: A mixed-method study among Portuguese war veterans. Traumatology, 20(4), 277-285. https://doi.org/10.1037/trm0000016
17.
ForbesD.AlkemadeN.HopcraftD.HawthorneG.O’HalloranP.ElhaiJ. D.McHughT.BatesG.NovacoR. W.BryantR.LewisV. (2014). Evaluation of the Dimensions of Anger Reactions-5 (DAR-5) Scale in combat veterans with posttraumatic stress disorder. Journal of Anxiety Disorders, 28(8), 830-835. https://doi.org/10.1016/j.janxdis.2014.09.015
18.
FrankfurtS.FrazierP. (2016). A review of research on moral injury in combat veterans. Military Psychology, 28(5), 318-330. https://doi.org/10.1037/mil0000132
19.
GriffinB. J.PurcellN.BurkmanK.LitzB. T.BryanC. J.SchmitzM.VilliermeC.WalshJ.MaguenS. (2019). Moral injury: An integrative review. Journal of Traumatic Stress, 32(3), 350-362. https://doi.org/10.1002/jts.22362
20.
GuykerW. M.DonnellyK.DonnellyJ. P.DunnamM.WarnerG. C.KittlesonJ.BradshawC. B.AltM.MeierS. T. (2013). Dimensionality, reliability, and validity of the combat experiences scale. Military Medicine, 178(4), 377-384. https://doi.org/10.7205/MILMED-D-12-00223
21.
HermidaR. (2015). The problem of allowing correlated errors in structural equation modeling: Concerns and considerations. Computational Methods in Social Sciences, 3(1), 5-17. https://ideas.repec.org/a/ntu/ntcmss/vol3-iss1-15-005.html
22.
HornJ. (1965). A rationale and test for the number of factors in factor analysis. Psychometrica, 30(2), 179-185. https://doi.org/10.1007/BF02289447
23.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
24.
IBM Corp. (2019). IBM SPSS Statistics for Windows (Ver. 26.0). Author.
25.
JamiesonN.UsherK.MapleM.RatnarajahD. (2020). Invisible wounds and suicide: Moral injury and veteran mental health. International Journal of Mental Health Nursing, 29(2), 105-109. https://doi.org/10.1111/inm.12704
KlineR. (2011). Methodology in the social sciences: Principles and practice of structural equation modeling (3rd ed.). Guilford Press.
28.
KoenigH. G.AmesD.YoussefN. A.OliverJ. P.VolkF.TengE. J.HaynesK.EricksonZ. D.ArnoldI.O’GaroK.PearceM. (2017). The Moral Injury Symptom Scale–Military Version. Journal of Religion and Health, 57(1), 249-265. https://doi.org/10.1007/s10943-017-0531-9
29.
KoenigH. G.YoussefN. A.PearceM. (2019). Assessment of moral injury in veterans and active duty military personnel with PTSD: A review. Frontiers in Psychiatry, 10, 443. https://doi.org/10.3389/fpsyt.2019.00443
30.
KroenkeK.SpitzerR. L.WilliamsJ. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606-613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
31.
LancasterS. L.HarrisJ. I. (2018). Measures of morally injurious experiences: A quantitative comparison. Psychiatry Research, 264(June), 15-19. https://doi.org/10.1016/j.psychres.2018.03.057
32.
LandisR.EdwardsB.CortinaJ. (2009). On the practice of allowing correlated residuals among indicators in structural equation models. In LanceC. E.VandenbergR. J. (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 193-214). Routledge/Taylor & Francis Group.
33.
LewisH. B. (1971). Shame and guilt in neurosis. Psychoanalytic Review, 58(3), 419-438.
34.
LitzB. T.SteinN.DelaneyE.LebowitzL.NashW. P.SilvaC.MaguenS. (2009). Moral injury and moral repair in war veterans: A preliminary model and intervention strategy. Clinical Psychology Review, 29(8), 695-706. https://doi.org/10.1016/j.cpr.2009.07.003
35.
LöweB.DeckerO.MüllerS.BrählerE.SchellbergD.HerzogW.HerzbergP. Y. (2008). Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Medical Care, 46(3), 266-274. https://doi.org/10.1097/MLR.0b013e318160d093
36.
MarshH. W.HauK. T.BallaJ. R.GraysonD. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33(2), 181-220. https://doi.org/10.1207/s15327906mbr3302_1
37.
MarshH. W.MorinA. J. S.ParkerP. D.KaurG. (2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10, 85-110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
38.
MazzaG. L.EndersC. K.RuehlmanL. S. (2015). Addressing item-level missing data: A comparison of proration and full information maximum likelihood estimation. Multivariate Behavioral Research, 50(5), 504-519. https://doi.org/10.1080/00273171.2015.1068157
39.
MerrickM. T.FordD. C.PortsK. A.GuinnA. S. (2018). Prevalence of adverse childhood experiences from the 2011-2014 Behavioral Risk Factor Surveillance System in 23 States. JAMA Pediatrics, 172(11), 1038-1044. https://doi.org/10.1001/jamapediatrics.2018.2537
40.
MuthénB. O.AsparouhovT. (2002). Using Mplus monte carlo simulations in practice: A note on assessing estimation quality and power in latent variable models (Mplus Web Notes No. 1). https://www.statmodel.com/download/webnotes/mc1.pdf
NashW. P.Marino CarperT. L.Alice MillsM.AuT.GoldsmithA.LitzB. T. (2013). Psychometric evaluation of the moral injury events scale. Military Medicine, 178(6), 646-652. https://doi.org/10.7205/MILMED-D-13-00017
43.
NazarovA.FikretogluD.LiuA.RichardsonJ. D.ThompsonM. (2020). Help-seeking for mental health issues in deployed Canadian Armed Forces personnel at risk for moral injury. European Journal of Psychotraumatology, 11(1), Article 1729032. https://doi.org/10.1080/20008198.2020.1729032
44.
NazarovA.FikretogluD.LiuA.ThompsonM.ZamorskiM. A. (2018). Greater prevalence of post-traumatic stress disorder and depression in deployed Canadian Armed Forces personnel at risk for moral injury. Acta Psychiatrica Scandinavica, 137(4), 342-354. https://doi.org/10.1111/acps.12866
45.
NazarovA.JetlyR.McNeelyH.KiangM.LaniusR.McKinnonM. C. (2015). Role of morality in the experience of guilt and shame within the armed forces. Acta Psychiatrica Scandinavica, 132(1), 4-19. https://doi.org/10.1111/acps.12406
46.
NazarovA.WalaszczykV.FrewenP.OremusC.LaniusR.McKinnonM. C. (2016). Moral reasoning in women with posttraumatic stress disorder related to childhood abuse. European Journal of Psychotraumatology, 7(1), Article 31028. https://doi.org/10.3402/ejpt.v7.31028
47.
NovacoR. W.SwansonR. D.GonzalezO. I.GahmG. A.RegerM. D. (2012). Anger and postcombat mental health: Validation of a brief anger measure with U.S. Soldiers postdeployed from Iraq and Afghanistan. Psychological Assessment, 24(3), 661-675. https://doi.org/10.1037/a0026636
48.
ParentM. C. (2013). Handling item-level missing data: Simpler is just as good. The Counseling Psychologist, 41(4), 568-600. https://doi.org/10.1177/0011000012445176
49.
R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
50.
RevelleW (2021). psych: Procedures for psychological, psychometric, and personality research (R package version 2.1.3) [Computer software]. Northwestern University. https://CRAN.R-project.org/package=psych
51.
RichardsonC. B.ChesnutR. P.MorganN. R.BleserJ. A.PerkinsD. F.VogtD.CopelandL. A.FinleyE. (2020). Examining the factor structure of the Moral Injury Events Scale in a Veteran Sample. Military Medicine, 185(1-2), E75-E83. https://doi.org/10.1093/milmed/usz129
52.
RobinsonM. A. (2018). Using multi-item psychometric scales for research and practice in human resource management. Human Resource Management, 57(3), 739-750. https://doi.org/10.1002/hrm.21852
53.
SAS Inc. (2019). SAS 9.4 Statements: Reference. SAS Institute Inc.
54.
SpitzerR. L.KroenkeK.WilliamsJ. B. W.LöweB. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092-1097. https://doi.org/10.1001/archinte.166.10.1092
55.
SpitzerR. L.KroenkeK.WilliamsJ. B., & Patient Health Questionnaire Primary Care Study Group. (1999). Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. JAMA, 282(18), 1737-1744. https://doi.org/10.1001/jama.282.18.1737
WiscoB. E.MarxB. P.MayC. L.MartiniB.KrystalJ. H.SouthwickS. M.PietrzakR. H. (2017). Moral injury in U.S. combat veterans: Results from the national health and resilience in veterans study. Depression & Anxiety, 34(4), 340-347. https://doi.org/10.1002/da.22614
58.
WiscoB. E.MarxB. P.MillerM. W.WolfE. J.MotaN. P.KrystalJ. H.SouthwickS. M.PietrzakR. H. (2016). Probable posttraumatic stress disorder in the US veteran population according to DSM-5: Results from the National Health and Resilience in Veterans Study. Journal of Clinical Psychiatry, 77(11), 1503-1510. https://doi.org/10.4088/JCP.15m10188
59.
YeterianJ. D.BerkeD. S.CarneyJ. R.McIntyre-SmithA.St. CyrK.KingL.KlineN. K.PhelpsA.LitzB. T., & Members of the Moral Injury Outcomes Project Consortium. (2019). Defining and measuring moral injury: Rationale, design, and preliminary findings from the moral injury outcome scale consortium. Journal of Traumatic Stress, 32(3), 363-372. https://doi.org/10.1002/jts.22380
60.
YongA.PearceS. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94. https://doi.org/10.20982/tqmp.09.2.p079
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
