The Beck Scale for Suicide Ideation (BSS) is one of the most used and empirically supported suicide risk assessment measures for behavioral health clinicians and researchers. However, the 19-item BSS is a relatively long measure and can take 5 to 10 minutes to administer. This study used Item Response Theory (IRT) techniques across two samples of mostly U.S. military service members to first identify (n1 = 1,899) and then validate (n2 = 757) an optimized set of the most informative BSS items. Results indicated that Items 1, 2, 4, 6, and 15 provided a similar-shaped test information curve across the same range of the latent trait as the full-length BSS and showed reliable item functioning across participant characteristics. The sum score of these five items showed a linear score linkage with the full-scale score, ρ > 0.87, and was equally as sensitive as the full scale for prospectively predicting near-term suicidal behavior at 74% with a cut score ≥1 (equivalent to full-scale score ≥6). Results are consistent with those from civilian samples. In time- or length-limited assessments, using these five BSS items may improve administration efficiency over the full BSS, while maintaining classification sensitivity.
This study suggests that summing Items 1, 2, 4, 6, and 15 of the Beck Scale for Suicide Ideation (BSS) is an acceptable approach for shortening the full-length measure.
BahrainiN.BahrainiN.BrennerL. A.BarryC.HostetterT.KeuschJ.PostE. P.KesslerC.SmithC.MatarazzoB. B. (2020). Assessment of rates of suicide risk screening and prevalence of positive screening results among US veterans after implementation of the veterans affairs suicide risk identification strategy. JAMA Network Open, 3(10), 1–11. https://doi.org/10.1001/jamanetworkopen.2020.22531
2.
BakerF.KimS.-H. (2004). Item response theory (2nd ed.). Marcel Dekker.
3.
BatterhamP. J.FtanouM.PirkisJ.BrewerJ. L.MackinnonA. J.BeautraisA.Fairweather-SchmidtA. K.ChristensenH. (2015). A systematic review and evaluation of measures for suicidal ideation and behaviors in population-based research. Psychological Assessment, 27(2), 501–512. https://doi.org/10.1037/pas0000053
4.
BeckA. T.KovacsM.WeissmanA. (1979). Assessment of suicidal intention: The Scale for Suicide Ideation. Journal of Consulting and Clinical Psychology, 47(2), 343–352. http://www.ncbi.nlm.nih.gov/pubmed/469082
5.
BeckA. T.SteerR. A. (1991). Beck Scale For Suicide Ideation manual (1993 ed.). Pearson.
6.
BelsherB. E.SmolenskiD. J.PruittL. D.BushN. E.BeechE. H.WorkmanD. E.MorganR. L.EvattD. P.TuckerJ.SkoppN. A. (2019). Prediction models for suicide attempts and deaths: A systematic review and simulation. JAMA Psychiatry, 76(6), 642–651. https://doi.org/10.1001/jamapsychiatry.2019.0174
BrownG. K.BeckA. T.SteerR. A.GrishamJ. R. (2000). Risk factors for suicide in psychiatric outpatients: A 20-year prospective study. Journal of Consulting and Clinical Psychology, 68(3), 371–377. https://doi.org/10.1037/0022-006X.68.3.371
9.
BrownG. K.SteerR. A.HenriquesG. R.BeckA. T. (2005). The internal struggle between the wish to die and the wish to live: A risk factor for suicide. American Journal of Psychiatry, 162(10), 1977–1979. https://doi.org/10.1176/appi.ajp.162.10.1977
10.
BrownL. A.BoudreauxE. D.AriasS. A.MillerI. W.MayA. M.CamargoC. A.BryanC. J.ArmeyM. F. (2020). C-SSRS performance in emergency department patients at high risk for suicide. Suicide and Life-Threatening Behavior, 50(6), 1097–1104. https://doi.org/10.1111/sltb.12657
11.
BryanC. J.MintzJ.ClemansT. A.BurchT. S.LeesonB.WilliamsS.RuddM. D. (2018). Effect of crisis response planning on patient mood and clinician decision making: A clinical trial with suicidal U.S. soldiers. Psychiatric Services, 69(1), 108–111. https://doi.org/10.1176/appi.ps.201700157
12.
BryanC. J.RuddM. D.PetersonA. L.Young-McCaughanS.WertenbergerE. G. (2016). The ebb and flow of the wish to live and the wish to die among suicidal military personnel. Journal of Affective Disorders, 202, 58–66. https://doi.org/10.1016/j.jad.2016.05.049
13.
CaiL.HansenM. (2013). Limited-information goodness-of-fit testing of hierarchical item factor models. British Journal of Mathematical and Statistical Psychology, 66(2), 245–276. https://doi.org/10.1111/j.2044-8317.2012.02050.x
14.
CarterG.MilnerA.McGillK.PirkisJ.KapurN.SpittalM. J. (2017). Predicting suicidal behaviours using clinical instruments: Systematic review and meta-analysis of positive predictive values for risk scales. British Journal of Psychiatry, 210(6), 387–395. https://doi.org/10.1192/bjp.bp.116.182717
ChalmersR. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06
17.
ChoiS. W.GibbonsL. E.CraneP. K. (2011). lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30. http://www.jstatsoft.org/v39/i08/
18.
CraneP. K.GibbonsL. E.JolleyL.van BelleG. (2006). Differential item functioning analysis with ordinal logistic regression techniques. Medical Care, 44(11Suppl. 3), S115–S123. https://doi.org/10.1097/01.mlr.0000245183.28384.ed
19.
De BeursD. P.De VriesA. L. M.De GrootM. H.De KeijserJ.KerkhofA. J. F. M. (2014). Applying computer adaptive testing to optimize online assessment of suicidal behavior: A simulation study. Journal of Medical Internet Research, 16(9), Article e207. https://doi.org/10.2196/jmir.3511
20.
De BeursD. P.FokkemaM.O’ConnorR. C. (2016). Optimizing the assessment of suicidal behavior: The application of curtailment techniques. Journal of Affective Disorders, 196, 218–224. https://doi.org/10.1016/j.jad.2016.02.033
21.
EmbretsonS. E.ReiseS. P. (2000). Item response theory for psychologists. Lawrence Earlbaum Associates.
22.
GaiA. R.RingerF.SchaferK.DoughertyS.SchneiderM.SoberayK. A.GutierrezP. M.JoinerT. E.ComtoisK. A.PlantE. A. (2020). The nature and structure of the Military Suicide Research Consortium’s common data elements. Military Behavioral Health, 9(2), 129–138. https://doi.org/10.1080/21635781.2020.1812454
23.
GrantC.LuskJ. (2015). A multidisciplinary approach to therapeutic risk management of the suicidal patient. Journal of Multidisciplinary Healthcare, 8, Article 291. https://doi.org/10.2147/JMDH.S50529
24.
GutierrezP. M.JoinerT. E.HansonJ.AveryK.FenderA.HarrisonT.KernsK.McGowanP.StanleyI. H.SilvaC.RogersM. L. (2021). Clinical utility of suicide behavior and ideation measures: Implications for military suicide risk assessment. Psychological Assessment, 33(1), 1–13. https://doi.org/10.1037/pas0000876
25.
GutierrezP. M.JoinerT. E.HansonJ.StanleyI. H.SilvaC.RogersM. L. (2019). Psychometric properties of four commonly used suicide risk assessment measures: Applicability to military treatment settings. Military Behavioral Health, 7(2), 177–184. https://doi.org/10.1080/21635781.2018.1562390
26.
HambletonR. K.SwaminathanH.RogersW. H. (1991). Fundamentals of item response theory. SAGE.
HarrisK. M.McLeanJ. P.SheffieldJ.JobesD. A. (2010). The internal suicide debate hypothesis: Exploring the life versus death struggle. Suicide and Life-Threatening Behavior, 40(2), 181–192. https://doi.org/10.1521/suli.2010.40.2.181
29.
HomM. A.JoinerT. E. (2017). Predictors of treatment attrition among adult outpatients with clinically significant suicidal ideation. Journal of Clinical Psychology, 73(1), 88–98. https://doi.org/10.1002/jclp.22318
30.
JobesD. A. (2016). Managing suicidal risk: A collaborative approach (2nd ed.). Guilford Press.
31.
JoinerT. E.PfaffJ. J.AcresJ. G. (2002). A brief screening tool for suicidal symptoms in adolescents and young adults in general health settings: Reliability and validity data from the Australian National General Practice Youth Suicide Prevention Project. Behaviour Research and Therapy, 40(4), 471–481. http://www.ncbi.nlm.nih.gov/pubmed/12008659
LinehanM. M.ComtoisK. A.BrownM. Z.HeardH. L.WagnerA. (2006). Suicide attempt self-injury interview (SASII): Development, reliability, and validity of a scale to assess suicide attempts and intentional self-injury. Psychological Assessment, 18(3), 303–312. https://doi.org/10.1037/1040-3590.18.3.303
35.
LouzonS. A.BossarteR.McCarthyJ. F.KatzI. R. (2016). Does suicidal ideation as measured by the PHQ-9 predict suicide among VA patients?Psychiatric Services, 67(5), 517–522. https://doi.org/10.1176/appi.ps.201500149
36.
McHughC. M.CorderoyA.RyanC. J.HickieI. B.LargeM. M. (2019). Association between suicidal ideation and suicide: Meta-analyses of odds ratios, sensitivity, specificity and positive predictive value. BJPsych Open, 5(2), 1–12. https://doi.org/10.1192/bjo.2018.88
37.
MokkenR. J. (1971). A theory and procedure of scale analysis. De Gruyter.
38.
NguyenT. H.HanH.-R.KimM. T.ChanK. S. (2014). An introduction to item response theory for patient-reported outcome measurement. The Patient—Patient-Centered Outcomes Research, 7(1), 23–35. https://doi.org/10.1007/s40271-013-0041-0
39.
NielssenO.WallaceD.LargeM. M. (2017). Pokorny’s complaint: The insoluble problem of the overwhelming number of false positives generated by suicide risk assessment. BJPsych Bulletin, 41(1), 18–20. https://doi.org/10.1192/pb.bp.115.053017
40.
OsmanA.BaggeC. L.GutierrezP. M.KonickL. C.KopperB. A.BarriosF. X. (2001). The Suicidal Behaviors Questionnaire-Revised (SBQ-R): Validation with clinical and nonclinical samples. Assessment, 8(4), 443–454. https://doi.org/10.1177/107319110100800409
PokornyA. D. (1983). Prediction of suicide in psychiatric patients. Archives of General Psychiatry, 40, 249–257.
43.
PosnerK.BrownG. K.StanleyB.BrentD. A.YershovaK. V.OquendoM. A.CurrierG. W.MelvinG. A.GreenhillL. L.ShenS.MannJ. J. (2011). The Columbia-Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. The American Journal of Psychiatry, 168(12), 1266–1277. https://doi.org/10.1176/appi.ajp.2011.10111704
44.
ReeveB. B.FayersP. (2005). Applying item response theory modeling for evaluating questionnaire item and scale properties. In FayersP.HaysR. D. (Eds.), Assessing quality of life in clinical trials: Methods of practice (pp. 55–73). Oxford University Press.
RevelleW.RocklinT. (1979). Very simple structure: An alternative procedure for estimating the optimal number of interpretable factors. Multivariate Behavioral Research, 14(4), 403–414. https://doi.org/10.1207/s15327906mbr1404_2
47.
RizopoulosD. (2006). ltm: An R package for latent variable modeling. Journal of Statistical Software, 17(5), 1–25. http://www.jstatsoft.org/v17/i05
48.
RoatenK.JohnsonC.GenzelR.KhanF.NorthC. S. (2018). Development and implementation of a Universal Suicide Risk Screening Program in a safety-net hospital system. Joint Commission Journal on Quality and Patient Safety, 44(1), 4–11. https://doi.org/10.1016/j.jcjq.2017.07.006
49.
RobinX.TurckN.HainardA.TibertiN.LisacekF.SanchezJ.-C.MüllerM. (2011). pROC: An open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 12(1), Article 77. https://doi.org/10.1186/1471-2105-12-77
50.
RosseelY. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
51.
RuddM. D.BryanC. J. (2021). The Brief Suicide Cognitions Scale: Development and clinical application. Frontiers in Psychiatry, 12, 1–10. https://doi.org/10.3389/fpsyt.2021.737393
52.
SamejimaF. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34, 1–97.
53.
SijtsmaK.MolenaarI. W. (2002). Introduction to nonparametric item response theory. SAGE.
54.
van der ArkL. A. (2012). New developments in Mokken Scale analysis in R. Journal of Statistical Software, 48(5).
55.
van SpijkerB.BatterhamP. J.CalearA. L.FarrerL.ChristensenH.ReynoldsJ.KerkhofA. J. F. M. (2014). The Suicidal Ideation Attributes Scale (SIDAS): Community-based validation study of a new scale for the measurement of suicidal ideation. Suicide and Life-Threatening Behavior, 44(4), 408–419. https://doi.org/10.1111/sltb.12084
56.
WestS. G.TaylorA. B.WuW. (2012). Model fit and model selection in structural equation modeling. In HoyleR. H. (Ed.), Handbook of structural equation modeling (pp. 209–231). Guilford Press.
WortzelH. S.MatarazzoB.HomaifarB. (2013). A model for therapeutic risk management of the suicidal patient. Journal of Psychiatric Practice, 19(4), 323–326. https://doi.org/10.1097/01.pra.0000432603.99211.e8
59.
ZumboB. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Department of National Defense, Directorate of Human Resources Research and Evaluation.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
