Optimizing the Beck Scale for Suicide Ideation: An Item Response Theory Approach Among U.S. Military Personnel

Abstract

The Beck Scale for Suicide Ideation (BSS) is one of the most used and empirically supported suicide risk assessment measures for behavioral health clinicians and researchers. However, the 19-item BSS is a relatively long measure and can take 5 to 10 minutes to administer. This study used Item Response Theory (IRT) techniques across two samples of mostly U.S. military service members to first identify (n₁ = 1,899) and then validate (n₂ = 757) an optimized set of the most informative BSS items. Results indicated that Items 1, 2, 4, 6, and 15 provided a similar-shaped test information curve across the same range of the latent trait as the full-length BSS and showed reliable item functioning across participant characteristics. The sum score of these five items showed a linear score linkage with the full-scale score, ρ > 0.87, and was equally as sensitive as the full scale for prospectively predicting near-term suicidal behavior at 74% with a cut score ≥1 (equivalent to full-scale score ≥6). Results are consistent with those from civilian samples. In time- or length-limited assessments, using these five BSS items may improve administration efficiency over the full BSS, while maintaining classification sensitivity.

This study suggests that summing Items 1, 2, 4, 6, and 15 of the Beck Scale for Suicide Ideation (BSS) is an acceptable approach for shortening the full-length measure.

Keywords

screening risk assessment IRT BSS SSI

Get full access to this article

View all access options for this article.

References

Bahraini

Brenner

L. A.

Barry

Hostetter

Keusch

Post

E. P.

Kessler

Smith

Matarazzo

B. B.

(2020). Assessment of rates of suicide risk screening and prevalence of positive screening results among US veterans after implementation of the veterans affairs suicide risk identification strategy. JAMA Network Open, 3(10), 1–11. https://doi.org/10.1001/jamanetworkopen.2020.22531

Baker

Kim

S.-H.

(2004). Item response theory (2nd ed.). Marcel Dekker.

Batterham

P. J.

Ftanou

Pirkis

Brewer

J. L.

Mackinnon

A. J.

Beautrais

Fairweather-Schmidt

A. K.

Christensen

(2015). A systematic review and evaluation of measures for suicidal ideation and behaviors in population-based research. Psychological Assessment, 27(2), 501–512. https://doi.org/10.1037/pas0000053

Beck

A. T.

Kovacs

Weissman

(1979). Assessment of suicidal intention: The Scale for Suicide Ideation. Journal of Consulting and Clinical Psychology, 47(2), 343–352. http://www.ncbi.nlm.nih.gov/pubmed/469082

Beck

A. T.

Steer

R. A.

(1991). Beck Scale For Suicide Ideation manual (1993 ed.). Pearson.

Belsher

B. E.

Smolenski

D. J.

Pruitt

L. D.

Bush

N. E.

Beech

E. H.

Workman

D. E.

Morgan

R. L.

Evatt

D. P.

Tucker

Skopp

N. A.

(2019). Prediction models for suicide attempts and deaths: A systematic review and simulation. JAMA Psychiatry, 76(6), 642–651. https://doi.org/10.1001/jamapsychiatry.2019.0174

Brown

G. K.

(2000). A review of suicide assessment measures for intervention research with adults and older adults. https://www.sprc.org/resources-programs/review-suicide-assessment-measures-intervention-research-adults-older-adults

Brown

G. K.

Beck

A. T.

Steer

R. A.

Grisham

J. R.

(2000). Risk factors for suicide in psychiatric outpatients: A 20-year prospective study. Journal of Consulting and Clinical Psychology, 68(3), 371–377. https://doi.org/10.1037/0022-006X.68.3.371

Brown

G. K.

Steer

R. A.

Henriques

G. R.

Beck

A. T.

(2005). The internal struggle between the wish to die and the wish to live: A risk factor for suicide. American Journal of Psychiatry, 162(10), 1977–1979. https://doi.org/10.1176/appi.ajp.162.10.1977

10.

Brown

L. A.

Boudreaux

E. D.

Arias

S. A.

Miller

I. W.

May

A. M.

Camargo

C. A.

Bryan

C. J.

Armey

M. F.

(2020). C-SSRS performance in emergency department patients at high risk for suicide. Suicide and Life-Threatening Behavior, 50(6), 1097–1104. https://doi.org/10.1111/sltb.12657

11.

Bryan

C. J.

Mintz

Clemans

T. A.

Burch

T. S.

Leeson

Williams

Rudd

M. D.

(2018). Effect of crisis response planning on patient mood and clinician decision making: A clinical trial with suicidal U.S. soldiers. Psychiatric Services, 69(1), 108–111. https://doi.org/10.1176/appi.ps.201700157

12.

Bryan

C. J.

Rudd

M. D.

Peterson

A. L.

Young-McCaughan

Wertenberger

E. G.

(2016). The ebb and flow of the wish to live and the wish to die among suicidal military personnel. Journal of Affective Disorders, 202, 58–66. https://doi.org/10.1016/j.jad.2016.05.049

13.

Cai

Hansen

(2013). Limited-information goodness-of-fit testing of hierarchical item factor models. British Journal of Mathematical and Statistical Psychology, 66(2), 245–276. https://doi.org/10.1111/j.2044-8317.2012.02050.x

14.

Carter

Milner

McGill

Pirkis

Kapur

Spittal

M. J.

(2017). Predicting suicidal behaviours using clinical instruments: Systematic review and meta-analysis of positive predictive values for risk scales. British Journal of Psychiatry, 210(6), 387–395. https://doi.org/10.1192/bjp.bp.116.182717

15.

Carter

Spittal

M. J.

(2018). Suicide risk assessment. Crisis, 39(4), 229–234. https://doi.org/10.1027/0227-5910/a000558

16.

Chalmers

R. P.

(2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06

17.

Choi

S. W.

Gibbons

L. E.

Crane

P. K.

(2011). lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30. http://www.jstatsoft.org/v39/i08/

18.

Crane

P. K.

Gibbons

L. E.

Jolley

van Belle

(2006). Differential item functioning analysis with ordinal logistic regression techniques. Medical Care, 44(11 Suppl. 3), S115–S123. https://doi.org/10.1097/01.mlr.0000245183.28384.ed

19.

De Beurs

D. P.

De Vries

A. L. M.

De Groot

M. H.

De Keijser

Kerkhof

A. J. F. M

. (2014). Applying computer adaptive testing to optimize online assessment of suicidal behavior: A simulation study. Journal of Medical Internet Research, 16(9), Article e207. https://doi.org/10.2196/jmir.3511

20.

De Beurs

D. P.

Fokkema

O’Connor

R. C

. (2016). Optimizing the assessment of suicidal behavior: The application of curtailment techniques. Journal of Affective Disorders, 196, 218–224. https://doi.org/10.1016/j.jad.2016.02.033

21.

Embretson

S. E.

Reise

S. P.

(2000). Item response theory for psychologists. Lawrence Earlbaum Associates.

22.

Gai

A. R.

Ringer

Schafer

Dougherty

Schneider

Soberay

K. A.

Gutierrez

P. M.

Joiner

T. E.

Comtois

K. A.

Plant

E. A.

(2020). The nature and structure of the Military Suicide Research Consortium’s common data elements. Military Behavioral Health, 9(2), 129–138. https://doi.org/10.1080/21635781.2020.1812454

23.

Grant

Lusk

(2015). A multidisciplinary approach to therapeutic risk management of the suicidal patient. Journal of Multidisciplinary Healthcare, 8, Article 291. https://doi.org/10.2147/JMDH.S50529

24.

Gutierrez

P. M.

Joiner

T. E.

Hanson

Avery

Fender

Harrison

Kerns

McGowan

Stanley

I. H.

Silva

Rogers

M. L.

(2021). Clinical utility of suicide behavior and ideation measures: Implications for military suicide risk assessment. Psychological Assessment, 33(1), 1–13. https://doi.org/10.1037/pas0000876

25.

Gutierrez

P. M.

Joiner

T. E.

Hanson

Stanley

I. H.

Silva

Rogers

M. L.

(2019). Psychometric properties of four commonly used suicide risk assessment measures: Applicability to military treatment settings. Military Behavioral Health, 7(2), 177–184. https://doi.org/10.1080/21635781.2018.1562390

26.

Hambleton

R. K.

Swaminathan

Rogers

W. H.

(1991). Fundamentals of item response theory. SAGE.

27.

Haney

O’Neil

Carson

Low

Peterson

Denneson

Oleksiewicz

Kansagara

(2012). Suicide risk factors and risk assessment tools: A systematic review. https://www.hsrd.research.va.gov/publications/esp/suicide-risk.pdf

28.

Harris

K. M.

McLean

J. P.

Sheffield

Jobes

D. A.

(2010). The internal suicide debate hypothesis: Exploring the life versus death struggle. Suicide and Life-Threatening Behavior, 40(2), 181–192. https://doi.org/10.1521/suli.2010.40.2.181

29.

Hom

M. A.

Joiner

T. E.

(2017). Predictors of treatment attrition among adult outpatients with clinically significant suicidal ideation. Journal of Clinical Psychology, 73(1), 88–98. https://doi.org/10.1002/jclp.22318

30.

Jobes

D. A.

(2016). Managing suicidal risk: A collaborative approach (2nd ed.). Guilford Press.

31.

Joiner

T. E.

Pfaff

J. J.

Acres

J. G.

(2002). A brief screening tool for suicidal symptoms in adolescents and young adults in general health settings: Reliability and validity data from the Australian National General Practice Youth Suicide Prevention Project. Behaviour Research and Therapy, 40(4), 471–481. http://www.ncbi.nlm.nih.gov/pubmed/12008659

32.

The Joint Commission. (2019). National Patient Safety Goal for suicide prevention (R³ Report). https://www.jointcommission.org/-/media/tjc/documents/resources/patient-safety-topics/suicide-prevention/r3_18_suicide_prevention_hap_bhc_5_6_19_rev5.pdf

33.

Kroenke

Spitzer

R. L.

Williams

J. B. W.

(2001). The PHQ-9. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x

34.

Linehan

M. M.

Comtois

K. A.

Brown

M. Z.

Heard

H. L.

Wagner

(2006). Suicide attempt self-injury interview (SASII): Development, reliability, and validity of a scale to assess suicide attempts and intentional self-injury. Psychological Assessment, 18(3), 303–312. https://doi.org/10.1037/1040-3590.18.3.303

35.

Louzon

S. A.

Bossarte

McCarthy

J. F.

Katz

I. R.

(2016). Does suicidal ideation as measured by the PHQ-9 predict suicide among VA patients? Psychiatric Services, 67(5), 517–522. https://doi.org/10.1176/appi.ps.201500149

36.

McHugh

C. M.

Corderoy

Ryan

C. J.

Hickie

I. B.

Large

M. M.

(2019). Association between suicidal ideation and suicide: Meta-analyses of odds ratios, sensitivity, specificity and positive predictive value. BJPsych Open, 5(2), 1–12. https://doi.org/10.1192/bjo.2018.88

37.

Mokken

R. J.

(1971). A theory and procedure of scale analysis. De Gruyter.

38.

Nguyen

T. H.

Han

H.-R.

Kim

M. T.

Chan

K. S.

(2014). An introduction to item response theory for patient-reported outcome measurement. The Patient—Patient-Centered Outcomes Research, 7(1), 23–35. https://doi.org/10.1007/s40271-013-0041-0

39.

Nielssen

Wallace

Large

M. M.

(2017). Pokorny’s complaint: The insoluble problem of the overwhelming number of false positives generated by suicide risk assessment. BJPsych Bulletin, 41(1), 18–20. https://doi.org/10.1192/pb.bp.115.053017

40.

Osman

Bagge

C. L.

Gutierrez

P. M.

Konick

L. C.

Kopper

B. A.

Barrios

F. X.

(2001). The Suicidal Behaviors Questionnaire-Revised (SBQ-R): Validation with clinical and nonclinical samples. Assessment, 8(4), 443–454. https://doi.org/10.1177/107319110100800409

41.

Podlogar

M. C.

Joiner

T. E.

(2020). Allowing for nondisclosure in high suicide risk groups. Assessment, 27(3), 547–559. https://doi.org/10.1177/1073191119845495

42.

Pokorny

A. D.

(1983). Prediction of suicide in psychiatric patients. Archives of General Psychiatry, 40, 249–257.

43.

Posner

Brown

G. K.

Stanley

Brent

D. A.

Yershova

K. V.

Oquendo

M. A.

Currier

G. W.

Melvin

G. A.

Greenhill

L. L.

Shen

Mann

J. J.

(2011). The Columbia-Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. The American Journal of Psychiatry, 168(12), 1266–1277. https://doi.org/10.1176/appi.ajp.2011.10111704

44.

Reeve

B. B.

Fayers

(2005). Applying item response theory modeling for evaluating questionnaire item and scale properties. In Fayers

Hays

R. D.

(Eds.), Assessing quality of life in clinical trials: Methods of practice (pp. 55–73). Oxford University Press.

45.

Revelle

(2019). psych: Procedures for psychological, psychometric, and personality research. https://cran.r-project.org/package=psych

46.

Revelle

Rocklin

(1979). Very simple structure: An alternative procedure for estimating the optimal number of interpretable factors. Multivariate Behavioral Research, 14(4), 403–414. https://doi.org/10.1207/s15327906mbr1404_2

47.

Rizopoulos

(2006). ltm: An R package for latent variable modeling. Journal of Statistical Software, 17(5), 1–25. http://www.jstatsoft.org/v17/i05

48.

Roaten

Johnson

Genzel

Khan

North

C. S.

(2018). Development and implementation of a Universal Suicide Risk Screening Program in a safety-net hospital system. Joint Commission Journal on Quality and Patient Safety, 44(1), 4–11. https://doi.org/10.1016/j.jcjq.2017.07.006

49.

Robin

Turck

Hainard

Tiberti

Lisacek

Sanchez

J.-C.

Müller

(2011). pROC: An open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 12(1), Article 77. https://doi.org/10.1186/1471-2105-12-77

50.

Rosseel

(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

51.

Rudd

M. D.

Bryan

C. J.

(2021). The Brief Suicide Cognitions Scale: Development and clinical application. Frontiers in Psychiatry, 12, 1–10. https://doi.org/10.3389/fpsyt.2021.737393

52.

Samejima

(1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34, 1–97.

53.

Sijtsma

Molenaar

I. W.

(2002). Introduction to nonparametric item response theory. SAGE.

54.

van der Ark

L. A

. (2012). New developments in Mokken Scale analysis in R. Journal of Statistical Software, 48(5).

55.

van Spijker

Batterham

P. J.

Calear

A. L.

Farrer

Christensen

Reynolds

Kerkhof

A. J. F. M

. (2014). The Suicidal Ideation Attributes Scale (SIDAS): Community-based validation study of a new scale for the measurement of suicidal ideation. Suicide and Life-Threatening Behavior, 44(4), 408–419. https://doi.org/10.1111/sltb.12084

56.

West

S. G.

Taylor

A. B.

(2012). Model fit and model selection in structural equation modeling. In Hoyle

R. H.

(Ed.), Handbook of structural equation modeling (pp. 209–231). Guilford Press.

57.

Wickham

(2016). ggplot2: Elegant graphics for data analysis. Springer. https://ggplot2.tidyverse.org/

58.

Wortzel

H. S.

Matarazzo

Homaifar

(2013). A model for therapeutic risk management of the suicidal patient. Journal of Psychiatric Practice, 19(4), 323–326. https://doi.org/10.1097/01.pra.0000432603.99211.e8

59.

Zumbo

B. D.

(1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Department of National Defense, Directorate of Human Resources Research and Evaluation.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.13 MB