Evaluating suicidal ideation in young people seeking mental health treatment is an important component of clinical assessment and treatment planning. To reduce the burden of youth suicide, we need to improve our understanding of suicidal ideation, its underlying constructs, and how ideation translates into suicidal behaviour. Using exploratory factor analysis, we investigated the dimensionality of the Suicidal Ideation Questionnaire (SIQ) among 273 participants aged 15–25 with Major Depressive Disorder. Area under the receiver operating characteristic curve (AUROC) analysis was used to explore associations between latent factors and actual suicidal behaviour. Findings suggested that the SIQ assesses multiple factors underlying suicidal ideation. AUROC analyses demonstrated that latent factors relating to both active and passive suicidal ideation predicted past-month suicidal behaviour and suicide attempt. These findings contribute to an improved understanding of the complexities of suicidal ideation and relationships with suicidal behaviour in young people with depression.
Abdel-KhalekA.LesterD. (2007). The psychometric properties and correlates of the Reynolds' suicide ideation questionnaire with Kuwaiti and American students. Archives of Suicide Research, 11, 309–319.
2.
AdrianM.MillerA. B.McCauleyE.Vander StoepA. (2016). Suicidal ideation in early to middle adolescence: Sex-specific trajectories and predictors. Journal of Child Psychology and Psychiatry, 57, 645–653.
3.
BabchishinK. M.HelmusL. M. (2016). The influence of base rates on correlations: An evaluation of proposed alternative effect sizes with real-world data. Behavior Research Methods, 48, 1021–1031.
4.
BastoM.PereiraJ. M. (2012). An SPSS R-menu for ordinal factor analysis. Journal of Statistical Software, 46, 1–29.
5.
BeckA. T.KovacsM.WeissmanA. (1979). Assessment of suicidal intention: The scale for suicide ideation. Journal of Consulting and Clinical Psychology, 47, 343–352.
6.
BerkM.MohebbiM.DeanO. M.CottonS. M.ChanenA. M.DoddS.RatheeshA.AmmingerG. P.PhelanM.WellerA.MackinnonA.GiorlandoF.BairdS.IncertiL.BrodieR. E.Ferguson, N. O.RiceS.SchaferM. R.MullenE.HetrickS. (2020). Youth depression alleviation with anti-inflammatory agents (YoDA-A): A randomised clinical trial of rosuvastatin and aspirin. BMC Medicine, 18, 16.
7.
BoegeI.CorpusN.SchepkerR.FegertJ. M. (2014). Pilot study: Feasibility of using the suicidal ideation questionnaire (SIQ) during acute suicidal crisis. Child and Adolescent Psychiatry and Mental Health, 8, 28.
8.
BorgesG.AngstJ.NockM. K.RuscioA. M.KesslerR. C. (2008). Risk factors for the incidence and persistence of suicide-related outcomes: A 10-year follow-up study using the national comorbidity surveys. Journal of Affective Disorders, 105, 25–33.
9.
BrásM. S. V.CarmoC. I. G.de JesusS. N. (2021). Reasons for living inventory for adolescents: Psychometric properties among Portuguese adolescents. OMEGA, 82, 527–547.
10.
BridgeJ. A.GoldsteinT. R.BrentD. A. (2006). Adolescent suicide and suicidal behavior. Journal of Child Psychology Psychiatry, 47, 372–394.
11.
BrowneM. W.CudeckR. (1992). Alternative ways of assessing model fit. Sociological Methods and Research, 21, 230–258.
12.
CarterG.MilnerA.McGillK.PirkisJ.KapurN.SpittalM. J. (2017). Predicting suicidal behaviours using clinical instruments: Systematic review and meta-analysis of positive predictive values for risk scales. The British Journal of Psychiatry, 210, 387–395.
13.
CashS. J.BridgeJ. A. (2009). Epidemiology of youth suicide and suicidal behavior. Current Opinion in Pediatrics, 21, 613–619.
14.
CassadyJ. C.CrossT. L. (2006). A factorial representation of suicidal ideation among academically gifted adolescents. Journal for the Education of the Gifted, 29, 290–304.
15.
ChaC. B.FranzP. J.GuzmánM. E.GlennC. R.KleimanE. M.NockM. K. (2018). Annual research review: Suicide among youth–epidemiology, (potential) etiology, and treatment. Journal of Child Psychology and Psychiatry, 59, 460–482.
16.
ChenF.CurranP. J.BollenK. A.KirbyJ.PaxtonP. (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods and Research, 36, 462–494.
17.
ChildD. (2006). The essentials of factor analysis (3rd ed.). Continuum International Publishing Group.
18.
CostelloA. B.OsborneJ. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10, 7.
19.
CronbachL. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.
20.
CzyzE. K.BeronaJ.KingC. A. (2015). A prospective examination of the interpersonal-psychological theory of suicidal behavior among psychiatric adolescent inpatients. Suicide and Life-Threatening Behavior, 45, 243–259.
21.
CzyzE. K.KingC. A.Nahum-ShaniI. (2018). Ecological assessment of daily suicidal thoughts and attempts among suicidal teens after psychiatric hospitalization: Lessons about feasibility and acceptability. Psychiatry Research, 267, 566–574.
22.
DaveyC. G.ChanenA. M.CottonS. M.HetrickS. E.KerrM. J.BerkM.DeanO. M.YuenK.PhelanM.RatheeshA.SchaferM. R.AmmingerG. P.ParkerA. G.PiskulicD.HarriganS.MackinnonA. J.HarrisonB. J.McGorryP. D. (2014). The addition of fluoxetine to cognitive behavioural therapy for youth depression (YoDA-C): Study protocol for a randomised control trial. Trials, 15, 425.
23.
DaveyC.G.ChanenA.M.HetrickS.E.CottonS.M.RatheeshA.AmmingerG.P.KoutsogiannisJ.PhelanM.MullenE.HarrisonB. J.RiceS.ParkerA. G.DeanO. M.WellerA.KerrM.QuinnA. L.CataniaL.KazantzisN.McGorryP. D.BerkM. (2019). The addition of fluoxetine to cognitive behavioural therapy for youth depression (YoDA-C): A randomised, double-blind, placebo-controlled, multicentre clinical trial. Lancet Psychiatry, 6, 735–744.
24.
De LeoD.CerinE.SpathonisK.BurgisS. (2005). Lifetime risk of suicide ideation and attempts in an Australian community: Prevalence, suicidal process, and help-seeking behaviour. Journal of Affective Disorders, 86, 215–224.
25.
EvansE.HawtonK.RodhamK.DeeksJ. (2005). The prevalence of suicidal phenomena in adolescents: A systematic review of population-based studies. Suicide and Life Threatening Behavior, 35, 239–250.
26.
FabrigarL. R.WegenerD. T.MacCallumR. C.StrahanE. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272.
27.
FirstM. B.SpitzerR. L.WilliamsJ.GibbonM. (1997). Structured clinical interview for DSM-IV axis I disorders (SCID-I): User’s guide and interview. American Psychiatric Association Press.
28.
FranklinJ. C.RibeiroJ. D.FoxK. R.BentleyK. H.KleimanE. M.HuangX.MusacchioK. M.JaroszewskiA. C.ChangB. P.NockM. K. (2017). Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychological Bulletin, 143, 187–232.
29.
GarridoL. E.AbadF. J.PonsodaV. (2011). Performance of Velicer’s minimum average partial factor retention method with categorical variables. Educational and Psychological Measurement, 71, 551–570.
30.
GarridoL. E.AbadF. J.PonsodaV. (2013). A new look at Horn’s parallel analysis with ordinal variables. Psychological Methods, 18, 454.
31.
GeoffroyM. C.OrriM.GirardA.PerretL. C.TureckiG. (2020). Trajectories of suicide attempts from early adolescence to emerging adulthood: Prospective 11-year follow-up of a Canadian cohort. Psychological Medicine, 51, 1–11.
32.
GhasemiP.ShaghaghiA.AllahverdipourH. (2015). Measurement scales of suicidal ideation and attitudes: A systematic review article. Health Promot Perspect, 5, 156–168.
33.
GipsonP. Y.AgarwalaP.OppermanK. J.HorwitzA.KingC. A. (2015). Columbia-suicide severity rating scale: Predictive validity with adolescent psychiatric emergency patients. Pediatric Emergency Care, 31, 88–94.
34.
GoldstonD. B.ErkanliA.DanielS. S.HeilbronN.WellerB. E.DoyleO. (2016). Developmental trajectories of suicidal thoughts and behaviors from adolescence through adulthood. Journal of the American Academy of Child and Adolescent Psychiatry, 55, 400–407.
35.
GolinoH.MoulderR.ShiD.ChristensenA. P.GarridoL. E.NietoM. D.NesselroadeJ.SadanaR.ThiyagarajanJ. A.BokerS. M. (2020). Entropy fit indices: New fit measures for assessing the structure and dimensionality of multiple latent variables. Multivariate Behavioral Research, 56, 874–902.
36.
GolinoH. F.EpskampS. (2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLoS ONE, 12, e0174035.
37.
GoodfellowB.KolvesK.de LeoD. (2018). Contemporary nomenclatures of suicidal behaviors: A systematic literature review. Suicide and Life Threatening Behavior, 48, 353–366.
38.
GoodfellowB.KõlvesK.De LeoD. (2020). Contemporary classifications of suicidal behaviors: A systematic literature review. Crisis, 41, 179.
39.
GrimmondJ.KornhaberR.VisentinD.ClearyM. (2019). A qualitative systematic review of experiences and perceptions of youth suicide. PLoS ONE, 14, e0217568.
40.
GutierrezP. M.OsmanA. (2009). Getting the best return on your screening investment: An analysis of the Suicidal Ideation Questionnaire and Reynolds Adolescent Depression Scale. School Psychology Review, 38, 200–217.
41.
HaertelE. (1985). Construct validity and criterion-referenced testing. Review of Educational Research, 55, 23–46.
42.
HairJ. F.BlackW. C.BabinB. J.AndersonR. E. (2014). Multivariate data analysis (new international edition). PearsonPearson Education Limited.
43.
HarrisK.HaddockG.PetersS.GoodingP. (2021). Psychometric properties of the Suicidal Ideation Attributes Scale (SIDAS) in a longitudinal sample of people experiencing non-affective psychosis. BMC Psychiatry, 21(1). https://doi.org/10.1186/s12888-021-03639-8
HayashiK.YuanK.-H. (2012). Exploratory factor analysis. In SalkindN. J. (Ed.), Encyclopedia of research design (pp. 459–465). SAGE Publications, Inc.
46.
HetrickS. E.GaoC. X.FiliaK. M.MenssinkJ. M.RickwoodD. J.HerrmanH.HickieI.McGorryP.TelfordN.ParkerA. G.CottonS. M. (2021). Validation of a brief tool to assess and monitor suicidal ideation: The Youth Suicide Ideation Screen (YSIS-3). Journal of Affective Disorders, 295, 235–242.
47.
HetrickS. E.ParkerA. G.RobinsonJ.HallN.VanceA. (2012). Predicting suicidal risk in a cohort of depressed children and adolescents. Crisis, 33, 13–20.
48.
Holgado–TelloF. P.Chacón–MoscosoS.Barbero–GarcíaI.Vila–AbadE. (2010). Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Quality & Quantity, 44, 153.
49.
HowardM. C. (2016). A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve?International Journal of Human-Computer Interaction, 32, 51–62.
50.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.
51.
Huth-BocksA. C.KerrD. C.IveyA. Z.KramerA. C.KingC. A. (2007). Assessment of psychiatrically hospitalized suicidal adolescents: Self-report instruments as predictors of suicidal thoughts and behavior. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 387–395.
52.
JiaC.-X.WangX.-T.ZhaoZ.-T. (2014). Psychometric properties of the Suicidal Ideation Questionnaire among Chinese high school students. OMEGA, 70, 195–207.
53.
JoinerT. E.Van OrdenK. A.WitteT. K.SelbyE. A.RibeiroJ. D.LewisR.RuddM. D. (2009). Main predictions of the interpersonal-psychological theory of suicidal behavior: Empirical tests in two samples of young adults. Journal of Abnormal Psychology, 118, 634–646.
54.
KahlB. L.MillerH. M.CairnsK.GiniunasH.NicholasM. (2020). Evaluation of ReachOut.com, an unstructured digital youth mental health intervention: Prospective cohort study. JMIR Mental Health, 7, e21280.
55.
KaiserH. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20, 141–151.
56.
KeithT. Z.CaemmererJ. M.ReynoldsM. R. (2016). Comparison of methods for factor extraction for cognitive test-like data: Which overfactor, which underfactor?Intelligence, 54, 37–54.
57.
KesslerR. C.BossarteR. M.LuedtkeA.ZaslavskyA. M.ZubizarretaJ. R. (2020). Suicide prediction models: A critical review of recent research with recommendations for the way forward. Molecular Psychiatry, 25, 168–179.
58.
KleimanE. M.TurnerB. J.FedorS.BealeE. E.HuffmanJ. C.NockM. K. (2017). Examination of real-time fluctuations in suicidal ideation and its risk factors: Results from two ecological momentary assessment studies. Journal of Abnormal Psychology, 126, 726–738.
59.
KlonskyE. D.SafferB. Y.BryanC. J. (2018). Ideation-to-action theories of suicide: A conceptual and empirical update. Current Opinion in Psychology, 22, 38–43.
60.
LewinsohnP. M.RohdeP.SeeleyJ. R. (1996). Adolescent suicidal ideation and attempts: Prevalence, risk factors, and clinical implications. Clinical Psychology: Science and Practice, 3, 25–36.
61.
MadanA.FruehB. C.AllenJ. G.EllisT. E.RufinoK. A.OldhamJ. M.FowlerJ. C. (2016). Psychometric reevaluation of the columbia-suicide severity rating scale: Findings from a prospective, inpatient cohort of severely mentally ill adults. The Journal of Clinical Psychiatry, 77, e867–873.
62.
MazzaJ. J.ReynoldsW. M. (1998). A longitudinal investigation of depression, hopelessness, social support, and major and minor life events and their relation to suicidal ideation in adolescents. Suicide and Life Threatening Behavior, 28, 358–374.
63.
McHughC. M.CorderoyA.RyanC. J.HickieI. B.LargeM. M. (2019). Association between suicidal ideation and suicide: meta-analyses of odds ratios, sensitivity, specificity and positive predictive value. BJPsych Open, 5(2E18), 1–12.
64.
MillerA. B.PrinsteinM. J. (2019). Adolescent suicide as a failure of acute stress-response systems. Annual Review of Clinical Psychology, 15, 425–450.
65.
MontgomeryS. A.ÅsbergM. (1979). A new depression scale designed to be sensitive to change. The British Journal of Psychiatry, 134, 382–389.
O'CarrollP. W.BermanA. L.MarisR. W.MoscickiE. K.TanneyB. L.SilvermanM. M. (1996). Beyond the tower of babel: A nomenclature for suicidology. Suicide and Life Threatening Behavior, 26, 237–252.
68.
O'ConnorR. C.KirtleyO. J. (2018). The integrated motivational-volitional model of suicidal behaviour. Philosophical Transactions of the Royal Society B: Biological Sciences, 373, 20170268.
69.
O'ConnorR. C.PortzkyG. (2018). Looking to the future: A synthesis of new developments and challenges in suicide research and prevention. Frontiers in Psychology, 9, 2139.
70.
PintoA.WhismanM. A.McCoyK. J. (1997). Suicidal ideation in adolescents: Psychometric properties of the suicidal ideation questionnaire in a clinical sample. Psychological Assessment, 9, 63.
71.
PosnerK.BrownG. K.StanleyB.BrentD. A.YershovaK. V.OquendoM. A.CurrierG. W.MelvinG. A.GreenhillL.ShenS.MannJ. J. (2011). The columbia-suicide severity rating scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. The American Journal of Psychiatry, 168, 1266–1277.
72.
PotardC.KubiszewskiV.GimenesG.CourtoisR. (2014). Validation of the French version of the suicidal ideation questionnaire among adolescents. Psychiatry Research, 215, 471–476.
73.
QuinnA. L.DeanO. M.DaveyC. G.KerrM.HarriganS. M.CottonS. M.ChanenA. M.DoddS.RatheeshA.AmmingerG. P.PhelanM.WilliamsA.MackinnonA.GiorlandoF.BairdS.RiceS.O'SheaM.SchaferM. R.MullenE.HetrickS. (2018). Youth depression alleviation-augmentation with an anti-inflammatory agent (YoDA-A): Protocol and rationale for a placebo-controlled randomized trial of rosuvastatin and aspirin. Early Intervention in Psychiatry, 12, 45–54.
74.
R Core Team. (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
75.
RevelleW. (2020). psych: Procedures for psychological, psychometric, and personality research. Northwestern University.
76.
ReynoldsW. (1988). Suicidal ideation questionnaire: Professional manual. Psychological Assessment Resources.
77.
RiceM. E.HarrisG. T. (2005). Comparing effect sizes in follow-up studies: ROC area, cohen's d, and r. Law and Human Behavior, 29, 615–620.
78.
RiceS. M.SimmonsM. B.BaileyA. P.ParkerA. G.HetrickS. E.DaveyC. G.PhelanM.BlaikieS.EdwardsJ. (2014) Development of practice principles for the management of ongoing suicidal ideation in young people diagnosed with major depressive disorder. SAGE Open Medicine, 2, 2050312114559574.
79.
Rodríguez-QuirogaA.FlamariqueI.Castro-FornielesJ.LievesleyK.BuitelaarJ. K.CoghillD.Díaz-CanejaC. M.DittmannR. W.GuptaA.HoekstraP. J.KehrmannL.LlorenteC.Purper-OuakilD.SchulzeU. M. E.ZuddasA.SalaR.SinghJ.FioriF.ArangoC.SantoshP. (2020). Development and psychometric properties of the “suicidality: Treatment occurring in paediatrics (STOP) risk and resilience factors scales” in adolescents. European Child & Adolescent Psychiatry, 29, 153–165.
80.
RushA. J.BernsteinI. H.TrivediM. H.CarmodyT. J.WisniewskiS.MundtJ. C.Shores-WilsonK.BiggsM. M.WooA.NierenbergA. A.FavaM. (2006). An evaluation of the quick inventory of depressive symptomatology and the Hamilton rating scale for depression: A sequenced treatment alternatives to relieve depression trial report. Biological Psychiatry, 59, 493–501.
81.
SchwarzN. (2007). Retrospective and concurrent self-reports: The rationale for real-time data capture. In StoneA.AtienzaS. S. S. A.NebelingL. (Eds.), The science of real-time data capture: Self-reports in health research (pp. 11–26). Oxford University Press.
82.
ShiD.Maydeu-OlivaresA.DiStefanoC. (2018). The relationship between the standardized root mean square residual and model misspecification in factor Analysis models. Multivariate Behavioral Research, 53, 676–694.
83.
SiddawayA. P.Holm-DenomaJ.WitteT. K.RuscioJ. (2021). Reexamining the latent structure of suicidal thoughts using taxometric analysis: Implications for testing ideation to action theoretical models of suicidal thoughts and behavior. Psychological Assessment, 33, 243–254.
84.
SmithJ. M.AlloyL. B.AbramsonL. Y. (2006). Cognitive vulnerability to depression, rumination, hopelessness, and suicidal ideation: Multiple pathways to self-injurious thinking. Suicide and Life Threatening Behavior, 36, 443–454.
85.
TemplemanR.WongS. (1994). Determining the factor structure of the psychopathy checklist: A converging approach. Multivariate Experimental Clinical Research, 10, 157–166.
86.
TranT.LuoW.PhungD.HarveyR.BerkM.KennedyR. L.VenkateshS. (2014). Risk stratification using data from electronic medical records better predicts suicide risks than clinician assessments. BMC Psychiatry, 14, 76.
87.
Van OrdenK. A.WitteT. K.CukrowiczK. C.BraithwaiteS. R.SelbyE. A.JoinerT. E.Jr. (2010). The interpersonal theory of suicide. Psychological Review, 117, 575–600.
88.
van SpijkerB. A.BatterhamP. J.CalearA. L.FarrerL.ChristensenH.ReynoldsJ.KerkhofA. J. (2014). The suicidal ideation attributes scale (SIDAS): Community-based validation study of a new scale for the measurement of suicidal ideation. Suicide and Life Threatening Behavior, 44, 408–419.
89.
WalentynowiczM.SchneiderS.StoneA. A. (2018). The effects of time frames on self-report. PLoS ONE, 13, e0201655.
90.
WatkinsM. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44, 219–246.
91.
WatsonJ. C. (2017). Establishing evidence for internal structure using exploratory factor analysis. Measurement and Evaluation in Counseling and Development, 50, 232–238.
92.
World Health Organization. (2019). Suicide in the world: Global health estimates. World Health Organization.
93.
WorthingtonR. L.WhittakerT. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34, 806–838.
94.
XiaY.YangY. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51, 409–428.
95.
YangH. (2012). Factor loadings. In SalkindN. J. (Ed.), Encyclopedia of research design (pp. 481–483). SAGE Publications, Inc.
96.
YoungstromE. A.HameedA.MitchellM. A.Van MeterA. R.FreemanA. J.AlgortaG. P.WhiteA. M.ClaytonP. J.GelenbergA. J.MeyerR. E. (2015). Direct comparison of the psychometric properties of multiple interview and patient-rated assessments of suicidal ideation and behavior in an adult psychiatric inpatient sample. The Journal of Clinical Psychiatry, 76, 1676–1682.
97.
ZhangY.YipP. S.FuK. W. (2014). Validation of the Chinese version of the Reynolds' suicidal ideation questionnaire: Psychometric properties and its short version. Health Qual Life Outcomes, 12, 33.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
