Restricted accessResearch articleFirst published online 2024
New Psychometric Evidence of the Grief Impairment Scale (GIS) in People Who Have Experienced the Death of a Loved One From a Network Psychometric Approach in Two Latin American Countries
This study aimed to evaluate the psychometric properties of the Grief Impairment Scale (GIS) using a network psychometric model. A total of 1048 individuals from Peru and El Salvador participated. A network psychometric model was used to determine internal structure, reliability, and cross-country invariance. The results indicate that the GIS items were grouped into a single network structure through Exploratory Graph Analysis. Reliability was estimated by structural consistency, and it was found that when replicating the network structure within an empirical dimension, a single network structure was consistently obtained, and all items remained stable. Furthermore, the network structure was invariant, thus functioning similarly across the different country groups. In conclusion, the GIS presented solid psychometric evidence of validity based on its internal structure, reliability, and cross-country invariance. Therefore, the GIS is a psychometrically sound measure of functional impairment symptoms due to grief for Peruvian and Salvadoran individuals.
BorsboomD. (2008). Psychometric perspectives on diagnostic systems. Journal of Clinical Psychology, 64(9), 1089–1108. https://doi.org/10.1002/jclp.20503
3.
BorsboomD.MellenberghG. J.van HeerdenJ. (2003). The theoretical status of latent variables. Psychological Review, 110(2), 203–219. https://doi.org/10.1037/0033-295X.110.2.203
BreenL. J.LeeS. A.NeimeyerR. A. (2021). Psychological risk factors of functional impairment after COVID-19 deaths. Journal of Pain and Symptom Management, 61(4), e1–e4. https://doi.org/10.1016/j.jpainsymman.2021.01.006
6.
Caycho-RodríguezT.Baños-ChaparroJ.Ventura-LeónJ.LeeS. A.VilcaL. W.Carbajal-LeónC.Yupanqui-LorenzoD. E.ValenciaP. D.Reyes-BossioM.Oré-KovacsN.Rojas-JaraC.GallegosM.Polanco-CarrascoR.CervigniM.MartinoP.Lobos-RiveraM. E.Moreta-HerreraR.Palacios SeguraD. A.Samaniego-PinhoA.Hualparuca-OliveraL. (2024b). Pandemic grief and suicidal ideation in Latin American countries: A network analysis. Psychological Reports, 00332941241231209. https://doi.org/10.1177/00332941241231209
7.
Caycho-RodríguezT.Baños-ChaparroJ.Ventura-LeónJ.VilcaL. W.Carbajal-LeónC.ValenciaP. D.Yupanqui-LorenzoD. E.Paredes-AngelesR.Arias GallegosW. L.Reyes-BossioM.Delgado-CampusanoM.GallegosM.Rojas-JaraC.Polanco-CarrascoR.CervigniM.MartinoP.Lobos-RiveraM. E.Moreta-HerreraR.Palacios SeguraD. A.Ayala-ColquiJ. (2023e). Network analysis of posttraumatic growth dimensions: A cross-sectional study in people who experienced the death of a loved one from COVID-19 in 16 Latin American countries. Illness, Crisis, and Loss, 10541373231208934. https://doi.org/10.1177/10541373231208934
8.
Caycho-RodríguezT.LeeS. A.VilcaL. W.Lobos-RiveraM. E.Flores-MonterrosaA. N.Tejada RodríguezJ. C.Chacón-AndradeE. R.Marroquín-CarpioW. C.Carbajal-LeónC.Reyes-BossioM.Delgado-CampusanoM.ToralesJ.ToralesJ. (2023a). A psychometric analysis of the Spanish version of the grief impairment scale: A screening tool of biopsychosocial grief-related functional impairment in a Salvadoran sample. Omega, 00302228231175383. https://doi.org/10.1177/00302228231175383
9.
Caycho-RodríguezT.Travezaño-CabreraA.ToralesJ.BarriosI.VilcaL. W.Samaniego-PinhoA.Moreta-HerreraR.Reyes-BossioM.Barria-AsenjoN.Ayala-ColquiJ.Garcia-CadenaC. H. (2024a). Psychometric network analysis of the Patient Health Questionnaire-4 (PHQ-4) in Paraguayan general population. Psicologia: Reflexão e Crítica: revista semestral do Departamento de Psicologia da UFRGS, 37(1), 15. https://doi.org/10.1186/s41155-024-00299-x
10.
Caycho-RodríguezT.ValenciaP. D.VilcaL. W.Carbajal-LeónC.Vivanco-VidalA.Saroli-AraníbarD.Reyes-BossioM.WhiteM.Rojas-JaraC.Polanco-CarrascoR.GallegosM.CervigniM.MartinoP.PalaciosD. A.Moreta-HerreraR.Samaniego-PinhoA.Lobos-RiveraM. E.FigaresA. B.Puerta-CortésD. X.Flores-MendozaC. (2023c). Cross-cultural validation of the new version of the Coronavirus Anxiety Scale in twelve Latin American countries. Current Psychology, 42(34), 1–18. https://doi.org/10.1007/s12144-021-02563-0
11.
Caycho-RodríguezT.ValenciaP. D.VilcaL. W.LeeS. A.Carbajal-LeónC.Vivanco-VidalA.Saroli-AraníbarD.Reyes-BossioM.WhiteM.Rojas-JaraC.Polanco-CarrascoR.GallegosM.CervigniM.MartinoP.PalaciosD. A.Moreta-HerreraR.Samaniego-PinhoA.RiveraM. E. L.FigaresA. B.GallegosW. L. A. (2023d). COVID-19 bereavement in ten Latin American countries: Measurement invariance of the pandemic grief scale and its relation to suicidal ideation. Omega, 88(2), 591–619. https://doi.org/10.1177/00302228211048566
12.
Caycho-RodríguezT.Ventura-LeónJ.Sánchez CarlessiH. H.Reyes RomeroC.Matos RamírezP.LeeS. A.BarriosI.ToralesJ.VilcaL. W.Carbajal-LeónC.Hualparuca-OliveraL.Hualparuca-OliveraL. (2023b). Network structure of bereavement functional impairment symptoms measured by the grief impairment scale in a Peruvian sample. Illness, Crisis. and Loss, 10541373231191245. https://doi.org/10.1177/10541373231191245
13.
Caycho-RodríguezT.VilcaL. W.Peña-CaleroB. N.Barboza-PalominoM.WhiteM.Reyes-BossioM. (2022a). Measurement of coronaphobia in older adults: Validation of the Spanish version of the coronavirus anxiety scale. Revista espanola de geriatria y gerontologia, 57(1), 20–27. https://doi.org/10.1016/j.regg.2021.09.001
14.
ChristensenA. P. (2020). Towards a network psychometrics approach to assessment: Simulations for redundancy, dimensionality, and loadings (Unpublished doctoral dissertation). University of North Carolina at Greensboro. https://doi.org/10.31234/osf.io/84kgd
15.
ChristensenA. P. (2023). Unidimensional community detection: A Monte Carlo simulation, grid search, and comparison. OSF. https://doi.org/10.31234/OSF.IO/EP3VX
16.
ChristensenA. P.GarridoL. E.Guerra-PeñaK.GolinoH. (2023). Comparing community detection algorithms in psychometric networks: A Monte Carlo simulation. Behavior Research Methods, 56(3), 1485–1505. https://doi.org/10.3758/s13428-023-02106-4
17.
ChristensenA. P.GolinoH. (2021a). Estimating the stability of psychological dimensions via bootstrap exploratory graph analysis: A Monte Carlo simulation and tutorial. Psych, 3(3), 479–500. https://doi.org/10.3390/PSYCH3030032
18.
ChristensenA. P.GolinoH. (2021b). On the equivalency of factor and network loadings. Behavior Research Methods, 53(4), 1563–1580. https://doi.org/10.3758/s13428-020-01500-6
19.
ChristensenA. P.GolinoH.SilviaP. J. (2020). A psychometric network perspective on the validity and validation of personality trait questionnaires. European Journal of Personality, 34(6), 1095–1108. https://doi.org/10.1002/per.2265
20.
ConstantinM. A.SchuurmanN. K.VermuntJ. K. (2023). A general Monte Carlo method for sample size analysis in the context of network models.Psychological Methods. Advance online publication. https://doi.org/10.1037/met0000555
21.
CostantiniG.PeruginiM. (2012). The definition of components and the use of formal indexes are key steps for a successful application of network analysis in personality psychology. European Journal of Personality, 26(4), 434–435. https://doi.org/10.1002/per.1869
22.
CramerA. O.Van der SluisS.NoordhofA.WichersM.GeschwindN.AggenS. H.KendlerK. S.BorsboomD.BorsboomD. (2012). Dimensions of normal personality as networks in search of equilibrium: You can't like parties if you don't like people. European Journal of Personality, 26(4), 414–431. https://doi.org/10.1002/per.1866
23.
DiasS. F.GomesA. A.EspieC. A.Ruivo MarquesD. (2023). Analysis of the psychometric properties of the glasgow sleep effort scale through classical test theory, item response theory, and network analysis. Sleep and Vigilance, 7(1), 65–77. https://doi.org/10.1007/s41782-023-00229-4
FinneyS. J.DiStefanoC. (2006). Nonnormal and categorical data in structural equation modeling. In HancockG. R.MuellerR. O. (Hrsg.). Structural equation modeling: A second course (pp. 269–314). Information Age Publishing.
28.
FirstM. B.ReedG. M.HymanS. E.SaxenaS. (2015). The development of the ICD‐11 clinical descriptions and diagnostic guidelines for mental and behavioural disorders. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 14(1), 82–90. https://doi.org/10.1002/wps.20189
29.
FriedmanJ.HastieT.TibshiraniR. (2008). Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9(3), 432–441. https://doi.org/10.1093/biostatistics/kxm045
30.
GallagherM. W.ZvolenskyM. J.LongL. J.RogersA. H.GareyL. (2020). The impact of Covid-19 experiences and associated stress on anxiety, depression, and functional impairment in American adults. Cognitive Therapy and Research, 44(6), 1043–1051. https://doi.org/10.1007/s10608-020-10143-y
31.
GentryJ. W.KennedyP. F.PaulK.HillR. P. (1995). The vulnerability of those grieving the death of a loved one: Implications for public policy. Journal of Public Policy and Marketing, 14(1), 128–142. https://doi.org/10.1177/074391569501400112
32.
GiraudC.TsybakovA. (2012). Discussion: Latent variable graphical model selection via convex optimization. Annals of Statistics, 40(4), 1984–1988. https://www.jstor.org/stable/41806523
33.
GolinoH. F.DemetriouA. (2017). Estimating the dimensionality of intelligence like data using Exploratory Graph Analysis. Intelligence, 62, 54–70. https://doi.org/10.1016/j.intell.2017.02.007
34.
GolinoH. F.EpskampS. (2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLoS One, 12(6), Article e0174035. https://doi.org/10.1371/journal.pone.0174035
35.
HudsonG.ChristensenA. P. (2024). EGAnet: Exploratory Graph Analysis – a framework for estimating the number of dimensions in multivariate data using network psychometrics. R package version. https://r-ega.net
JamisonL.GolinoH.ChristensenA. P. (2022). Metric invariance in exploratory graph analysis via permutation testing. PsyArXiv. https://doi.org/10.31234/osf.io/j4rx9
38.
KeithT. Z.CaemmererJ. M.ReynoldsM. R. (2016). Comparison of methods for factor extraction for cognitive test-like data: Which overfactor, which underfactor?Intelligence, 54, 37–54. https://doi.org/10.1016/j.intell.2015.11.003
39.
KimJ.TolW. A.ShresthaA.KafleH. M.RayamajhiR.LuitelN. P.ThapaL.SurkanP. J. (2017). Persistent complex bereavement disorder and culture: Early and prolonged grief in Nepali widows. Psychiatry, 80(1), 1–16. https://doi.org/10.1080/00332747.2016.1213560
40.
KristensenP.WeisæthL.HussainA.HeirT. (2015). Prevalence of psychiatric disorders and functional impairment after loss of a family member: A longitudinal study after the 2004 tsunami. Depression and Anxiety, 32(1), 49–56. https://doi.org/10.1002/da.22269
41.
LeeS. A.NeimeyerR. A. (2022). Pandemic grief scale: A screening tool for dysfunctional grief due to a COVID-19 loss. Death Studies, 46(1), 14–24. https://doi.org/10.1080/07481187.2020.1853885
42.
LeeS. A.NeimeyerR. A. (2023). Grief impairment scale: A biopsychosocial measure of grief-related functional impairment. Death Studies, 47(5), 519–530. https://doi.org/10.1080/07481187.2022.2113605
43.
LichtenthalW. G.MaciejewskiP. K.Craig DemirjianC.RobertsK. E.FirstM. B.KissaneD. W.NeimeyerR. A.BreitbartW.SlivjakE.JankauskaiteG.NapolitanoS.MaerckerA.PrigersonH. G.PrigersonH. G. (2018). Evidence of the clinical utility of a prolonged grief disorder diagnosis. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 17(3), 364–365. https://doi.org/10.1002/wps.20544
44.
LundP. C. (2021). Deconstructing grief: A sociological analysis of prolonged grief disorder. Social Theory & Health, 19(2), 186–200. https://doi.org/10.1057/s41285-020-00135-z
45.
MaccallumF.BryantR. A. (2020). A network approach to understanding quality of life impairments in prolonged grief disorder. Journal of Traumatic Stress, 33(1), 106–115. https://doi.org/10.1002/jts.22383
46.
MagnavitaN.ChiorriC. (2022). Development and validation of a new measure of work annoyance using a psychometric network approach. International Journal of Environmental Research and Public Health, 19(15), 9376. https://doi.org/10.3390/ijerph19159376
47.
McFarlaneA. C. (1988). The international classification of impairments, disabilities and handicaps: Its usefulness in classifying and understanding biopsychosocial phenomena. Australian and New Zealand Journal of Psychiatry, 22(1), 31–42. https://doi.org/10.1080/00048678809158942
48.
MundtJ. C.MarksI. M.ShearM. K.GreistJ. H. (2002). The work and social adjustment scale: A simple measure of impairment in functioning. The British Journal of Psychiatry: Journal of Mental Science, 180(5), 461–464. https://doi.org/10.1192/bjp.180.5.461
49.
NeimeyerR. A.KlassD.DennisM. R. (2014). A social constructionist account of grief: Loss and the narration of meaning. Death Studies, 38(6–10), 485–498. https://doi.org/10.1080/07481187.2014.913454
50.
NeimeyerR. A.LeeS. A. (2022). Circumstances of the death and associated risk factors for severity and impairment of COVID-19 grief. Death Studies, 46(1), 34–42. https://doi.org/10.1080/07481187.2021.1896459
51.
NielsenM. K.ChristensenK. S.NeergaardM. A.BidstrupP. E.GuldinM. B. (2020). Exploring functional impairment in light of prolonged grief disorder: A prospective, population-based cohort study. Frontiers in Psychiatry, 11, 537674. https://doi.org/10.3389/fpsyt.2020.537674
52.
Pablos-MéndezA.VegaJ.ArangurenF. P.TabishH.RaviglioneM. C. (2020). Covid-19 in Latin America. BMJ (Clinical Research ed.), 370, m2939. https://doi.org/10.1136/bmj.m2939
53.
PonsP.LatapyM. (2006). Computing communities in large networks using random walks. Journal of Graph Algorithms and Applications, 10(2), 191–218. https://doi.org/10.7155/jgaa.00124
54.
PrigersonH. G.BoelenP. A.XuJ.SmithK. V.MaciejewskiP. K. (2021). Validation of the new DSM‐5‐TR criteria for prolonged grief disorder and the PG‐13‐Revised (PG‐13‐R) scale. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 20(1), 96–106. https://doi.org/10.1002/wps.20823
55.
RodriguezP.HolowkaD. W.MarxB. P. (2012). Assessment of posttraumatic stress disorder-related functional impairment: A review. Journal of Rehabilitation Research and Development, 49(5), 649–665. https://doi.org/10.1682/jrrd.2011.09.0162
56.
Rojas-MendozaE.Alania-MarinV.Travezaño-CabreraA. (2024). New psychometric evidence from the Revised Mental Health Inventory (R-MHI-5) in Peruvian adolescents from a network psychometrics approach. BMC psychology, 12(1), 52. https://doi.org/10.1186/s40359-024-01543-w
57.
R Studio Team. (2021). A language and environment for statistical computing. R Foundation for Statistical Computing.
58.
SchmittmannV. D.CramerA. O.WaldorpL. J.EpskampS.KievitR. A.BorsboomD. (2013). Deconstructing the construct: A network perspective on psychological phenomena. New Ideas in Psychology, 31(1), 43–53. https://doi.org/10.1016/j.newideapsych.2011.02.007
59.
Serpa-BarrientosA.Pérez-FloresE. G.SaintilaJ. (2023). Psychometric network analysis of the problematic pornography use scale (PPUS) in Peruvian adults. Psychology Research and Behavior Management, 16, 1331–1341. https://doi.org/10.2147/PRBM.S398503
60.
SilvermanG. S.BaroillerA.HemerS. R. (2021). Culture and grief: Ethnographic perspectives on ritual, relationships and remembering. Death Studies, 45(1), 1–8. https://doi.org/10.1080/07481187.2020.1851885
61.
SimonN. M.HoeppnerS. S.LubinR. E.RobinaughD. J.MalgaroliM.NormanS. B.AciernoR.GoetterE. M.HellbergS. N.CharneyM. E.BuiE.BakerA. W.SmithE.KimH. M.RauchS. A. M.RauchS. A. (2020). Understanding the impact of complicated grief on combat related posttraumatic stress disorder, guilt, suicide, and functional impairment in a clinical trial of post‐9/11 service members and veterans. Depression and Anxiety, 37(1), 63–72. https://doi.org/10.1002/da.22911
62.
SmidG. E.GroenS.de la RieS. M.KooperS.BoelenP. A. (2018). Toward cultural assessment of grief and grief-related psychopathology. Psychiatric Services, 69(10), 1050–1052. https://doi.org/10.1176/appi.ps.201700422
63.
StroebeM. S.HanssonR. O.StroebeW.SchutH. (2001a). Introduction: Concepts and issues in contemporary research on grief. In StroebeM. S.HanssonR. O.StroebeW.SchutH. (Eds.). Handbook of grief research: Consequences, coping, and care (pp. 3–22). American Psychological Association. https://doi.org/10.1037/10436-031
64.
ÜstünB.KennedyC. (2009). What is “functional impairment”? Disentangling disability from clinical significance. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 8(2), 82–85. https://doi.org/10.1002/j.2051-5545.2009.tb00219.x
Ventura-LeónJ.Sánchez-VillenaA. R.Caycho-RodríguezT. (2023). Validity evidence and reliability of a subjective well-being scale: A psychometric network analysis. Trends in Psychology, 1–15. https://doi.org/10.1007/s43076-022-00251-x
67.
WeissM. D.McBrideN. M.CraigS.JensenP. (2018). Conceptual review of measuring functional impairment: Findings from the weiss functional impairment rating scale. Evidence-Based Mental Health, 21(4), 155–164. https://doi.org/10.1136/ebmental-2018-300025
68.
WongvorachanT.HeS.BulutO. (2023). A comparison of undersampling, oversampling, and SMOTE methods for dealing with imbalanced classification in educational data mining. Information, 14(1), 54. https://doi.org/10.3390/INFO14010054
ZieglerM.HagemannD. (2015). Testing the unidimensionality of items. European Journal of Psychological Assessment, 31(4), 231–237. https://doi.org/10.1027/1015-5759/a000309
