Is the Self-Evaluation of Resilience a Valid Assessment to Measure Resilience in Healthcare? A Confirmatory validation Study in Italian Healthcare Settings
Restricted accessResearch articleFirst published online December, 2023
Is the Self-Evaluation of Resilience a Valid Assessment to Measure Resilience in Healthcare? A Confirmatory validation Study in Italian Healthcare Settings
Although the Self-Evaluation of Resilience (SEOR) scale is a promising tool for assessing resilience in healthcare, its psychometric structure has not yet been confirmed. This study aimed to assess and validate the four-factor psychometric structure of the SEOR. Between September 2020 and January 2021, cross-sectional data were collected from randomly selected healthcare workers, managers, and administrators from a predefined network of 70 healthcare facilities in 12 Italian regions. The sample size was based on a Monte Carlo simulation using estimates from the SEOR developmental study. Two confirmatory factor models (first-order and second-order) were predefined. The responders (n = 199, response rate, 81%) were healthcare workers (n = 99; 49.7%), managers (n = 86; 43.2%), and administrators (n = 14; 7%). The two confirmatory factor models each showed a good fit in explaining sample statistics, corroborating the capacity of the scale to provide a total score of resilience and sub-scores for organizational resilience, network-based resilience, skill-based resilience, and individual-based resilience. The Molenaar-Sijtsma coefficients (internal consistency) ranged between 0.889 and 0.927. The SEOR enables managers and policy-makers to comprehensively screen resilience in healthcare from an epidemiological perspective.
AaseK.GuiseV.BillettS.SollidS. J. M.NjåO.RøiseO.ManserT.AndersonJ. E.WiigS. (2020). Resilience in healthcare (RiH): A longitudinal research programme protocol. BMJ Open, 10(10), Article e038779. https://doi.org/10.1136/bmjopen-2020-038779
AhernN. R.KiehlE. M.SoleM. L.ByersJ. (2006). A Review of instruments measuring resilience. Issues in Comprehensive Pediatric Nursing, 29(2), 103–125. https://doi.org/10.1080/01460860600677643
4.
AristodemouK.BuchhassL.ClaringbouldD. (2021). The COVID-19 crisis in the EU: The resilience of healthcare systems, government responses and their socio-economic effects. Eurasian Economic Review, 11(2), 251–281. https://doi.org/10.1007/s40822-020-00162-1
5.
ArsenaultC.GageA.KimM. K.KapoorN. R.AkweongoP.AmponsahF.AryalA.AsaiD.Awoonor-WilliamsJ. K.AyeleW.BedregalP.DoubovaS. V.DulalM.GadekaD. D.Gordon-StrachanG.MariamD. H.HensmanD.JosephJ. P.KaewkamjornchaiP.KrukM. E. (2022). COVID-19 and resilience of healthcare systems in ten countries. Nature Medicine, 28(6), 1314–1324. https://doi.org/10.1038/s41591-022-01750-1
6.
BraithwaiteJ.WearsR. L.HollnagelE. (2015). Resilient health care: Turning patient safety on its head. International Journal for Quality in Health Care: Journal of the International Society for Quality in Health Care, 27(5), 418–420. https://doi.org/10.1093/intqhc/mzv063
7.
BruneauM.ChangS. E.EguchiR. T.LeeG. C.O’RourkeT. D.ReinhornA. M.ShinozukaM.TierneyK.WallaceW. A.von WinterfeldtD. (2003). A framework to quantitatively assess and enhance the seismic resilience of communities. Earthquake Spectra, 19(4), 733–752. https://doi.org/10.1193/1.1623497
8.
CarusoR.FidaR.SiliA.ArrigoniC. (2016). Towards an integrated model of nursing competence: An overview of the literature reviews and concept analysis. Professioni Infermieristiche, 69(1), 35–43. Scopushttps://doi.org/10.7429/pi.2016.691035
9.
EngelsbergerA.HalvorsenB.CavanaghJ.BartramT. (2022). Human resources management and open innovation: The role of open innovation mindset. Asia Pacific Journal of Human Resources, 60(1), 194–215. https://doi.org/10.1111/1744-7941.12281
10.
FinucaneM. L.AcostaJ.WickerA.WhipkeyK. (2020). Short-term solutions to a long-term challenge: Rethinking disaster recovery planning to reduce vulnerabilities and inequities. International Journal of Environmental Research and Public Health, 17(2), 482. https://doi.org/10.3390/ijerph17020482
11.
HaldaneV.De FooC.AbdallaS. M.JungA.-S.TanM.WuS.ChuaA.VermaM.ShresthaP.SinghS.PerezT.TanS. M.BartosM.MabuchiS.BonkM.McNabC.WernerG. K.PanjabiR.NordströmA.Legido-QuigleyH. (2021). Health systems resilience in managing the COVID-19 pandemic: Lessons from 28 countries. Nature Medicine, 27(6), 964–980. https://doi.org/10.1038/s41591-021-01381-y
KanturD.İşeri-SayA. (2012). Organizational resilience: A conceptual integrative framework. Journal of Management and Organization, 18(6), 762–773. https://doi.org/10.5172/jmo.2012.18.6.762
14.
KhanM. T. I.AnwarS.SarkodieS. A.YaseenM. R.NadeemA. M.AliQ. (2022). Comprehensive disaster resilience index: Pathway towards risk-informed sustainable development. Journal of Cleaner Production, 366(15 September 2022), 132937. https://doi.org/10.1016/j.jclepro.2022.132937
15.
KotnourT.MallakL. A. (2009). From the editor: Special issue — putting culture to work in our organizations. Engineering Management Journal, 21(2), 1–2. https://doi.org/10.1080/10429247.2009.11431800
16.
KrukM. E.MyersM.VarpilahS. T.DahnB. T. (2015). What is a resilient health system? Lessons from ebola. The Lancet, 385(9980), 1910–1912. https://doi.org/10.1016/S0140-6736(15)60755-3
17.
LyngH. B.MacraeC.GuiseV.Haraldseid-DriftlandC.FagerdalB.SchibevaagL.AlsvikJ. G.WiigS. (2021). Balancing adaptation and innovation for resilience in healthcare – a metasynthesis of narratives. BMC Health Services Research, 21(1), 759. https://doi.org/10.1186/s12913-021-06592-0
18.
MagonA.ArrigoniC.FavaA.PittellaF.VillaG.DellafioreF.ConteG.CarusoR. (2021). Nursing self-efficacy for oral anticoagulant therapy management: Development and initial validation of a theory-grounded scale. Applied Nursing Research, 59, 151428. Scopushttps://doi.org/10.1016/j.apnr.2021.151428
19.
ManaraD. F.VillaG.KorelicL.ArrigoniC.DellafioreF.MilaniV.GhizzardiG.MagonA.GiannettaN.CarusoR. (2021). One-week longitudinal daily description of moral distress, coping, and general health in healthcare workers during the first wave of the covid-19 outbreak in Italy: A quantitative diary study. Acta Biomedica, 92(S6), Article e2021461. Scopushttps://doi.org/10.23750/abm.v92iS6.12313
20.
MargheritaA.HeikkiläM. (2021). Business continuity in the COVID-19 emergency: A framework of actions undertaken by world-leading companies. Business Horizons, 64(5), 683–695. https://doi.org/10.1016/j.bushor.2021.02.020
21.
MartinelliE.TagliazucchiG. (2018). Resilienza e impresa: L’impatto dei disastri naturali sulle piccole imprese commerciali al dettaglio. Angeli.
22.
MolenaarI. W.SijtsmaK.BoerP. (2000). MSP5 for Windows: A program for mokken scale analysis for polytomous items : Version 5.0: user’s manual. Iec ProGAMMA.
23.
MuellerR. O.HancockG. R. (2001). Factor analysis and latent structure, confirmatoryInternational encyclopedia of the social and behavioral sciences (pp. 5239–5244). Elsevier. https://doi.org/10.1016/B0-08-043076-7/00426-5
24.
MuthénL. K.MuthénB. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling: A Multidisciplinary Journal, 9(4), 599–620. https://doi.org/10.1207/S15328007SEM0904_8
25.
OrelA.BernikI. (2018). GDPR and health personal data; tricks and traps of compliance. Studies in Health Technology and Informatics, 255, 155–159.
26.
PenniniA.ArmellinG. (2021). L’organizzazione resiliente: L’esperienza dell’emergenza COVID-19 in ambito sanitario e sociosanitario. Angeli.
27.
TaherdoostH. (2016). Sampling methods in research methodology; how to choose a sampling technique for research. Helvetic Editions LTD, Switzerland. https://www.ssrn.com/abstract=3205035
28.
TavakolM.DennickR. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
29.
von ElmE.AltmanD. G.EggerM.PocockS. J.GøtzscheP. C.VandenbrouckeJ. P.STROBE Initiative (2008). The strengthening the reporting of observational studies in epidemiology (STROBE) statement: Guidelines for reporting observational studies. Journal of Clinical Epidemiology, 61(4), 344–349. https://doi.org/10.1016/j.jclinepi.2007.11.008
30.
WeickK. E.SutcliffeK. M. (2007). Managing the unexpected: Resilient performance in an age of uncertainty (2nd ed). Jossey-Bass.
31.
WiigS.AaseK.BillettS.CanfieldC.RøiseO.NjåO.GuiseV.Haraldseid-DriftlandC.ReeE.AndersonJ. E.MacraeC.RiH-team (2020). Defining the boundaries and operational concepts of resilience in the resilience in healthcare research program. BMC Health Services Research, 20(1), 330. https://doi.org/10.1186/s12913-020-05224-3
32.
XiaY.YangY. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51(1), 409–428. https://doi.org/10.3758/s13428-018-1055-2
33.
ZhongS.ClarkM.HouX.-Y.ZangY.FitzGeraldG. (2015). Development of key indicators of hospital resilience: A modified delphi study. Journal of Health Services Research and Policy, 20(2), 74–82. https://doi.org/10.1177/1355819614561537
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
