The prevalence of burnout is becoming a public health issue across the world. This study developed and validated Brief ProQOL-12, formed from the existing, but yet unvalidated 30-item ProQOL-5.
Methods
Study 1—Eight intercultural samples of helping professionals from four continents (n = 4,129). Validation included step-wise appraisal and multi-group invariance testing. Study 2—Ethnically and occupationally-balanced sample (n = 453). Rasch modeling, factor analysis, analysis of measure correlates, and scale refinements.
Results
ProQOL-5 (30-item) did not fit among any continential or national samples, including North America. Study 1—Provisional ProQOL-12 showed good internal structure and measurement invariance. Study 2—Brief ProQOL-12 had an excellent fit in the ethnically and occupationally diverse sample. Included ProQOL 5 items were: 9, 10, 12-14, 18, 19, 21, 24-26, and 30. The reliability and validity of the Brief ProQOL-12 were significantly improved over the 30-item measure. Rasch modeling and factor analysis indicated that the measure was reliable, valid interculturally and occupationally.
Conclusions
The ProQOL-5 (30-item) reliability and validity concerns were resolved in this 12-item measure which was refined to include a more realistic time context of seven days and time definite Likert ranges. These enhancements increased validity, as evidenced by the improvement in all model fit indicators in the excellent range in Study 2. Transcending culture and ethnicity with proven psychometric robustness, the Brief ProQOL-12 serves as a valuable resource for evaluating burnout risk and well-being across heterogeneous ethnic, cultural, and occupational landscapes.
GhahramaniSLankaraniKBYousefiMHeydariKShahabiSAzmandS. A systematic review and meta-analysis of burnout among healthcare workers during COVID-19. Front Psychiatr. 2021;12:758849. doi:10.3389/fpsyt.2021.758849.
2.
MaslachCJacksonSE. Burnout in health professions: a social psychological analysis. In: SandersGSulsJ, eds. The Social Psychology of Health and Illness. Mahwah: Lawrence Erlbaum Associates; 1982:227-251.
3.
MaslachCLeiterMP. The Truth about Burnout: How Organizations Can Cause Personal Stress and what to Do about it. San Francisco: Jossey-Bass; 1997.
4.
VachonMLS. Motivation and stress experienced by staff working with the terminally ill. Death Education. Spring-Summer. 1978;2(1-2):113-122.
5.
SprangGClarkJJWhitt-WoosleyA. Compassion fatigue, compassion satisfaction, and burnout: factors impacting a professional's quality of life. J Loss Trauma. 2007;12(3):259-280. doi:10.1080/15325020701238093.
6.
MaslachCSchaufeliWBLeiterMP. Job burnout. Annu Rev Psychol. 2001;52(1):397-422. doi:10.1146/annurev.psych.52.1.397.
7.
CraigCDSprangG. Compassion satisfaction, compassion fatigue, and burnout in a national sample of trauma treatment therapists. Hist Philos Logic. 2010;23(3):319-339. doi:10.1080/10615800903085818.
8.
MaslachC. Job burnout: new directions in research and intervention. Curr Dir Psychol Sci. 2003;12(5):189-192. doi:10.1111/1467-8721.01258.
9.
FessellDChernissC. Coronavirus disease 2019 (COVID-19) and beyond: micropractices for burnout prevention and emotional wellness. J Am Coll Radiol. 2020;17(6):746. doi:10.1016/j.jacr.2020.03.013.
10.
GarciaACMFerreiraACGSilvaLSRda ConceiçãoVMNogueiraDAMillsJ. Mindful self-care, self-compassion, and resilience among palliative care providers during the COVID-19 pandemic. J Pain Symptom Manag. 2022;64(1):49. doi:10.1016/j.jpainsymman.2022.03.003.
11.
HotchkissJTCook-CottoneCPWongMYCGuykerWGarciaACM. Intercultural validation of the mindful self-care scale—Rasch and factor analysis of 16 studies representing five continents. Mindfulness. 2023;14(8):2055-2072.
12.
StammBH.The concise ProQOL manual, ProQOL version 5. Professional Quality of Life:2010. https://www.proqol.org/.
13.
HotchkissJTWongC. Factorial structure of the ProQOL: systematic review and integration of 27 international factor analysis studies. Trends in Psychology. 2022. doi:10.1007/s43076-022-00184-5.
14.
ArrowsTD. Validation of the Professional Quality of Life Model Among Correctional Officers. Ann Arbor: ProQuest Dissertations Publishing; 2018.
15.
GalianaLArenaFOliverASansóNBenitoE. Compassion satisfaction, compassion fatigue, and burnout in Spain and Brazil: ProQOL validation and cross-cultural diagnosis. J Pain Symptom Manag. 2017;53(3):598. doi:10.1016/j.jpainsymman.2016.09.014.
16.
HemsworthDBareghehAAounSKazanjianA. A critical enquiry into the psychometric properties of the professional quality of life scale (ProQol-5) instrument. Appl Nurs Res. 2018;39:81.
17.
HeritageBReesCSHegneyDG. The ProQOL-21: a revised version of the professional quality of life (ProQOL) scale based on Rasch analysis. PLoS One. 2018;13(2):e0193478-e0193479. doi:10.1371/journal.pone.0193478.
18.
KeeslerJMFukuiS. Factor structure of the professional quality of life scale among direct support professionals: factorial validity and scale reliability. J Intellect Disabil Res. 2020;64(9):681-689. doi:10.1111/jir.12766.
19.
MarksM. Re-Conceptualizing compassion fatigue: a confirmatory factor analysis. Electronic Theses and Dissertations; 2016. https://stars.library.ucf.edu/etd/5278.
20.
SamsonTIecovichEShvartzmanP. Psychometric characteristics of the Hebrew version of the professional quality-of-life scale. J Pain Symptom Manag. 2016;52(4):575.
21.
GalianaLOliverAArenaF, et al.Development and validation of the Short professional quality of life scale based on versions IV and V of the professional quality of life scale. Health Qual Life Outcome. 2020;18(1):364-372. doi:10.1186/s12955-020-01618-3.
22.
LazărFGabaDMunchS. The ProQOL-20, a restructured version of the professional quality of life scale (ProQOL). Curr Psychol. 2023;42:14724-14735. doi:10.1007/s12144-022-02755-2.
23.
StammBH. Measuring compassion satisfaction as well as fatigue: developmental history of the compassion satisfaction and fatigue test. In: FigleyCR, ed. Treating Compassion Fatigue. New York: Brunner-Routledge; 2002:107-119.
DangWChengWMaH, et al.Reliability and validity of Professional Quality of Life Scale among government staff in earthquake - stricken areas in China. Zhonghua Laodong Weisheng Zhiyebing Zazhi. 2015;33(6):440.
26.
KlineRB. Beyond Significance Testing: Statistics Reform in the Behavioral Sciences. 2nd ed. Washington, DC: American Psychological Association; 2013.
27.
FigleyCR. Trauma and its wake Volume II: traumatic stress theory, research, and intervention. In: Brunner/Mazel Psychosocial Stress Series. 1st ed. England: Routledge; 1986.
28.
JoinsonC. Coping with compassion fatigue. Nursing. 1992;22:116-120.
FigleyCR. Review of the compassion fatigue self-test. In: StammBH, ed. Measurement of Stress, Trauma, and Adaptation. Towson: Sidran Press; 1996:127-130.
31.
FigleyCR. In: StammBH, ed. Compassion Fatigue as Secondary Traumatic Stress Disorder: An Overview. England: Routledge; 1995:23-42.
MuthenBAsparouhovT. BSEM measurement invariance analysis. Mplus Web Notes. 2013;17:1-48.
38.
SchmittNAliAA. In: LanceCEVandenbergRJ, eds. The Practical Importance of Measurement Invariance More statistical and methodological myths and urban legends. England: Routledge; 2015.
39.
CilarLSpevanMMusovicKStiglicG. Validation of the professional quality of life scale among slovenian and Croatian nurses. Central European Journal of Nursing and Midwifery. 2021;12(2):333-341. doi:10.15452/cejnm.2021.12.0008.
40.
ChenYLiTCChangYWLiaoHCHuangHMHuangLC. Exploring the relationships among professional quality of life, personal quality of life and resignation in the nursing profession. J Adv Nurs. 2021;77(6):2689-2699. doi:10.1111/jan.14770.
41.
DepnerRMCook-CottoneCPKimS. Structural relationship between mindful self-care, meaning made, and palliative worker’s quality of life. Int J Stress Manag. 2021;28(1):74-87. doi:10.1037/str0000209.
42.
FukumoriTGotoTSatoH. Development, Reliability, and Validation of a Japanese Nurse Version of the Professional Quality of Life Scale (ProQOL-JN). Japan: 31st International Congress of Psychology; 2016.
43.
HotchkissJTCook-CottoneCP. Validation of the Mindful Self-Care Scale (MSCS) and development of the Brief-MSCS among hospice and healthcare professionals: a confirmatory factor analysis approach to validation. Palliat Support Care. 2019;17(6):628. doi:10.1017/S1478951519000269.
44.
MissouridouEMangouliaPPavlouV, et al.Reliability and validity of the Greek version of the professional quality of life scale (ProQOL-V). Mater Soc Med. 2021;33:179. doi:10.5455/msm.2021.33.179-183.
45.
OliverRHughesBWeissG. A study of the self-reported resilience of APC chaplains. J Pastor Care Counsel. 2018;72(2):99-103. doi:10.1177/1542305018773698.
46.
StanfordSTimmsC. Australian chaplains and their professional quality of life. J Pastor Care Counsel. 2021;75(4):15423050211036344. doi:10.1177/15423050211036344.
47.
GoetzCLemetayerFRatA. Item reduction based on rigorous methodological guidelines is necessary to maintain validity when shortening composite measurement scales. J Clin Epidemiol. 2013;66:710-718. doi:10.1016/j.jclinepi.2012.12.015.
48.
HuLTBentlerPM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1. doi:10.1080/10705519909540118.
49.
MarshHWHauK-TWenZ. In search of golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing hu and bentler's (1999) findings. Struct Equ Model. 2004;11(3):320. doi:10.1207/s15328007sem1103_2.
50.
McDonaldRP. Test Theory: A Unified Treatment. England: Psychology Press; 1999.
51.
WatkinsMW. The reliability of multidimensional neuropsychological measures: from alpha to omega. Clin Neuropsychol. 2017;31(6-7):1113-1126. doi:10.1080/13854046.2017.1317364.
52.
ByrneBMShavelsonRMuthénB. Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychol Bull. 1989;105:456-466. doi:10.1037/0033-2909.105.3.456.
53.
ChenF. What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. J Pers Soc Psychol. 2008;95:1005-1008. doi:10.1037/a0013193.
Cook-CottoneCPGuykerWM. The development and validation of the mindful self-care scale (MSCS): an assessment of practices that support positive embodiment. Mindfulness. 2017;2018:9. doi:10.1007/s12671-017-0759-1.
56.
HotchkissJTCook-CottoneCP. The Mindful Helping and Self-Care model—mindful self-care and quality of life among a racially-balanced sample of helping professionals. International Journal of Yoga Therapy. 2023;33. doi:10.17761/2023-D-22-00001.
57.
MastersGNWrightBD. The partial credit model. In: Handbook of Modern Item Response Theory. New York: Springer; 1982:101-121.
58.
WrightBDLinacreJ. Reasonable mean-square fit values. Transactions of the Rasch measurement SIG American educational research association. Rasch Measurement Transaction. 1994;8:370-382.
59.
HughesSHaroonSSubramanianA, et al.Development and validation of the symptom burden questionnaire for long covid (SBQ-LC): Rasch analysis. Br Med J. 2022;377: doi:10.1136/bmj-2022-070230.
60.
BrownTA. Confirmatory Factor Analysis for Applied Research. New York, NY: The Guilford Press; 2006.
61.
DebelakRKollerI. Testing the local independence assumption of the Rasch model with Q3-based nonparametric model tests. Appl Psychol Meas. 2019;44(2). doi:10.1177/0146621619835501.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
