Optimizing the Assessment of Parental Burnout: A Multi-informant and Multimethod Approach to Determine Cutoffs for the Parental Burnout Inventory and the Parental Burnout Assessment

Abstract

Parental burnout (PB) is a chronic stress-related condition resulting from long-lasting exposure to overwhelming parenting stress. Previous studies showing the seriousness of this condition stressed the urgent need to provide researchers and practitioners with effective assessment tools. Validated PB measures are the Parental Burnout Inventory (PBI) and the Parental Burnout Assessment (PBA). The good psychometric properties of these instruments have been replicated across different samples and countries, but thresholds for identifying impairing PB levels (i.e., cutoff scores) have not yet been established. The present study aims to fill this gap by adopting a multi-informant and multimethod approach to a sample of 192 burned-out and control parents. PBI and PBA cutoffs were derived from the combination of several PB indicators, based on a preregistered analysis strategy. Results identified a score of 74.6 (95% confidence interval (CI) = [69.48–79.68]) for the PBI and 86.3 (95% CI = [79.49–93.03]) for the PBA as indicators of the most severe PB levels.

Keywords

burnout parent assessment multimethod cutoff diagnosis

Get full access to this article

View all access options for this article.

References

Akobeng

A. K.

(2007). Understanding diagnostic tests 3: Receiver operating characteristic curves. Acta Paediatrica, International Journal of Paediatrics, 96(5), 644–647. https://doi.org/10.1111/j.1651-2227.2006.00178.x

Alexander

L. A.

McKnight

P. E.

Disabato

D. J.

Kashdan

T. B.

(2017). When and how to use multiple informants to improve clinical assessments. Journal of Psychopathology and Behavioral Assessment, 39(4), 669–679. https://doi.org/10.1007/s10862-017-9607-9

Ambady

(2010). The perils of pondering: Intuition and thin slice judgments. Psychological Inquiry, 21(4), 271–278. https://doi.org/10.1080/1047840X.2010.524882

Augenstein

T. M.

Thomas

S. A.

Ehrlich

K. B.

Daruwala

Reyes

S. M.

Chrabaszcz

J. S.

De Los Reyes

(2016). Comparing multi-informant assessment measures of parental monitoring and their links with adolescent delinquent behavior. Parenting, 16(3), 164–186. https://doi.org/10.1080/15295192.2016.1158600

Aunola

Sorkkila

Tolvanen

(2020). Validity of the Finnish version of the Parental Burnout Assessment (PBA). Scandinavian Journal of Psychology. https://doi.org/10.1111/sjop.12654

Baldisserotto

M. L.

Theme-Filha

M. M.

Griep

R. H.

Oates

Renó Junior

Cavalsan

J. P.

(2018). Transcultural adaptation to the Brazilian Portuguese of the postpartum bonding questionnaire for assessing the postpartum bond between mother and baby. Cadernos de Saude Publica, 34(7). https://doi.org/10.1590/0102-311X00170717

Brianda

M. E.

Roskam

Gross

J. J.

Franssen

Kapala

Gérard

Mikolajczak

(2020). Treating parental burnout: Impact of two treatment modalities on burnout symptoms, emotions, hair cortisol, and parental neglect and violence. Psychotherapy and Psychosomatics, 89(5), 330–332. https://doi.org/10.1159/000506354

Brianda

M. E.

Roskam

Mikolajczak

(2020). Hair cortisol concentration as a biomarker of parental burnout. Psychoneuroendocrinology, 117. https://doi.org/10.1016/j.psyneuen.2020.104681

Caparros-Gonzalez

R. A.

Romero-Gonzalez

Strivens-Vilchez

Gonzalez-Perez

Martinez-Augustin

Peralta-Ramirez

M. I.

(2017). Hair cortisol levels, psychological stress and psychopathological symptoms as predictors of postpartum depression. PLOS ONE, 12(8). https://doi.org/10.1371/journal.pone.0182817

10.

De Los Reyes

Thomas

S. A.

Goodman

K. L.

Kundey

S. M. A

. (2013). Principles underlying the use of multiple informants’ reports. Annual Review of Clinical Psychology, 9(1), 123–149. https://doi.org/10.1146/annurev-clinpsy-050212-185617

11.

Demetriou

Ozer

B. U.

Essau

C. A.

(2015). Self-report questionnaires. In Cautin

R. L.

Lilienfeld

S. O.

(Eds.), The encyclopedia of clinical psychology (pp. 1–6). John Wiley. https://doi.org/10.1002/9781118625392.wbecp507

12.

Fluss

Faraggi

Reiser

(2005). Estimation of the Youden Index and its associated cutoff point. Biometrical Journal, 47(4), 458–472. https://doi.org/10.1002/bimj.200410135

13.

Hajian-Tilaki

(2013). Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation. Caspian Journal of Internal Medicine, 4(2), 627–635. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3755824/

14.

Hubert

Aujoulat

(2018). Parental burnout: When exhausted mothers open up. Frontiers in Psychology, 9, Article 1021. https://doi.org/10.3389/fpsyg.2018.01021

15.

Kawamoto

Furutani

Alimardani

(2018). Preliminary validation of Japanese version of the parental burnout inventory and its relationship with perfectionism. Frontiers in Psychology, 9, Article 970. https://doi.org/10.3389/fpsyg.2018.00970

16.

Lindström

Åman

Norberg

A. L.

(2011). Parental burnout in relation to sociodemographic, psychosocial and personality factors as well as disease duration and glycaemic control in children with Type 1 diabetes mellitus. Acta Paediatrica, International Journal of Paediatrics, 100(7), 1011–1017. https://doi.org/10.1111/j.1651-2227.2011.02198.x

17.

Magaña

A. B.

Goldstein

M. J.

Karno

Miklowitz

D. J.

Jenkins

Falloon

I. R. H.

(1986). A brief method for assessing expressed emotion in relatives of psychiatric patients. Psychiatry Research, 17(3), 203–212. https://doi.org/10.1016/0165-1781(86)90049-1

18.

Manenschijn

Koper

J. W.

van den Akker

E. L. T.

de Heide

L. J. M.

Geerdink

E. A. M.

de Jong

F. H.

Feelders

R. A.

van Rossum

E. F. C.

(2012). A novel tool in the diagnosis and follow-up of (cyclic) Cushing’s syndrome: Measurement of long-term cortisol in scalp hair. The Journal of Clinical Endocrinology and Metabolism, 97(10), E1836–E1843. https://doi.org/10.1210/jc.2012-1852

19.

Maslach

Jackson

S. E.

Leiter

M. P.

Schaufeli

W. B.

Schwab

R. L.

(1986). Maslach burnout inventory. Consulting Psychologists Press.

20.

Mikolajczak

Brianda

M. E.

Avalosse

Roskam

(2018). Consequences of parental burnout: Its specific effect on child neglect and violence. Child Abuse and Neglect, 80, 134–145. https://doi.org/10.1016/j.chiabu.2018.03.025

21.

Mikolajczak

Gross

J. J.

Roskam

(2019). Parental burnout: What is it, and why does it matter? Clinical Psychological Science, 7, 1319–1329. https://doi.org/10.1177/2167702619858430

22.

Mikolajczak

Gross

J. J.

Stinglhamber

Lindahl Norberg

Roskam

(2020). Is parental burnout distinct from job burnout and depressive symptoms? Clinical Psychological Science, 8(4), 673–689. https://doi.org/10.1177/2167702620917447

23.

Mikolajczak

Roskam

(2018). A theoretical and clinical framework for parental burnout: The balance between risks and resources (BR²). Frontiers in Psychology, 9, Article 886. https://doi.org/10.3389/fpsyg.2018.00886

24.

Park

S. H.

Goo

J. M.

C. H.

(2004). Receiver operating characteristic (ROC) curve: Practical review for radiologists. Korean Journal of Radiology, 5(1), 11–18. https://doi.org/10.3348/kjr.2004.5.1.11

25.

Perkins

N. J.

Schisterman

E. F.

(2006). The inconsistency of “optimal” cutpoints obtained using two criteria based on the receiver operating characteristic curve. American Journal of Epidemiology, 163(7), 670–675. https://doi.org/10.1093/aje/kwj063

26.

Pintea

Moldovan

(2009). The receiver-operating characteristic (ROC) analysis: Fundamentals and applications in clinical psychology. Journal of Cognitive and Behavioral Psychotherapies, 9(1), 49–66.

27.

Roskam

Aguiar

Akgun

Arikan

Artavia

Avalosse

Aunola

Bader

Bahati

Barham

E. J.

Besson

Beyers

Boujut

Brianda

M. E.

Brytek-Matera

Carbonneau

César

Chen

B.-B.

Dorard

. . . Mikolajczak

(2021). Parental burnout around the globe: A 42-country study. Affective Science, 2, 58–79. https://doi.org/10.1007/s42761-020-00028-4

28.

Roskam

Brianda

M. E.

Mikolajczak

(2018). A step forward in the conceptualization and measurement of parental burnout: The Parental Burnout Assessment (PBA). Frontiers in Psychology, 9, Article 758. https://doi.org/10.3389/fpsyg.2018.00758

29.

Roskam

Mikolajczak

(2020). Gender differences in the nature, antecedents and consequences of parental burnout. Sex Roles, 83, 485–498. https://doi.org/10.1007/s11199-020-01121-5

30.

Roskam

Raes

M. E.

Mikolajczak

(2017). Exhausted parents: Development and preliminary validation of the parental burnout inventory. Frontiers in Psychology, 8, Article 163. https://doi.org/10.3389/fpsyg.2017.00163

31.

Russell

Kirschbaum

Laudenslager

M. L.

Stalder

De Rijke

Van Rossum

E. F. C.

Van Uum

Koren

(2015). Toward standardization of hair cortisol measurement: Results of the first international interlaboratory round robin. Therapeutic Drug Monitoring, 37(1), 71–75. https://doi.org/10.1097/FTD.0000000000000148

32.

Semmer

N. K.

Grebner

Elfering

(2003). Beyond self-report: Using observational, physiological, and situation-based measures in research on occupational stress. In Perrewe

P. L.

Ganster

D. C.

(Eds.), Research in occupational stress and well being (Vol. 3, pp. 205–263). Emerald Group. https://doi.org/10.1016/S1479-3555(03)03006-3

33.

Stalder

Kirschbaum

(2012). Analysis of cortisol in hair–state of the art and future directions. Brain, Behavior, and Immunity, 26(7), 1019–1029. https://doi.org/10.1016/j.bbi.2012.02.002

34.

Staufenbiel

S. M.

Penninx

B. W. J. H.

Spijker

A. T.

Elzinga

B. M.

van Rossum

E. F. C.

(2013). Hair cortisol, stress exposure, and mental health in humans: A systematic review. Psychoneuroendocrinology, 38(8), 1220–1235. https://doi.org/10.1016/j.psyneuen.2012.11.015

35.

Streiner

D. L.

Cairney

(2007). What’s under the ROC? An introduction to receiver operating characteristics curves. Canadian Journal of Psychiatry, 52(2), 121–128. https://doi.org/10.1177/070674370705200210

36.

Van Bakel

H. J. A.

Van Engen

M. L.

Peters

. (2018). Validity of the Parental Burnout Inventory among dutch employees. Frontiers in Psychology, 9, Article 697. https://doi.org/10.3389/fpsyg.2018.00697

37.

Ward

M. M.

(2013). Estimating disease prevalence and incidence using administrative data: Some assembly required. Journal of Rheumatology, 40(8), 1241–1243. https://doi.org/10.3899/jrheum.130675