Using Item Response Theory to Compare Irritability Measures in Early Adolescent and Childhood Samples

Abstract

Limited psychometric information is available to guide best practices for measuring youth irritability. This report compares performance of irritability measures using item response theory (IRT). Study 1 used a sample of 482 early adolescents and compared the parent- and youth-report affective reactivity index (ARI) and irritability factors derived from the parent-report Child Behavior Checklist (CBCL) and clinician-administered Kiddie Schedule for Affective Disorders (K-SADS). Study 2 combined data from three childhood samples (N = 811) and compared performance of the parent-report ARI and CBCL and the clinician-administered Preschool Age Psychiatric Assessment (PAPA). The ARI emerged as the best measure of childhood irritability across the developmental periods, while the CBCL and K-SADS provided an adequate amount of information in early adolescents. No measure reliably assessed irritability at modest severity levels. Using IRT across large pools of developmental samples and measures is needed to guide the field in the measurement of youth irritability.

Keywords

item response theory IRT irritability measurement assessment

Get full access to this article

View all access options for this article.

References

Achenbach

T. M.

Rescorla

L. A.

(2001). Manual for the ASEBA school-age forms and profiles. University of Vermont Research Center for Children, Youth and Families.

Aebi

Plattner

Metzke

C. W.

Bessler

Steinhausen

H.-C.

(2013). Parent- and self-reported dimensions of oppositionality in youth: Construct validity, concurrent validity, and the prediction of criminal outcomes in adulthood. Journal of Child Psychology and Psychiatry, 54(9), 941-949. https://doi.org/10.1111/jcpp.12039

Baker

F. B.

(2001). The basics of item response theory: ERIC Clearinghouse on Assessment and Evaluation. https://files.eric.ed.gov/fulltext/ED458219.pdf

Brotman

M. A.

Kircanski

Leibenluft

(2017). Irritability in children and adolescents. Annual Review of Clinical Psychology, 13(1), 317-341. https://doi.org/10.1146/annurev-clinpsy-032816-044941

Bufferd

S. J.

Dougherty

L. R.

Olino

T. M.

(2017). Mapping the frequency and severity of depressive behaviors in preschool-aged children. Child Psychiatry & Human Development, 48(6), 934-943. https://doi.org/10.1007/s10578-017-0715-2

Copeland

W. E.

Shanahan

Egger

Angold

Costello

E. J.

(2014). Adult diagnostic and functional outcomes of DSM-5 disruptive mood dysregulation disorder. American Journal of Psychiatry, 171(6), 668-674. https://doi.org/10.1176/appi.ajp.2014.13091213

Dougherty

L. R.

Smith

V. C.

Bufferd

S. J.

Kessel

Carlson

G. A.

Klein

D. N.

(2015). Preschool irritability predicts child psychopathology, functional impairment, and service use at age nine. Journal of Child Psychology and Psychiatry, 56(9), 999-1007. https://doi.org/10.1111/jcpp.12403

Dougherty

L. R.

Tolep

M. R.

Smith

V. C.

Rose

(2013). Early exposure to parental depression and parenting: Associations with young offspring’s stress physiology and oppositional behavior. Journal of Abnormal Child Psychology, 41(8), 1299-1310. https://doi.org/10.1007/s10802-013-9763-7

Evans

S. C.

Bonadio

F.T.

Bearman

S. K.

Ugueto

A. M.

Chorpita

B. F.

Weisz

J. R.

(2020). Assessing the irritable and defiant dimensions of youth oppositional behavior using CBCL and YSR Items. Journal of Clinical Child & Adolescent Psychology, 49(6), 804-819. https://doi.org/10.1080/15374416.2019.1622119

10.

Hawes

M. T.

Carlson

G. A.

Finsaas

M. C.

Olino

T. M.

Seely

J. R.

Klein

D. N.

(2020). Dimensions of irritability in adolescents: Longitudinal associations with psychopathology in adulthood. Psychological Medicine, 50(16), 2759-2767. https://doi.org/10.1017/S0033291719002903

11.

Kaat

A. J.

Blackwell

C. K.

Estabrook

C. R.

Burns

J. L.

Petitclerc

Briggs-Gowan

M. J.

Gershon

R. C.

Cella

Perlman

S. B.

Wakschlag

L.S.

(2019). Linking the Child Behavior Checklist (CBCL) with the Multidimensional Assessment Profile of Disruptive Behavior (MAP-DB): Advancing a dimensional spectrum approach to disruptive behavior. Journal of Child and Family Studies, 28(2), 343-353. https://doi.org/10.1007/s10826-018-1272-4

12.

Kaufman

Birmaher

Axelson

Perepletchikova

Brent

Ryan

N. D.

(2016). K-SADS-PL DSM-5. https://www.kennedykrieger.org/sites/default/files/library/documents/faculty/ksads-dsm-5-screener.pdf

13.

Klein

D. N.

Finsaas

M. C.

(2017). The Stony Brook Temperament Study: Early antecedents and pathways to emotional disorders. Child Development Perspectives, 11(4), 257-263. https://doi.org/10.1111/cdep.12242

14.

Lord

F. M.

(1980). Applications of item response theory to practical testing problems. Taylor & Francis. https://doi.org/10.4324/9780203056615

15.

Luby

Belden

Botteron

Marrus

Harms

M. P.

Babb

Nishino

Barch

(2013). The effects of poverty on childhood brain development: The mediating effect of caregiving and stressful life events. JAMA Pediatrics, 167(12), 1135-1142. https://doi.org/10.1001/jamapediatrics.2013.3139

16.

Melvin

G. A.

Tonge

B. J.

Mulraney

Gordon

Taffe

Klimkeit

(2018). The Cranky Thermometers: Visual analogue scales measuring irritability in youth. Journal of Adolescence, 64(April), 146-154. https://doi.org/10.1016/j.adolescence.2018.02.008

17.

Merwin

S. M.

Barrios

Smith

V. C.

Lemay

E. P.

Dougherty

L. R.

(2018). Outcomes of early parent-child adrenocortical attunement in the high-risk offspring of depressed parents. Developmental Psychobiology, 60(4), 468-482. https://doi.org/10.1002/dev.21623

18.

Mulraney

M. A.

Melvin

G. A.

Tonge

B. J.

(2014). Psychometric properties of the Affective Reactivity Index in Australian adults and adolescents. Psychological Assessment, 26(1), 148-155. https://doi.org/10.1037/a0034891

19.

Olino

T. M.

McMakin

D. L.

Forbes

E. E.

Seeley

J. R.

Lewinsohn

P. M.

Pilkonis

P. A.

(2013). Comparisons across depression assessment instruments in adolescence and young adulthood: An item response theory study using two linking methods. Journal of Abnormal Child Psychology, 41(8), 1267-1277. https://doi.org/10.1007/s10802-013-9756-6

20.

Pagliaccio

Pine

D. S.

Barch

D. M.

Luby

J. L.

Leibenluft

(2018). Irritability trajectories, cortical thickness, and clinical outcomes in a sample enriched for preschool depression. Journal of the American Academy of Child & Adolescent Psychiatry, 57(5), 336-342.e6. https://doi.org/10.1016/j.jaac.2018.02.010

21.

Roberson-Nay

Leibenluft

Brotman

M. A.

Myers

Larsson

Lichtenstein

Kendler

K. S.

(2015). Longitudinal stability of genetic and environmental influences on irritability: From childhood to young adulthood. American Journal of Psychiatry, 172(7), 657-664. https://doi.org/10.1176/appi.ajp.2015.14040509

22.

Samejima

(1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4, Pt. 2), 1-97. https://doi.org/10.1007/BF03372160

23.

Steiger

J. H.

(1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25(2), 173-180. https://doi.org/10.1207/s15327906mbr2502_4

24.

Stringaris

Cohen

Pine

D. S.

Leibenluft

(2009). Adult outcomes of youth irritability: A 20-year prospective community-based study. American Journal of Psychiatry, 166(9), 1048-1054. https://doi.org/10.1176/appi.ajp.2009.08121849

25.

Stringaris

Goodman

Ferdinando

Razdan

Muhrer

Leibenluft

Brotman

M. A.

(2012). The Affective Reactivity Index: A concise irritability scale for clinical and research settings. Journal of Child Psychology and Psychiatry, 53(11), 1109-1117. https://doi.org/10.1111/j.1469-7610.2012.02561.x

26.

Stringaris

Zavos

Leibenluft

Maughan

Eley

(2012). Adolescent irritability: Phenotypic associations and genetic links with depressed mood. American Journal of Psychiatry, 169(1), 47-54. https://doi.org/10.1176/appi.ajp.2011.10101549

27.

Tseng

W.-L.

Moroney

Machlin

Roberson-Nay

Hettema

J. M.

Carney

Stoddard

Towbin

K. A.

Pine

D. S.

Leibenluft

Brotman

M. A.

(2017). Test-retest reliability and validity of a frustration paradigm and irritability measures. Journal of Affective Disorders, 212(April), 38-45. https://doi.org/10.1016/j.jad.2017.01.024

28.

Wakschlag

L. S.

Choi

S. W.

Carter

A. S.

Hullsiek

Burns

McCarthy

Leibenluft

Briggs-Gowan

M. J.

(2012). Defining the developmental parameters of temper loss in early childhood: Implications for developmental psychopathology. Journal of Child Psychology and Psychiatry, 53(11), 1099-1108. https://doi.org/10.1111/j.1469-7610.2012.02595.x

29.

Wakschlag

L. S.

Estabrook

Petitclerc

Henry

Burns

J. L.

Perlman

S. B.

Voss

J. L.

Pine

D. S.

Leibenluft

Briggs-Gowan

(2015). Clinical implications of a dimensional approach: The normal:abnormal spectrum of early irritability. Journal of the American Academy of Child & Adolescent Psychiatry, 54(8), 626-634. https://doi.org/10.1016/j.jaac.2015.05.016

30.

Wiggins

J. L.

Briggs-Gowan

M. J.

Estabrook

Brotman

M. A.

Pine

D. S.

Leibenluft

Wakschlag

L. S.

(2018). Identifying clinically significant irritability in early childhood. Journal of the American Academy of Child & Adolescent Psychiatry, 57(3), 191-199.e2. https://doi.org/10.1016/j.jaac.2017.12.008

31.

Wiggins

J. L.

Mitchell

Stringaris

Leibenluft

(2014). Developmental trajectories of irritability and bidirectional associations with maternal depression. Journal of the American Academy of Child & Adolescent Psychiatry, 53(11), 1191-1205.e4. https://doi.org/10.1016/j.jaac.2014.08.005

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.08 MB