Bifactor Models of Attention-Deficit/Hyperactivity Disorder (ADHD): An Evaluation of Three Necessary but Underused Psychometric Indexes

Abstract

Background: In the past decade, the bifactor model of attention-deficit/hyperactivity disorder (ADHD) has been extensively researched. This model consists of an ADHD general dimension and two specific factors: inattention and hyperactivity/impulsivity. All studies conclude that the bifactor is superior to the traditional two-correlated factors model, according to the fit obtained by factor analysis. However, the proper interpretation of a bifactor not only depends on the fit but also on the quality of the measurement model. Objective: To evaluate the model-based reliability, distribution of common variance and construct replicability of general and specific ADHD factors. Method: We estimated expected common variance, omega hierarchical/subscale and H-index from standardized factor loadings of 31 ADHD bifactor models previously published. Results and Conclusion: The ADHD general factor explained most of the common variance. Given the low reliable variance ratios, the specific factors were difficult to interpret. However, in clinical samples, inattention acquired sufficient specificity and stability for interpretation beyond the general factor. Implications for research and clinical practice are discussed.

Keywords

ADHD bifactor model hierarchical model general factor

Get full access to this article

View all access options for this article.

References

Achenbach

T. M.

Rescorla

L. A.

(2001). Manual for the ASEBA school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth and Families.

American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed. Rev.). Washington, DC: Author.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.

Arias

V. B.

Ponce

F. P.

Arias

Martinez-Molina

Nuñez

(2016). General and specific attention-deficit/hyperactivity disorder factors of children 4 to 6 years of age: An exploratory structural equation modeling approach to assessing symptom multidimensionality. Journal of Abnormal Psychology, 125, 125-137.

Barkley

R. A.

(2014). Sluggish cognitive tempo (concentration deficit disorder?): Current status, future directions, and a plea to change the name. Journal of Abnormal Child Psychology, 42, 117-125.

Barkley

R. A.

Murphy

(1998). Attention-deficit hyperactivity disorder: A clinical workbook. New York, NY: Guilford Press.

Bauermeister

J. J.

(1992). Factor analyses of teacher ratings of attention-deficit hyperactivity and oppositional defiant symptoms in children aged four through thirteen years. Journal of Clinical Child & Adolescent Psychology, 21, 27-34.

Bauermeister

J. J.

Canino

Polanczyk

Rohde

L. A.

(2010). ADHD across cultures: Is there evidence for a bidimensional organization of symptoms? Journal of Clinical Child & Adolescent Psychology, 39, 362-372.

Bernad

Servera

Becker

S. P.

Burns

G. L.

(2016). Sluggish cognitive tempo and ADHD inattention as predictors of externalizing, internalizing, and impairment domains: A 2-year longitudinal study. Journal of Abnormal Child Psychology, 44, 771-785.

10.

Brunner

Nagy

Wilhelm

(2012). A tutorial on hierarchically structured constructs. Journal of Personality, 80, 796-846.

11.

Burns

G. L.

de Moura

M. A.

Beauchaine

T. P.

McBurnett

(2014). Bifactor latent structure of ADHD/ODD symptoms: Predictions of dual pathway/trait-impulsivity etiological models of ADHD. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 55, 393-401.

12.

Burns

G. L.

Taylor

T. K.

Rusby

J. C.

(2001). Child and Adolescent Disruptive Behavior Inventory 2.3: Parent version. Pullman: Washington State University, Department of Psychology.

13.

Burns

G. L.

Walsh

J. A.

Servera

Lorenzo-Seva

Cardo

Rodríguez-Fornells

(2013). Construct validity of ADHD/ODD rating scales: Recommendations for the evaluation of forthcoming DSM-V ADHD/ODD scales. Journal of Abnormal Child Psychology, 41, 15-26.

14.

Caci

H. M.

Morin

A. J.

Tran

(2013). Teacher ratings of the ADHD-RS IV in a community sample: Results from the ChiP-ARD study. Journal of Attention Disorders, 20, 434-444.

15.

Canivez

G. L.

(2015). Bifactor modeling in construct validation of multifactored tests: Implications for understanding multidimensional constructs and test interpretation. In Schweizer

DiStefano

(Eds.), Principles and methods of test construction: Standards and recent advancements (pp. 247-271). Göttingen, Germany: Hogrefe.

16.

Conners

C. K.

(1997). Conners’ Rating Scales-Revised: Technical manual. New York, NY: Multi-Health Systems.

17.

DeMars

C. E.

(2013). A tutorial on interpreting bifactor model scores. International Journal of Testing, 13, 354-378.

18.

Döpfner

Görtz-Dorten

Lehmkuhl

Breuer

Goletz

(2008). Diagnostik-System für psychische Störungen nach ICD-10 und DSM-IV für Kinder und Jugendliche—II [Diagnostic system for mental disorders according to ICD-10 and DSM-IV for children and adolescents-II]. Göttingen, Germany: Hogrefe.

19.

Döpfner

Steinhausen

H. C.

Coghill

Dalsgaard

Poole

Ralston

S. J., . . .

The ADORE Study Group. (2006). Cross-cultural reliability and validity of ADHD assessed by the ADHD Rating Scale in a pan-European study. European Child & Adolescent Psychiatry, 15, I46-I55.

20.

Dumenci

McConaughy

S. H.

Achenbach

T. M.

(2004). A hierarchical three-factor model of inattention-hyperactivity-impulsivity derived from the attention problems syndrome of the teacher’s report form. School Psychology Review, 33, 287-301.

21.

DuPaul

G. J.

Anastopoulos

A. D.

Power

T. J.

Reid

Ikeda

McGoey

(1998). Parent ratings of attention-deficit/hyperactivity disorder symptoms: Factor structure and normative data. Journal of Psychopathology and Behavioral Assessment, 20, 83-102.

22.

DuPaul

G. J.

Reid

Anastopoulos

A. D.

Lambert

M. C.

Watkins

M. W.

Power

T. J.

(1997). Teacher ratings of attention-deficit hyperactivity disorder symptoms: Factor structure and normative data. Psychological Assessment, 9, 436-443.

23.

DuPaul

G. J.

Reid

Anastopoulos

A. D.

Lambert

M. C.

Watkins

M. W.

Power

T. J.

(2015). Parent and teacher ratings of attention-deficit/hyperactivity disorder symptoms: Factor structure and normative data. Psychological Assessment, 28, 214-225.

24.

Faraone

S. V.

Biederman

Mick

(2006). The age-dependent decline of attention deficit hyperactivity disorder: A meta-analysis of follow-up studies. Psychological Medicine, 36, 159-165.

25.

Gadow

K. D.

Sprafkin

(1994). Child Symptom Inventories manual (CSI: Parent Checklist and CSI: Teacher Checklist): Screening instruments for childhood emotional and behavioral disorders. Stony Brook, NY: Checkmate Plus.

26.

Gagné

Hancock

G. R.

(2006). Measurement model quality, sample size, and solution propriety in confirmatory factor models. Multivariate Behavioral Research, 41, 65-83.

27.

Garner

A. A.

Peugh

Becker

S. P.

Kingery

K. M.

Tamm

Vaughn

A. J.

. . . Epstein

J. N.

(2014). Does sluggish cognitive tempo fit within a bi-factor model of ADHD? Journal of Attention Disorders. Advance online publication. doi:10.1177/1087054714539995

28.

Gibbins

Toplak

M. E.

Flora

D. B.

Weiss

M. D.

Tannock

(2012). Evidence for a general factor model of ADHD in adults. Journal of Attention Disorders, 16, 635-644.

29.

Gignac

G. E.

Watkins

M. W.

(2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48, 639-662.

30.

Gomez

(2014). ADHD bifactor model based on parent and teacher ratings of Malaysian children. Asian Journal of Psychiatry, 8, 47-51.

31.

Gomez

Kyriakides

Devlin

(2014). Attention-deficit/hyperactivity disorder symptoms in an adult sample: Associations with Rothbart’s temperament dimensions. Personality and Individual Differences, 60, 73-78.

32.

Gomez

Vance

Gomez

R. M.

(2013). Validity of the ADHD bifactor model in general community samples of adolescents and adults, and a clinic-referred sample of children and adolescents. Journal of Attention Disorders. Advance online publication. doi:10.1177/1087054713480034

33.

Goodman

Ford

Richards

Gatward

Meltzer

(2000). The development and well-being assessment: Description and initial validation of an integrated assessment of child and adolescent psychopathology. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 41, 645-655.

34.

Hancock

G. R.

Mueller

R. O.

(2001). Rethinking construct reliability within latent variable systems. In Cudeck

du Toit

Sorbom

(Eds.), Structural equation modeling: Present and future—A Festschrift in honor of Karl Joreskog (pp. 195-216). Lincolnwood, IL: Scientific Software.

35.

Hardy

K. K.

Kollins

S. H.

Murray

D. W.

Riddle

M. A.

Greenhill

Cunningham

. . . Chuang

S. Z.

(2007). Factor structure of parent and teacher-rated attention-deficit/hyperactivity disorder symptoms in the Preschoolers with Attention-Deficit/Hyperactivity Disorder Treatment Study (PATS). Journal of Child and Adolescent Psychopharmacology, 17, 621-634.

36.

Holzinger

K. J.

Swineford

(1937). The bifactor method. Psychometrika, 2, 41-54.

37.

Kaufman

Birmaher

Brent

Rao

Flynn

Moreci

. . . Ryan

(1997). Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 980-988.

38.

Kessler

R. C.

Adler

Ames

Demler

Faraone

Hiripi

Walters

E. E.

(2005). The World Health Organization adult ADHD self-report scale (ASRS): A short screening scale for use in the general population. Psychological Medicine, 35, 245-256.

39.

Lee

Burns

G. L.

Beauchaine

T. P.

Becker

S. P.

(2015). Bifactor latent structure of Attention-deficit/hyperactivity disorder (ADHD)/oppositional defiant disorder (ODD) symptoms and first-order latent structure of sluggish cognitive tempo symptoms. Psychological Assessment, 28, 917-928.

40.

J. J.

Reise

S. P.

Chronis-Tuscano

Mikami

A. Y.

Lee

S. S.

(2015). Item response theory analysis of ADHD symptoms in children with and without ADHD. Assessment. Advance online publication. doi:10.1177/1073191115591595

41.

Martel

M. M.

Gremillion

Roberts

von Eye

Nigg

J. T.

(2010). The structure of childhood disruptive behaviors. Psychological Assessment, 22, 816-826.

42.

Martel

M. M.

Roberts

Gremillion

von Eye

Nigg

J. T.

(2011). External validation of bifactor model of ADHD: Explaining heterogeneity in psychiatric comorbidity, cognitive control, and personality trait profiles within DSM–IV ADHD. Journal of Abnormal Child Psychology, 39, 1111-1123.

43.

Martel

M. M.

von Eye

Nigg

J. T.

(2010). Revisiting the latent structure of ADHD: Is there a “g” factor? Journal of Child Psychology and Psychiatry, and Allied Disciplines, 51, 905-914.

44.

Martel

M. M.

von Eye

Nigg

J. T.

(2012). Developmental differences in structure of attention-deficit/hyperactivity disorder (ADHD) between childhood and adulthood. International Journal of Behavioral Development, 36, 279-292.

45.

Matte

Anselmi

Salum

G. A.

Kieling

Gonçalves

Menezes

. . . Rohde

L. A.

(2015). ADHD in DSM–5: A field trial in a large, representative sample of 18- to 19-year-old adults. Psychological Medicine, 45, 361-373.

46.

McDonald

R. P.

(1999). Test theory: A unified approach. Mahwah, NJ: Lawrence Erlbaum.

47.

Milich

Balentine

A. C.

Lynam

D. R.

(2001). ADHD combined type and ADHD predominantly inattentive type are distinct and unrelated disorders. Clinical Psychology: Science and Practice, 8, 463-488.

48.

Morin

A. J.

Tran

Caci

(2013). Factorial validity of the ADHD Adult Symptom Rating Scale in a French community sample: Results from the ChiP-ARD Study. Journal of Attention Disorders, 20, 530-541.

49.

Murray

A. L.

Johnson

(2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41, 407-422.

50.

Normand

Flora

D. B.

Toplak

M. E.

Tannock

(2012). Evidence for a general ADHD factor from a longitudinal general school population study. Journal of Abnormal Child Psychology, 40, 555-567.

51.

Ogg

J. A.

Bateman

Dedrick

R. F.

Suldo

S. M.

(2014). The relationship between life satisfaction and ADHD symptoms in middle school students: Using a bifactor model. Journal of Attention Disorders, 20, 390-399.

52.

Reise

S. P.

(2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696.

53.

Reise

S. P.

Bonifay

W. E.

Haviland

M. G.

(2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95, 129-140.

54.

Revelle

Wilt

(2013). The general factor of personality: A general critique. Journal of Research in Personality, 47, 493-504.

55.

Rodenacker

Hautmann

Görtz-Dorten

Döpfner

(2016). The factor structure of ADHD: Different models, analyses and informants in a bifactor framework. Journal of Psychopathology and Behavioral Assessment. Advance online publication. doi:10.1007/s10862-016-9565-7

56.

Rodriguez

Reise

S. P.

Haviland

M. G.

(2015). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98, 1-15.

57.

Rohde

L. A.

Barbosa

Polanczyk

Eizirik

Rasmussen

E. R.

Neuman

R. J.

Todd

R. D.

(2001). Factor and latent class analysis of DSM-IV ADHD symptoms in a school sample of Brazilian adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 711-718.

58.

Schneider

W. J.

(2013). What if we took our models seriously? Estimating latent scores in individuals. Journal of Psychoeducational Assessment, 31, 186-201.

59.

Servera

Bernad

M. D. M.

Carrillo

J. M.

Collado

Burns

G. L.

(2015). Longitudinal correlates of sluggish cognitive tempo and ADHD-Inattention symptom dimensions with Spanish children. Journal of Clinical Child & Adolescent Psychology, 45, 632-641.

60.

Smith

L. C.

Tamm

Hughes

C. W.

Bernstein

I. H.

(2013). Separate and overlapping relationships of inattention and hyperactivity/impulsivity in children and adolescents with attention-deficit/hyperactivity disorder. Attention Deficit and Hyperactivity Disorders, 5, 9-20.

61.

Sonuga-Barke

E. J.

Castellanos

F. X.

(2005). A common core dysfunction in attention-deficit/hyperactivity disorder: A scientific red herring? Behavioral and Brain Sciences, 28, 443-444.

62.

Swanson

J. M.

Nolan

Pelham

W. E.

(1992). The SNAP-IV Rating Scale. Retrieved from http://www.myadhd.com/snap-iv-6160-18sampl.html

63.

Swanson

J. M.

Schuck

Mann

Carlson

Hartman

C. A.

Sergeant

J. A.

. . . Wigal

(2012). Categorical and dimensional definitions and evaluations of symptoms of ADHD: History of the SNAP and the SWAN rating scales. International Journal of Educational and Psychological Assessment, 10, 51-70.

64.

Taylor

E. A.

Sandberg

Thorley

Giles

(1991). The epidemiology of childhood hyperactivity. Oxford, England: Oxford University Press.

65.

Ten Berge

J. M.

Sôcan

. (2004). The greatest lower bound to the reliability of a test and the hypothesis of unidimensionality. Psychometrika, 69, 613-625.

66.

Thorndike

R. L.

(1994). g. Intelligence, 19, 145-155.

67.

Toplak

M. E.

Pitch

Flora

D. B.

Iwenofu

Ghelani

Jain

Tannock

(2009). The unity and diversity of inattention and hyperactivity/impulsivity in ADHD: Evidence for a general factor with separable dimensions. Journal of Abnormal Child Psychology, 37, 1137-1150.

68.

Toplak

M. E.

Sorge

G. B.

Flora

D. B.

Chen

Banaschewski

Buitelaar

. . . Faraone

S. V.

(2012). The hierarchical factor model of ADHD: Invariant across age and national groupings? Journal of Child Psychology and Psychiatry, and Allied Disciplines, 53, 292-303.

69.

Ullebø

A. K.

Breivik

Gillberg

Lundervold

A. J.

Posserud

M. B.

(2012). The factor structure of ADHD in a general population of primary school children. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 53, 927-936.

70.

Wagner

Martel

M. M.

Cogo-Moreira

Moreira

C. R.

Pan

P. M.

Rohde

L. A.

Salum

G. A.

(2015). Attention-deficit/hyperactivity disorder dimensionality: The reliable “g” and the elusive “s” dimensions. European Child & Adolescent Psychiatry, 25, 83-90.

71.

Weiss

D. J.

Gibbons

R. D.

(2007). Computerized adaptive testing with the bifactor model. In GMAC Conference on Computerized Adaptive Testing. Retrieved from http://publicdocs.iacat.org/cat2010/cat07weiss&gibbons.pdf

72.

Willcutt

E. G.

Nigg

J. T.

Pennington

B. F.

Solanto

M. V.

Rohde

L. A.

Tannock

. . . Lahey

B. B.

(2012). Validity of DSM-IV attention-deficit/hyperactivity disorder symptom dimensions and subtypes. Journal of Abnormal Psychology, 121, 991-1010.

73.

Willoughby

M. T.

Blanton

Z. E.

The Family Life Project Investigators. (2015). Replication and external validation of a bi-factor parameterization of attention deficit/hyperactivity symptomatology. Journal of Clinical Child & Adolescent Psychology, 44, 68-79.

74.

Wolraich

M. L.

Feurer

I. D.

Hannah

J. H.

Baumgaertel

Pinnock

T. Y.

(1998). Obtaining systematic teacher reports of disruptive behavior disorders utilizing DSM-IV. Journal of Abnormal Child Psychology, 26, 141-152.

75.

Wolraich

M. L.

Lambert

Doffing

M. A.

Bickman

Simmons

Worley

(2003). Psychometric properties of the Vanderbilt ADHD Diagnostic Parent Rating Scale in a referred population. Journal of Pediatric Psychology, 28, 559-567.

76.

Zinbarg

R. E.

Yovel

Revelle

McDonald

R. P.

(2006). Estimating generalizability to a latent variable common to all of a scale’s indicators: A comparison of estimators for ω_h. Applied Psychological Measurement, 30, 121-144.