Sage Journals: Discover world-class research

Abstract

Previous studies examining the factor structure of attention-deficit/hyperactivity disorder (ADHD) symptoms in adults using self-report measures have shown mixed results, supporting two-, three-, and bifactor solutions. The current study further investigated the structure of ADHD symptoms in adults using the Current Symptoms Scale and rigorous model evaluation in a sample of 892 college students. Confirmatory factor analysis was used to analyze and compare five-factor structures; a single-factor model, a two-factor model, a three-factor model, and two bifactor models. A single-factor model with correlated residuals best fit the data. Factor correlations with nearly all related constructs (i.e., symptoms of oppositional defiant disorder, depression, impairment, previous ADHD diagnosis, grades, and substance use) were significant in the expected directions and the model was invariant across gender. These findings contribute to a growing body of work suggesting a unidimensional factor may best represent ADHD symptoms in adults. Implications are discussed.

Keywords

ADHD Barkley Current Symptoms Scale factor structure college students adults

Get full access to this article

View all access options for this article.

References

American Psychiatric Association. (1968). Diagnostic and statistical manual of mental disorders (2nd ed.). Author.

American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Author.

American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed. Rev.). Author.

American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Author.

American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., Text Rev.). Author.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Author. https://doi.org/10.1176/appi.books.9780890425596

Arias

V. B.

Ponce

F. P.

Núñez

D. E.

(2018). Bi-factor models of attention-deficit/hyperactivity disorder (ADHD): An evaluation of three necessary but underused psychometric indexes. Assessment, 25(7), 885-897. https://doi.org/10.1177/1073191116679260

Arnett

J. J.

(2000). Emerging adulthood: A theory of development from the late teens through the twenties. American Psychologist, 55(5), 469-480. https://doi.org/10.1037/0003-066X.55.5.469

Arnett

J. J.

(2016). College students as emerging adults: The developmental implications of the college context. Emerging Adulthood, 4(3), 219-222. https://doi.org/10.1177/2167696815587422

10.

Asherson

Ramos-Quiroga

J. A.

Young

(2018). Adult ADHD: Clinical presentation and assessment. In Banaschewski

Coghill

Zuddas

(Eds.), Oxford textbook of attention deficit hyperactivity disorder (pp. 178-189). Oxford University Press.

11.

Asparouhov

Muthén

(2006). Robust chi square difference testing with mean and variance adjusted test statistics (Mplus Web Notes No. 10). Muthén & Muthén. http://www.statmodel.com/download/webnotes/webnote10.pdf

12.

Asparouhov

Muthén

B. O.

(2010). Simple second order chi-square correction scaled chi-square statistics (Technical Appendix). Muthén & Muthén.

13.

Barkley

R. A.

(1997). Behavioral inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD. Psychological Bulletin, 121(1), 65-94. https://doi.org/10.1037/0033-2909.121.1.65

14.

Barkley

R. A.

(2011). Barkley Adult ADHD Rating Scale–IV (BAARS-IV). Guilford Press.

15.

Barkley

R. A.

Fischer

Smallish

Fletcher

(2002). The persistence of attention-deficit/hyperactivity disorder into young adulthood as a function of reporting source and definition of disorder. Journal of Abnormal Psychology, 111(2), 279-289. https://doi.org/10.1037/0021-843X.111.2.279

16.

Barkley

R. A.

Murphy

K. R.

(2006). Attention-deficit hyperactivity disorder: A handbook for diagnosis and treatment (3rd ed.). Guilford Press.

17.

Batstra

Frances

(2012). DSM-5 further inflates attention deficit hyperactivity disorder. Journal of Nervous and Mental Disease, 200(6), 486-488. https://doi.org/10.1097/NMD.0b013e318257c4b6

18.

Biederman

Faraone

S. V.

Spencer

Wilens

Mick

Lapey

K. A.

(1994). Gender differences in a sample of adults with attention deficit hyperactivity disorder. Psychiatry Research, 53(1), 13-29. https://doi.org/10.1016/0165-1781(94)90092-2

19.

Bonifay

Lane

S. P.

Reise

S. P.

(2017). Three concerns with applying a bi-factor model as a structure of psychopathology. Clinical Psychological Science, 5(1), 184-186. https://doi.org/10.1177/2167702616657069

20.

Brown

T. A.

(2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.

21.

Caye

Swanson

Thapar

Sibley

Arseneault

Hechtman

Arnold

L. E.

Niclasen

Moffitt

Rohde

L. A.

(2016). Life span studies of ADHD: Conceptual challenges and predictors of persistence and outcome. Current Psychiatry Reports, 18(12), Article 111. https://doi.org/10.1007/s11920-016-0750-x

22.

Chen

F. F.

(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464-504. https://doi.org/10.1080/10705510701301834

23.

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255. https://doi.org/10.1207/S15328007SEM0902_5

24.

Cohen

(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum.

25.

DuPaul

G. J.

Schaughency

E. A.

Weyandt

L. L.

Tripp

Kiesner

Ota

Stanish

(2001). Self-report of ADHD symptoms in university students: Cross-gender and cross-national prevalence. Journal of Learning Disabilities, 34(4), 370-379. https://doi.org/10.1177/002221940103400412

26.

DuPaul

G. J.

Weyandt

L. L.

O’Dell

S. M.

Varejao

(2009). College students with ADHD: Current status and future directions. Journal of Attention Disorders, 13(3), 234-250. https://doi.org/10.1177/1087054709340650

27.

Eaton

W. W.

Muntaner

Smith

Tien

Ybarra

(2004). Center for Epidemiologic Studies Depression Scale: Review and revision (CESD and CESD-R). In Maruish

M. E.

(Ed.), The use of psychological testing for treatment planning and outcomes assessment (3rd ed., pp. 363-377). Lawrence Erlbaum. https://doi.org/10.1037/t29280-000

28.

Faraone

S. V.

Biederman

Mick

(2006). The age-dependent decline of attention deficit hyperactivity disorder: A meta-analysis of follow-up studies. Psychological Medicine, 36(2), 159-165. https://doi.org/10.1017/S003329170500471X

29.

Fayyad

De Graaf

Kessler

Alonso

Angermeyer

Demyttenaere

De Girolamo

Haro

J. M.

Karam

E. G.

Lara

Lépine

J. P.

Ormel

Posada-Villa

Zaslavsky

A. M.

Jin

(2007). Cross-national prevalence and correlates of adult attention-deficit hyperactivity disorder. British Journal of Psychiatry, 190(5), 402-409. https://doi.org/10.1192/bjp.bp.106.034389

30.

Fischer

Barkley

R. A.

(2007). The persistence of ADHD into adulthood: (Once again) it depends on whom you ask. ADHD Report, 15(4), 7-16. https://doi.org/10.1521/adhd.2007.15.4.7

31.

Flory

Milich

Lynam

D. R.

Leukefeld

Clayton

(2003). Relation between childhood disruptive behavior disorders and substance use and dependence symptoms in young adulthood: Individuals with symptoms of attention-deficit/hyperactivity disorder are uniquely at risk. Psychology of Addictive Behaviors, 17(2), 151-158. https://doi.org/10.1037/0893-164X.17.2.151

32.

Forero

C. G.

Maydeu-Olivares

Gallardo-Pujol

(2009). Factor analysis with ordinal indicators: A Monte Carlo study comparing DWLS and ULS estimation. Structural Equation Modeling, 16(4), 625-641. https://doi.org/10.1080/10705510903203573

33.

Gibbins

Toplak

M. E.

Flora

D. B.

Weiss

M. D.

Tannock

(2012). Evidence for a general factor model of ADHD in adults. Journal of Attention Disorders, 16(8), 635-644. https://doi.org/10.1177/1087054711416310

34.

Glutting

J. J.

Youngstrom

E. A.

Watkins

M. W.

(2005). ADHD and college students: Exploratory and confirmatory factor structures with student and parent data. Psychological Assessment, 17(1), 44-55. https://doi.org/10.1037/1040-3590.17.1.44

35.

Gomez

(2016). ADHD and hyperkinetic disorder symptoms in Australian adults: Descriptive scores, incidence rates, factor structure, and gender invariance. Journal of Attention Disorders, 20(4), 325-334. https://doi.org/10.1177/1087054713485206

36.

Gomez

Burns

G. L.

Walsh

J. A.

Hafetz

(2005). A multitrait–multisource confirmatory factor analytic approach to the construct validity of ADHD and ODD rating scales with Malaysian children. Journal of Abnormal Child Psychology, 33(2), 241-254. https://doi.org/10.1007/s10802-005-1831-1

37.

Hart

E. L.

Lahey

B. B.

Loeber

Applegate

Frick

P. J.

(1995). Developmental change in attention-deficit hyperactivity disorder in boys: A four-year longitudinal study. Journal of Abnormal Child Psychology, 23(6), 729-749. https://doi.org/10.1007/BF01447474

38.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

39.

Kessler

R. C.

Adler

Barkley

Biederman

Conners

C. K.

Demler

Faraone

S. V.

Greenhill

L. L.

Howes

M. J.

Secnik

Spencer

Ustun

T. B.

Walters

E. E.

Zaslavsky

A. M.

(2006). The prevalence and correlates of adult ADHD in the United States: Results from the National Comorbidity Survey Replication. American Journal of Psychiatry, 163(4), 716-723. https://doi.org/10.1176/ajp.2006.163.4.716

40.

Knouse

L. E.

Safren

S. A.

(2010). Adult attention-deficit hyperactivity disorder. In Baer

Blais

M. A.

(Eds.), Handbook of clinical rating scales and assessment in psychiatry and mental health (pp. 195-208). Humana Press. https://doi.org/10.1007/978-1-59745-387-5_9

41.

Kooij

J. J. S.

Boonstra

A. M.

Swinkels

S. H. N.

Bekker

E. M.

de Noord

Buitellar

J. K.

(2008). Reliability, validity, and utility of instruments for self-report and informant report concerning symptoms of ADHD in adult patients. Journal of Attention Disorders, 11(4), 445-458. https://doi.org/10.1177/1087054707299367

42.

Lahey

B. B.

Applegate

McBurnett

Biederman

Greenhill

Hynd

G. W.

Barkley

R. A.

Newcorn

Jensen

Richters

Garfinkle

Kerdyk

Frick

P. J.

Ollendick

Perez

Hart

E. L.

Waidman

Shaffer

(1994). DMS-IV field trials for attention deficit hyperactivity disorder in children and adolescents. American Journal of Psychiatry, 151(11), 1673-1685. https://doi.org/10.1176/ajp.151.11.1673

43.

Larsson

Chang

D’Onofrio

B. M.

Lichtenstein

(2014). The heritability of clinically diagnosed attention deficit hyperactivity disorder across the lifespan. Psychological Medicine, 44(10), 2223-2229. https://doi.org/10.1017/S0033291713002493

44.

Larsson

Dilshad

Lichtenstein

Barker

E. D.

(2011). Developmental trajectories of DSM-IV symptoms of attention-deficit/hyperactivity disorder: Genetic effects, family risk and associated psychopathology. Journal of Child Psychology and Psychiatry, 52(9), 954-963. https://doi.org/10.1111/j.1469-7610.2011.02379.x

45.

LeRoy

Jacova

Young

(2018). Neuropsychological performance patterns of adult ADHD subtypes. Journal of Attention Disorders, 23(10), 1136-1147. https://doi.org/10.1177/1087054718773927

46.

Levy

Sherritt

Harris

S. K.

Gates

E. C.

Holder

D. W.

Kulig

J. W.

Knight

J. R.

(2004). Test-retest reliability of adolescents’ self-report of substance use. Alcoholism: Clinical & Experimental Research, 28(8), 1236-1241. https://doi.org/10.1097/01.ALC.0000134216.22162.A5

47.

Martel

M. M.

Von Eye

Nigg

(2012). Developmental differences in structure of attention-deficit/hyperactivity disorder (ADHD) between childhood and adulthood. International Journal of Behavioral Development, 36(4), 279-292. https://doi.org/10.1177/0165025412444077

48.

Maydeu-Olivares

Shi

(2017). Effect sizes of model misfit in structural equation models: Standardized residual covariances and residual correlations. Methodology, 13(Suppl. 1), 23-30. https://doi.org/10.1027/1614-2241/a000129

49.

McDonald

R. P.

(1999). Test theory: A unified approach. Lawrence Erlbaum.

50.

Millsap

R. E.

(2012). Statistical approaches to measurement invariance. Routledge. https://doi.org/10.4324/9780203821961

51.

Millsap

R. E.

Yun-Tein

(2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39(3), 479-515. https://doi.org/10.1207/S15327906MBR3903_4

52.

Muthén

L. K.

Muthén

B. O.

(1998-2012). Mplus user’s guide (7th ed.). Muthén & Muthén.

53.

Murray

A. L.

Johnson

(2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41(5), 407-422. https://doi.org/10.1016/j.intell.2013.06.004

54.

Nigg

J. T.

Willcutt

E. G.

Doyle

A. E.

Sonuga-Barke

E. J.

(2005). Causal heterogeneity in attention-deficit/hyperactivity disorder: Do we need neuropsychologically impaired subtypes? Biological Psychiatry, 57(11), 1224-1230. https://doi.org/10.1016/j.biopsych.2004.08.025

55.

Nussbaum

N. L.

(2012). ADHD and female specific concerns: A review of the literature and clinical implications. Journal of Attention Disorders, 16(2), 87-100. https://doi.org/10.1177/1087054711416909

56.

Park

J. L.

Silveira

Elliott

Savalei

Johnston

(2018). Confirmatory factor analysis of the structure of adult ADHD symptoms. Journal of Psychopathology and Behavioral Assessment, 40(4), 573-585. https://doi.org/10.1007/s10862-018-9698-y

57.

Proctor

B. E.

Prevatt

(2009). Confirming the factor structure of attention-deficit/hyperactivity disorder symptoms in college students using student and parent data. Journal of Learning Disabilities, 42(3), 250-259. https://doi.org/10.1177/0022219408331043

58.

Radloff

L. S.

(1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385-401. https://doi.org/10.1177/014662167700100306

59.

Reise

S. P.

(2012). The rediscovery of bi-factor measurement models. Multivariate Behavioral Research, 47(5), 667-696. https://doi.org/10.1080/00273171.2012.715555

60.

Reise

S. P.

Morizot

Hays

R. D.

(2007). The role of the bi-factor model in resolving dimensionality issues in health measurement. Quality of Life Research, 16(1), 19-31. https://doi.org/10.1007/s11136-007-9183-7

61.

Rodriguez

Reise

S. P.

Haviland

M. G.

(2016a). Applying bi-factor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223-237. https://doi.org/10.1080/00223891.2015.1089249

62.

Rodriguez

Reise

S. P.

Haviland

M. G.

(2016b). Evaluating bi-factor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137-150. https://doi.org/10.1037/met0000045

63.

Rodriguez

P. D.

Simon-Dack

S. L.

(2013). Factor analysis of five adult ADHD self-report measures: Are they all the same? Journal of Attention Disorders, 17(1), 64-69. https://doi.org/10.1177/1087054711423627

64.

Samuel

D. B.

(2019). Incoming editorial. Assessment, 26(2), 147-150. https://doi.org/10.1177/1073191118822760

65.

Saris

W. E.

Satorra

Van der Veld

W. M.

(2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling: A Multidisciplinary Journal, 16(4), 561-582. https://doi.org/10.1080/10705510903203433

66.

Shi

DiStefano

McDaniel

H. L.

Jiang

(2018). Examining chi-square test statistics under conditions of large model size and ordinal data. Structural Equation Modeling: A Multidisciplinary Journal, 25(6), 924-945. https://doi.org/10.1080/10705511.2018.1449653

67.

Shi

Maydeu-Olivares

Distefano

(2018). The relationship between the standardized root mean square residual and model misspecification in factor analysis models. Multivariate Behavioral Research, 53(5), 676-694. https://doi.org/10.1080/00273171.2018.1476221

68.

Shi

Song

Lewis

(2017). The impact of partial factorial invariance on cross-group comparison. Assessment, 26(7), 1217-1233. https://doi.org/10.1177/1073191117711020

69.

Smith

E. V.

Jr. Johnson

B. D.

(1998). Factor structure of the DSM-IV criteria for college students using the Adult Behavior Checklist. Measurement and Evaluation in Counseling and Development, 31(3), 164-183. https://doi.org/10.1080/07481756.1998.12068963

70.

Sonuga-Barke

E. J.

Castellanos

(2005). A common core dysfunction in attention-deficit/hyperactivity disorder: A scientific red herring? Behavioral and Brain Sciences, 28(3), 443-444. https://doi.org/10.1017/S0140525X05390078

71.

Span

S. A.

Earleywine

Strybel

T. Z.

(2002). Confirming the factor structure of attention deficit hyperactivity disorder symptoms in adult, nonclinical samples. Journal of Psychopathology and Behavioral Assessment, 24(2), 129-136. https://doi.org/10.1023/A:1015396926356

72.

Stanton

Forbes

M. K.

Zimmerman

(2018). Distinct dimensions defining the Adult ADHD Self-Report Scale: Implications for assessing inattentive and hyperactive/impulsive symptoms. Psychological Assessment, 30(12), 1549-1559. https://doi.org/10.1037/pas0000604

73.

Taylor

Deb

Unwin

(2011). Scales for the identification of adults with attention deficit hyperactivity disorder (ADHD): A systematic review. Research in Developmental Disabilities, 32(3), 924-938. https://doi.org/10.1016/j.ridd.2010.12.036

74.

Upadhyaya

H. P.

Carpenter

M. J.

(2008). Is attention deficit hyperactivity disorder (ADHD) symptom severity associated with tobacco use? American Journal on Addictions, 17(3), 195-198. https://doi.org/10.1080/10550490802021937

75.

U.S. Department of Education, National Center for Education Statistics. (2012). Degrees conferred by degree-granting institutions, by level of degree and sex of student: Selected years, 1869-70 through 2021-22. https://nces.ed.gov/programs/digest/d12/tables/dt12_310.asp

76.

Van Dam

N. T.

Earleywine

. (2011). Validation of the Center for Epidemiologic Studies Depression Scale–Revised (CESD-R): Pragmatic depression assessment in the general population. Psychiatry Research, 186(1), 128-132. https://doi.org/10.1016/j.psychres.2010.08.018

77.

Van de Schoot

Lugtig

Hox

(2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486-492. https://doi.org/10.1080/17405629.2012.686740

78.

Whittaker

T. A.

(2012). Using the modification index and standardized expected parameter change for model modification. Journal of Experimental Education, 80(1), 26-44. https://doi.org/10.1080/00220973.2010.531299

79.

Willcutt

E. G.

(2012). The prevalence of DSM-IV attention-deficit/hyperactivity disorder: A meta-analytic review. Neurotherapeutics, 9(3), 490-499. https://doi.org/10.1007/s13311-012-0135-8

80.

Wolraich

M. L.

Lambert

E. W.

Baumgaertel

Garcia-Tornel

Feurer

I. D.

Bickman

Doffing

M. A.

(2003). Teachers’ screening for attention deficit/hyperactivity disorder: Comparing multinational samples on teacher ratings of ADHD. Journal of Abnormal Child Psychology, 31(4), 445-455. https://doi.org/10.1023/A:1023847719796

81.

Wood

W. L.

Lewandowski

L. J.

Lovett

B. J.

(2019). Profiles of diagnosed and undiagnosed college students meeting ADHD symptom criteria. Journal of Attention Disorders. Advance online publication. https://doi.org/10.1177/1087054718824991

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.10 MB

The Factor Structure and Gender Invariance of ADHD Symptoms in College Students

Abstract

Keywords

Get full access to this article

References

Supplementary Material