Barkley Deficits in Executive Functioning Scale (BDEFS): Validation in a Large Multisite College Sample

Abstract

Despite the importance of daily life executive functioning (EF) for college students’ success, few measures exist that have been validated in college students specifically. This study examined the factor structure of the Barkley Deficits in Executive Functioning Scale (BDEFS) in college students. Participants were 1,311 students (ages 18-28 years, 65% female) from five universities in the United States. Additionally, the study examined invariance across sex, age, and attention-deficit/hyperactivity disorder symptoms. Exploratory structural equation modeling provided strong support for the BDEFS five-factor structure though some items had high cross-loadings on multiple factors. Findings generally supported invariance across sex and age; however, loadings, thresholds, and factor means differed based on attention-deficit/hyperactivity disorder symptoms. Stronger support for invariance across sex emerged for a reduced item version that eliminated cross-loading items. Overall, findings provide support for the validity and utility of the BDEFS in college students.

Keywords

attention-deficit/hyperactivity disorder (ADHD)emerging adults executive functions psychometrics sex differences university

Get full access to this article

View all access options for this article.

References

American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed). Arlington, VA: Author.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed). Arlington, VA: Author.

Barkley

R. A.

(1997). ADHD and the nature of self-control. New York, NY: Guilford Press.

Barkley

R. A.

(2010). Differential diagnosis of adults with ADHD: The role of executive function and self-regulation. Journal of Clinical Psychiatry, 71(7), e17. doi:10.4088/JCP.9066tx1c

Barkley

R. A.

(2011a). Barkley Adult ADHD Rating Scale–IV (BAARS-IV). New York, NY: Guilford Press.

Barkley

R. A.

(2011b). Barkley Deficits in Executive Functioning Scale (BDEFS for adults). New York, NY: Guilford Press.

Barkley

R. A.

(2012). Barkley Deficits in Executive Functioning Scale–Children and Adolescents (BDEFS-CA). New York, NY: Guilford Press.

Barkley

R. A.

Fischer

(2011). Predicting impairment in major life activities and occupational functioning in hyperactive children as adults: Self-reported executive function (EF) deficits versus EF tests. Developmental Neuropsychology, 36, 137-161. doi:10.1080/87565641.2010.549877

Barkley

R. A.

Murphy

K. R.

(2011). The nature of executive function (EF) deficits in daily life activities in adults with ADHD and their relationship to performance on EF Tests. Journal of Psychopathology and Behavioral Assessment, 33, 137-158.

10.

Becker

S. P.

Jarrett

M. A.

Luebbe

A. M.

Garner

A. A.

Burns

G. L.

Kofler

M. J.

(2018). Sleep in a large, multi-university sample of college students: Sleep problem prevalence, sex differences, and mental health correlates. Sleep Health, 4, 174-181.

11.

Biederman

Petty

Fried

Fontanella

Doyle

A. E.

Seidman

L. J.

Faraone

S. V.

(2006). Impact of psychometrically defined deficits of executive functioning in adults with attention deficit hyperactivity disorder. American Journal of Psychiatry, 163, 1730-1738. doi:10.1176/ajp.2006.163.10.1730

12.

Bogod

N. M.

Mateer

C. A.

MacDonald

S. W.

(2003). Self-awareness after traumatic brain injury: A comparison of measures and their relationship to executive functions. Journal of International Neuropsychological Society, 9, 450-458. doi:10.1017/S1355617703930104

13.

Booth

Hughes

D. J.

(2014). Exploratory structural equation modeling of personality data. Assessment, 21, 260-271. doi:10.1177/1073191114528029

14.

Brown

T. A.

(2015). Confirmatory factor analysis for applied research (2nd ed.). New York, NY: Guilford Press.

15.

Browne

M. W.

Cudeck

(1993). Alternative ways of assessing model fit. In Bollen

K. A.

Long

J. S.

(Eds.), Testing structural equation models (pp. 136-162). London, England: Sage.

16.

Burgess

P. W.

Alderman

Evans

Emslie

Wilson

B. A.

(1998). The ecological validity of tests of executive function. Journal of International Neuropsychological Society, 4, 547-558.

17.

Burns

L. R.

Dittman

Nguyen

Mitchelson

J. K.

(2000). Academic procrastination, perfectionism, and control: Associations with vigilant and avoidant coping. Journal of Social Behavior and Personality, 5, 35-46.

18.

Carragher

Krueger

R. F.

Eaton

N. R.

Markon

K. E.

Keyes

K. M.

Blanco

. . . Hasin

D. S.

(2014). ADHD and the externalizing spectrum: Direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample. Social Psychiatry and Psychiatry Epidemiology, 49, 1307-1317. doi:10.1007/s00127-013-0770-3

19.

Cole

D. A.

Perkins

C. E.

Zelkowitz

R. L.

(2016). Impact of homogeneous and heterogeneous parceling strategies when latent variables represent multidimensional constructs. Psychological Methods, 21, 164-174. doi:10.1037/met0000047

20.

Costello

A. B.

Osborne

J. W.

(2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1-9.

21.

Dehili

V. M.

Prevatt

Coffman

T. P.

(2017). An analysis of the Barkley Deficits in Executive Functioning Scale in a college population: Does it predict symptoms of ADHD better than a visual-search task? Journal of Attention Disorders, 21, 567-574. doi:10.1177/1087054713498932

22.

Friedman

N. P.

Miyake

Altamirano

L. J.

Corley

R. P.

Young

S. E.

Rhea

S. A.

Hewitt

J. K.

(2016). Stability and change in executive function abilities from late adolescence to early adulthood: A longitudinal twin study. Developmental Psychology, 52, 326-340. doi:10.1037/dev0000075

23.

Friedman

N. P.

Miyake

Young

S. E.

Defries

J. C.

Corley

R. P.

Hewitt

J. K.

(2008). Individual differences in executive functions are almost entirely genetic in origin. Journal of Experimental Psychology General, 137, 201-225. doi:10.1037/0096-3445.137.2.201

24.

Garrido

L. E.

Abad

F. J.

Ponsoda

(2013). A new look at Horn’s parallel analysis with ordinal variables. Psychological Methods, 18, 454-474. doi:10.1037/a0030005

25.

Gerstorf

Siedlecki

K. L.

Tucker-Drob

E. M.

Salthouse

T. A.

(2008). Executive dysfunctions across adulthood: Measurement properties and correlates of the DEX self-report questionnaire. Aging, Neuropsychology, and Cognition, 15, 424-445. doi:10.1080/13825580701640374

26.

L. T.

Bentler

P. M.

(1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.

27.

L. T.

Bentler

P. M.

(1999). Cut-off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.

28.

Huizinga

Dolan

C. V.

van der Molen

M. W.

(2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44, 2017-2036. doi:10.1016/j.neuropsychologia.2006.01.010

29.

Janssen

G. T.

De Mey

H. R.

Egger

J. I.

(2009). Executive functioning in college students: Evaluation of the Dutch executive function index (EFI-NL). International Journal of Neuroscience, 119, 792-805. doi:10.1080/00207450802333979

30.

Jarrett

M. A.

(2016). Attention-deficit/hyperactivity disorder (ADHD) symptoms, anxiety symptoms, and executive functioning in emerging adults. Psychological Assessment, 28, 245-250. doi:10.1037/pas0000190

31.

Kachgal

M. M.

Hansen

S. L.

Nutter

K. J.

(2001). Academic procrastination/intervention: Strategies and recommendations. Journal of Developmental Education, 25, 14-24.

32.

Kamradt

J. M.

Ullsperger

J. M.

Nikolas

M. A.

(2014). Executive function assessment and adult attention-deficit/hyperactivity disorder: Tasks versus ratings on the Barkley deficits in executive functioning scale. Psychological Assessment, 26, 1095-1105. doi:10.1037/pas0000006

33.

LaCount

P. A.

Hartung

C. M.

Shelton

C. R.

Stevens

A. E.

(2018). Efficacy of an organizational skills intervention for college students with ADHD symptomatology and academic difficulties. Journal of Attention Disorders, 22, 356-367. doi:10.1177/1087054715594423

34.

Larsson

Anckarsater

Rastam

Chang

Lichtenstein

(2012). Childhood attention-deficit hyperactivity disorder as an extreme of a continuous trait: A quantitative genetic study of 8,500 twin pairs. Journal of Child Psychology and Psychiatry, 53, 73-80. doi:10.1111/j.1469-7610.2011.02467.x

35.

Lezak

M. D.

(1995). Neuropsychological assessment. New York, NY: Oxford University Press.

36.

Little

T. D.

(2013). Methodology in the social sciences. Longitudinal structural equation modeling. New York, NY, US: Guilford Press.

37.

Little

T. D.

Rhemtulla

Gibson

Schoemann

A. M.

(2013). Why the items versus parcels controversy needn’t be one. Psychological Methods, 18, 285-300. doi:10.1037/a0033266

38.

Marcus

D. K.

Norris

A. L.

Coccaro

E. F.

(2012). The latent structure of attention deficit/hyperactivity disorder in an adult sample. Journal of Psychiatry Research, 46, 782-789. doi:10.1016/j.jpsychires.2012.03.010

39.

Marsh

H. W.

Ludtke

Nagengast

Morin

A. J.

Von Davier

(2013). Why item parcels are (almost) never appropriate: Two wrongs do not make a right—camouflaging misspecification with item parcels in CFA models. Psychological Methods, 18, 257-284. doi:10.1037/a0032773

40.

Mischel

Ayduk

Berman

M. G.

Casey

B. J.

Gotlib

I. H.

Jonides

. . . Shoda

(2011). “Willpower” over the life span: Decomposing self-regulation. Social Cognitive and Affective Neuroscience, 6, 252-256. doi:10.1093/scan/nsq081

41.

Moffitt

T. E.

Arseneault

Belsky

Dickson

Hancox

R. J.

Harrington

. . . Caspi

(2011). A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the National Academy of Sciences of the United States of America, 108, 2693-2698. doi:10.1073/pnas.1010076108

42.

Moon

S. M.

Illingworth

A. J.

(2005). Exploring the dynamic nature of procrastination: A latent growth curve analysis of academic procrastination. Personality and Individual Differences, 38, 297-309.

43.

Morisano

Hirsh

J. B.

Peterson

J. B.

Pihl

R. O.

Shore

B. M.

(2010). Setting, elaborating, and reflecting on personal goals improves academic performance. Journal of Applied Psychology, 95, 255-264. doi:10.1037/a0018478

44.

Munro

B. A.

Weyandt

L. L.

Marraccini

M. E.

Oster

D. R.

(2017). The relationship between nonmedical use of prescription stimulants, executive functioning and academic outcomes. Addictive Behavior, 65, 250-257. doi:10.1016/j.addbeh.2016.08.023

45.

Muthén

L. K.

Muthén

B. O.

(2011). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén & Muthén.

46.

Naglieri

J. A.

Goldstein

(2017). Comprehensive Executive Function Inventory Adult–CEFI Adult). North Tonawanda, NY: MHS.

47.

O’Hearn

Asato

Ordaz

Luna

(2008). Neurodevelopment and executive function in autism. Developmental Psychopathology, 20, 1103-1132. doi:10.1017/S0954579408000527

48.

Onwuegbuzie

A. J.

(2004). Academic procrastination and statistics anxiety. Assessment and Evaluation in Higher Education, 29, 3-19.

49.

Oppenheimer

D. M.

Meyvis

Davidenko

(2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45, 867-872.

50.

Pennington

B. F.

Ozonoff

(1996). Executive functions and developmental psychopathology. Journal of Child Psychology and Psychiatry, 37, 51-87.

51.

Petersen

Lavelle

Guarino

A. J.

(2006). The relationship between college students’ executive functioning and study strategies. Journal of College Reading and Learning, 36(2), 59-67.

52.

Pharo

Sim

Graham

Gross

Hayne

(2011). Risky business: Executive function, personality, and reckless behavior during adolescence and emerging adulthood. Behavioral Neuroscience, 125, 970-978. doi:10.1037/a0025768

53.

Prevatt

Yelland

(2015). An empirical evaluation of ADHD coaching in college students. Journal of Attention Disorder, 19, 666-677. doi:10.1177/1087054713480036

54.

Rabin

L. A.

Fogel

Nutter-Upham

K. E.

(2011). Academic procrastination in college students: The role of self-reported executive function. Journal of Clinical and Experimental Neuropsychology, 33, 344-357. doi:10.1080/13803395.2010.518597

55.

Romer

(2010). Adolescent risk taking, impulsivity, and brain development: Implications for prevention. Developmental Psychobiology, 52, 263-276. doi:10.1002/dev.20442

56.

Roth

R. M.

Isquith

P. K.

Gioia

G. A.

(2005). BRIEF-A: Behavior Rating Inventory of Executive Function—Adult Version manual. Odessa, FL: Psychological Assessment Resources.

57.

Sandra Kooij

J. J.

Marije Boonstra

Swinkels

S. H.

Bekker

E. M.

de Noord

Buitelaar

J. K

. (2008). Reliability, validity, and utility of instruments for self-report and informant report concerning symptoms of ADHD in adult patients. Journal of Attention Disorders, 11, 445-458. doi:10.1177/1087054707299367

58.

Schutz

P. A.

White

V. E.

Lanehart

S. L.

(2000). Core goals and their relationship to semester sub goals and academic performance. Journal of College Student Retention, 2, 13-28.

59.

Snyder

H. R.

(2013). Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: A meta-analysis and review. Psychological Bulletin, 139, 81-132. doi:10.1037/a0028727

60.

Spinella

(2005). Self-rated executive function: Development of the executive function index. International Journal of Neuro-science, 115, 649-667. doi:10.1080/00207450590524304

61.

Tice

D. M.

Baumeister

R. F.

(1997). Longitudinal study of procrastination, performance, stress and health: The costs and benefits of dawdling. Psychological Science, 8, 454-458.

62.

Timmerman

M. E.

Lorenzo-Seva

(2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16, 209-220. doi:10.1037/a0023353

63.

Toplak

M. E.

West

R. F.

Stanovich

K. E.

(2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, 54, 131-143. doi:10.1111/jcpp.12001

64.

U.S. Department of Education, National Center for Education Statistics. (2018). Digest of Education Statistics, 2016 (NCES 2017-094, chap. 3). Washington, DC: Author.

65.

Velez-Pastrana

M. C.

Gonzalez

R. A.

Rodriguez Cardona

Purcell Baerga

Alicea Rodriguez

Levin

F. R.

(2016). Psychometric properties of the Barkley Deficits in Executive Functioning Scale: A Spanish-language version in a community sample of Puerto Rican adults. Psychological Assessment, 28, 483-498. doi:10.1037/pas0000171

66.

Weyandt

L. L.

(2005). Executive function in children, adolescents, and adults with attention deficit hyperactivity disorder: Introduction to the special issue. Developmental Neuropsychology, 27, 1-10. doi:10.1207/s15326942dn2701_1

67.

Willcutt

E. G.

Doyle

A. E.

Nigg

J. T.

Faraone

S. V.

Pennington

B. F.

(2005). Validity of the executive function theory of attention-deficit/hyperactivity disorder: A meta-analytic review. Biological Psychiatry, 57, 1336-1346. doi:10.1016/j.biopsych.2005.02.006

68.

Wodka

E. L.

Mostofsky

S. H.

Prahme

Gidley Larson

J. C.

Loftis

Denckla

M. B.

Mahone

E. M.

(2008). Process examination of executive function in ADHD: Sex and subtype effects. Clinical Neuropsychology, 22, 826-841. doi:10.1080/13854040701563583

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.31 MB