Despite the importance of daily life executive functioning (EF) for college students’ success, few measures exist that have been validated in college students specifically. This study examined the factor structure of the Barkley Deficits in Executive Functioning Scale (BDEFS) in college students. Participants were 1,311 students (ages 18-28 years, 65% female) from five universities in the United States. Additionally, the study examined invariance across sex, age, and attention-deficit/hyperactivity disorder symptoms. Exploratory structural equation modeling provided strong support for the BDEFS five-factor structure though some items had high cross-loadings on multiple factors. Findings generally supported invariance across sex and age; however, loadings, thresholds, and factor means differed based on attention-deficit/hyperactivity disorder symptoms. Stronger support for invariance across sex emerged for a reduced item version that eliminated cross-loading items. Overall, findings provide support for the validity and utility of the BDEFS in college students.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed). Arlington, VA: Author.
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed). Arlington, VA: Author.
3.
BarkleyR. A. (1997). ADHD and the nature of self-control. New York, NY: Guilford Press.
4.
BarkleyR. A. (2010). Differential diagnosis of adults with ADHD: The role of executive function and self-regulation. Journal of Clinical Psychiatry, 71(7), e17. doi:10.4088/JCP.9066tx1c
5.
BarkleyR. A. (2011a). Barkley Adult ADHD Rating Scale–IV (BAARS-IV). New York, NY: Guilford Press.
6.
BarkleyR. A. (2011b). Barkley Deficits in Executive Functioning Scale (BDEFS for adults). New York, NY: Guilford Press.
7.
BarkleyR. A. (2012). Barkley Deficits in Executive Functioning Scale–Children and Adolescents (BDEFS-CA). New York, NY: Guilford Press.
8.
BarkleyR. A.FischerM. (2011). Predicting impairment in major life activities and occupational functioning in hyperactive children as adults: Self-reported executive function (EF) deficits versus EF tests. Developmental Neuropsychology, 36, 137-161. doi:10.1080/87565641.2010.549877
9.
BarkleyR. A.MurphyK. R. (2011). The nature of executive function (EF) deficits in daily life activities in adults with ADHD and their relationship to performance on EF Tests. Journal of Psychopathology and Behavioral Assessment, 33, 137-158.
10.
BeckerS. P.JarrettM. A.LuebbeA. M.GarnerA. A.BurnsG. L.KoflerM. J. (2018). Sleep in a large, multi-university sample of college students: Sleep problem prevalence, sex differences, and mental health correlates. Sleep Health, 4, 174-181.
11.
BiedermanJ.PettyC.FriedR.FontanellaJ.DoyleA. E.SeidmanL. J.FaraoneS. V. (2006). Impact of psychometrically defined deficits of executive functioning in adults with attention deficit hyperactivity disorder. American Journal of Psychiatry, 163, 1730-1738. doi:10.1176/ajp.2006.163.10.1730
12.
BogodN. M.MateerC. A.MacDonaldS. W. (2003). Self-awareness after traumatic brain injury: A comparison of measures and their relationship to executive functions. Journal of International Neuropsychological Society, 9, 450-458. doi:10.1017/S1355617703930104
13.
BoothT.HughesD. J. (2014). Exploratory structural equation modeling of personality data. Assessment, 21, 260-271. doi:10.1177/1073191114528029
14.
BrownT. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). New York, NY: Guilford Press.
15.
BrowneM. W.CudeckR. (1993). Alternative ways of assessing model fit. In BollenK. A.LongJ. S. (Eds.), Testing structural equation models (pp. 136-162). London, England: Sage.
16.
BurgessP. W.AldermanN.EvansJ.EmslieH.WilsonB. A. (1998). The ecological validity of tests of executive function. Journal of International Neuropsychological Society, 4, 547-558.
17.
BurnsL. R.DittmanK.NguyenN.MitchelsonJ. K. (2000). Academic procrastination, perfectionism, and control: Associations with vigilant and avoidant coping. Journal of Social Behavior and Personality, 5, 35-46.
18.
CarragherN.KruegerR. F.EatonN. R.MarkonK. E.KeyesK. M.BlancoC.. . . HasinD. S. (2014). ADHD and the externalizing spectrum: Direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample. Social Psychiatry and Psychiatry Epidemiology, 49, 1307-1317. doi:10.1007/s00127-013-0770-3
19.
ColeD. A.PerkinsC. E.ZelkowitzR. L. (2016). Impact of homogeneous and heterogeneous parceling strategies when latent variables represent multidimensional constructs. Psychological Methods, 21, 164-174. doi:10.1037/met0000047
20.
CostelloA. B.OsborneJ. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1-9.
21.
DehiliV. M.PrevattF.CoffmanT. P. (2017). An analysis of the Barkley Deficits in Executive Functioning Scale in a college population: Does it predict symptoms of ADHD better than a visual-search task?Journal of Attention Disorders, 21, 567-574. doi:10.1177/1087054713498932
22.
FriedmanN. P.MiyakeA.AltamiranoL. J.CorleyR. P.YoungS. E.RheaS. A.HewittJ. K. (2016). Stability and change in executive function abilities from late adolescence to early adulthood: A longitudinal twin study. Developmental Psychology, 52, 326-340. doi:10.1037/dev0000075
23.
FriedmanN. P.MiyakeA.YoungS. E.DefriesJ. C.CorleyR. P.HewittJ. K. (2008). Individual differences in executive functions are almost entirely genetic in origin. Journal of Experimental Psychology General, 137, 201-225. doi:10.1037/0096-3445.137.2.201
24.
GarridoL. E.AbadF. J.PonsodaV. (2013). A new look at Horn’s parallel analysis with ordinal variables. Psychological Methods, 18, 454-474. doi:10.1037/a0030005
25.
GerstorfD.SiedleckiK. L.Tucker-DrobE. M.SalthouseT. A. (2008). Executive dysfunctions across adulthood: Measurement properties and correlates of the DEX self-report questionnaire. Aging, Neuropsychology, and Cognition, 15, 424-445. doi:10.1080/13825580701640374
26.
HuL. T.BentlerP. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
27.
HuL. T.BentlerP. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
28.
HuizingaM.DolanC. V.van der MolenM. W. (2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44, 2017-2036. doi:10.1016/j.neuropsychologia.2006.01.010
29.
JanssenG. T.De MeyH. R.EggerJ. I. (2009). Executive functioning in college students: Evaluation of the Dutch executive function index (EFI-NL). International Journal of Neuroscience, 119, 792-805. doi:10.1080/00207450802333979
30.
JarrettM. A. (2016). Attention-deficit/hyperactivity disorder (ADHD) symptoms, anxiety symptoms, and executive functioning in emerging adults. Psychological Assessment, 28, 245-250. doi:10.1037/pas0000190
31.
KachgalM. M.HansenS. L.NutterK. J. (2001). Academic procrastination/intervention: Strategies and recommendations. Journal of Developmental Education, 25, 14-24.
32.
KamradtJ. M.UllspergerJ. M.NikolasM. A. (2014). Executive function assessment and adult attention-deficit/hyperactivity disorder: Tasks versus ratings on the Barkley deficits in executive functioning scale. Psychological Assessment, 26, 1095-1105. doi:10.1037/pas0000006
33.
LaCountP. A.HartungC. M.SheltonC. R.StevensA. E. (2018). Efficacy of an organizational skills intervention for college students with ADHD symptomatology and academic difficulties. Journal of Attention Disorders, 22, 356-367. doi:10.1177/1087054715594423
34.
LarssonH.AnckarsaterH.RastamM.ChangZ.LichtensteinP. (2012). Childhood attention-deficit hyperactivity disorder as an extreme of a continuous trait: A quantitative genetic study of 8,500 twin pairs. Journal of Child Psychology and Psychiatry, 53, 73-80. doi:10.1111/j.1469-7610.2011.02467.x
35.
LezakM. D. (1995). Neuropsychological assessment. New York, NY: Oxford University Press.
36.
LittleT. D. (2013). Methodology in the social sciences. Longitudinal structural equation modeling. New York, NY, US: Guilford Press.
37.
LittleT. D.RhemtullaM.GibsonK.SchoemannA. M. (2013). Why the items versus parcels controversy needn’t be one. Psychological Methods, 18, 285-300. doi:10.1037/a0033266
38.
MarcusD. K.NorrisA. L.CoccaroE. F. (2012). The latent structure of attention deficit/hyperactivity disorder in an adult sample. Journal of Psychiatry Research, 46, 782-789. doi:10.1016/j.jpsychires.2012.03.010
39.
MarshH. W.LudtkeO.NagengastB.MorinA. J.Von DavierM. (2013). Why item parcels are (almost) never appropriate: Two wrongs do not make a right—camouflaging misspecification with item parcels in CFA models. Psychological Methods, 18, 257-284. doi:10.1037/a0032773
40.
MischelW.AydukO.BermanM. G.CaseyB. J.GotlibI. H.JonidesJ.. . . ShodaY. (2011). “Willpower” over the life span: Decomposing self-regulation. Social Cognitive and Affective Neuroscience, 6, 252-256. doi:10.1093/scan/nsq081
41.
MoffittT. E.ArseneaultL.BelskyD.DicksonN.HancoxR. J.HarringtonH.. . . CaspiA. (2011). A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the National Academy of Sciences of the United States of America, 108, 2693-2698. doi:10.1073/pnas.1010076108
42.
MoonS. M.IllingworthA. J. (2005). Exploring the dynamic nature of procrastination: A latent growth curve analysis of academic procrastination. Personality and Individual Differences, 38, 297-309.
43.
MorisanoD.HirshJ. B.PetersonJ. B.PihlR. O.ShoreB. M. (2010). Setting, elaborating, and reflecting on personal goals improves academic performance. Journal of Applied Psychology, 95, 255-264. doi:10.1037/a0018478
44.
MunroB. A.WeyandtL. L.MarracciniM. E.OsterD. R. (2017). The relationship between nonmedical use of prescription stimulants, executive functioning and academic outcomes. Addictive Behavior, 65, 250-257. doi:10.1016/j.addbeh.2016.08.023
45.
MuthénL. K.MuthénB. O. (2011). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén & Muthén.
46.
NaglieriJ. A.GoldsteinS. (2017). Comprehensive Executive Function Inventory Adult–CEFI Adult). North Tonawanda, NY: MHS.
47.
O’HearnK.AsatoM.OrdazS.LunaB. (2008). Neurodevelopment and executive function in autism. Developmental Psychopathology, 20, 1103-1132. doi:10.1017/S0954579408000527
48.
OnwuegbuzieA. J. (2004). Academic procrastination and statistics anxiety. Assessment and Evaluation in Higher Education, 29, 3-19.
49.
OppenheimerD. M.MeyvisT.DavidenkoN. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45, 867-872.
50.
PenningtonB. F.OzonoffS. (1996). Executive functions and developmental psychopathology. Journal of Child Psychology and Psychiatry, 37, 51-87.
51.
PetersenR.LavelleE.GuarinoA. J. (2006). The relationship between college students’ executive functioning and study strategies. Journal of College Reading and Learning, 36(2), 59-67.
52.
PharoH.SimC.GrahamM.GrossJ.HayneH. (2011). Risky business: Executive function, personality, and reckless behavior during adolescence and emerging adulthood. Behavioral Neuroscience, 125, 970-978. doi:10.1037/a0025768
53.
PrevattF.YellandS. (2015). An empirical evaluation of ADHD coaching in college students. Journal of Attention Disorder, 19, 666-677. doi:10.1177/1087054713480036
54.
RabinL. A.FogelJ.Nutter-UphamK. E. (2011). Academic procrastination in college students: The role of self-reported executive function. Journal of Clinical and Experimental Neuropsychology, 33, 344-357. doi:10.1080/13803395.2010.518597
55.
RomerD. (2010). Adolescent risk taking, impulsivity, and brain development: Implications for prevention. Developmental Psychobiology, 52, 263-276. doi:10.1002/dev.20442
56.
RothR. M.IsquithP. K.GioiaG. A. (2005). BRIEF-A: Behavior Rating Inventory of Executive Function—Adult Version manual. Odessa, FL: Psychological Assessment Resources.
57.
Sandra KooijJ. J.Marije BoonstraA.SwinkelsS. H.BekkerE. M.de NoordI.BuitelaarJ. K. (2008). Reliability, validity, and utility of instruments for self-report and informant report concerning symptoms of ADHD in adult patients. Journal of Attention Disorders, 11, 445-458. doi:10.1177/1087054707299367
58.
SchutzP. A.WhiteV. E.LanehartS. L. (2000). Core goals and their relationship to semester sub goals and academic performance. Journal of College Student Retention, 2, 13-28.
59.
SnyderH. R. (2013). Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: A meta-analysis and review. Psychological Bulletin, 139, 81-132. doi:10.1037/a0028727
60.
SpinellaM. (2005). Self-rated executive function: Development of the executive function index. International Journal of Neuro-science, 115, 649-667. doi:10.1080/00207450590524304
61.
TiceD. M.BaumeisterR. F. (1997). Longitudinal study of procrastination, performance, stress and health: The costs and benefits of dawdling. Psychological Science, 8, 454-458.
62.
TimmermanM. E.Lorenzo-SevaU. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16, 209-220. doi:10.1037/a0023353
63.
ToplakM. E.WestR. F.StanovichK. E. (2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct?Journal of Child Psychology and Psychiatry, 54, 131-143. doi:10.1111/jcpp.12001
64.
U.S. Department of Education, National Center for Education Statistics. (2018). Digest of Education Statistics, 2016 (NCES 2017-094, chap. 3). Washington, DC: Author.
65.
Velez-PastranaM. C.GonzalezR. A.Rodriguez CardonaJ.Purcell BaergaP.Alicea RodriguezA.LevinF. R. (2016). Psychometric properties of the Barkley Deficits in Executive Functioning Scale: A Spanish-language version in a community sample of Puerto Rican adults. Psychological Assessment, 28, 483-498. doi:10.1037/pas0000171
66.
WeyandtL. L. (2005). Executive function in children, adolescents, and adults with attention deficit hyperactivity disorder: Introduction to the special issue. Developmental Neuropsychology, 27, 1-10. doi:10.1207/s15326942dn2701_1
67.
WillcuttE. G.DoyleA. E.NiggJ. T.FaraoneS. V.PenningtonB. F. (2005). Validity of the executive function theory of attention-deficit/hyperactivity disorder: A meta-analytic review. Biological Psychiatry, 57, 1336-1346. doi:10.1016/j.biopsych.2005.02.006
68.
WodkaE. L.MostofskyS. H.PrahmeC.Gidley LarsonJ. C.LoftisC.DencklaM. B.MahoneE. M. (2008). Process examination of executive function in ADHD: Sex and subtype effects. Clinical Neuropsychology, 22, 826-841. doi:10.1080/13854040701563583
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
