The Structural Validity of the Barkley Deficits in Executive Functioning Scale-Short Form Among College Students Who Drink Alcohol

Abstract

The Barkley Deficits in Executive Functioning Scale (BDEFS) is a multidimensional measure of executive functioning (EF). Yet, no work has validated the 20-item BDEFS short form (BDEFS-SF) among individuals at risk of EF deficits, including college students who consume alcohol. The current study evaluated the factor structure and measurement invariance of the BDEFS-SF in 867 undergraduates from 12 colleges/universities who endorsed past-month alcohol use. The bifactor model best fit the data, supporting the use of the general factor over the five subscales for measurement models, and measurement invariance was partially supported across sex assigned at birth. Four subscales were uniquely associated with alcohol use, consequences, and alcohol protective behavioral strategies. The BDEFS-SF total score appears to be a valid measure of EF among undergraduates who use alcohol; however, more research is needed to increase the clinical utility of the measure given the lack of support for the use of the subscales in measurement models.

Keywords

alcohol use executive functioning college students psychometrics protective behavioral strategies

Get full access to this article

View all access options for this article.

References

Abdulaal

El Tantawy

Ibrahim

Elbadry

Hassan

(2023). Cognitive dysfunction in adolescents with substance use disorder. Middle East Current Psychiatry, 30(1), 13. https://doi.org/10.1186/s43045-023-00291-8

Allee-Smith

P. J.

Winters

R. R.

Drake

Joslin

A. K.

(2013). Test review: Barkley Deficits in Executive Functioning Scale (BDEFS). Journal of Psychoeducational Assessment, 31(1), 80–83. https://doi.org/10.1177/0734282912452651

Appelhans

B. M.

Thomas

A. S.

Roisman

G. I.

Booth-LaForce

Bleil

M. E.

(2021). Preexisting executive function deficits and change in health behaviors during the COVID-19 pandemic. International Journal of Behavioral Medicine, 28(6), 813–819. https://doi.org/10.1007/s12529-021-09974-0

Arnett

J. J.

(2005). The developmental context of substance use in emerging adulthood. Journal of Drug Issues, 35(2), 235–254. https://doi.org/10.1177/002204260503500202

Barkley

R. A.

(1997). Behavioral inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD. Psychological Bulletin, 121(1), 65–94. https://doi.org/10.1037/0033-2909.121.1.65

Barkley

R. A.

(2011a). Barkley Deficits in Executive Functioning Scale (BDEFS). Guilford.

Barkley

R. A.

(2011b). Attention-deficit/hyperactivity Disorder, Self-regulation, and Executive Functioning. In Vohs

K. D.

Baumeister

R. F.

(Eds.), Handbook of Self-regulation: Research, Theory, and Applications (2nd ed., pp. 551–563). The Guilford Press.

Barkley

R. A.

Fischer

(2011). Predicting impairment in major life activities and occupational functioning in hyperactive children as adults: Self-reported executive function (EF) deficits versus EF tests. Developmental Neuropsychology, 36(2), 137–161. https://doi.org/10.1080/87565641.2010.549877

Barkley

R. A.

Murphy

K. R.

(2011a). The nature of executive function (EF) deficits in daily life activities in adults with ADHD and their relationship to performance on EF tests. Journal of Psychopathology and Behavioral Assessment, 33(2), 137–158. https://doi.org/10.1007/s10862-011-9217-x

10.

Bechara

(2005). Decision making, impulse control and loss of willpower to resist drugs: A neurocognitive perspective. Nature Neuroscience, 8(11), 1458–1463. https://doi.org/10.1038/nn1584

11.

Bollen

K. A.

(1989). Structural equations with latent variables. John Wiley. https://doi.org/10.1002/9781118619179

12.

Boyraz

Zhu

Aarstad-Martin

(2019). The Brief Self-Control Scale: Measurement invariance across gender and relationship with academic achievement. Canadian Journal of Behavioural Science/Revue Canadienne Des Sciences Du Comportement, 51(3), 201–206. https://doi.org/10.1037/cbs0000134

13.

Brown

T. A.

(2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.

14.

Brunelle

Flood

(2016). Examining the relationship between self-reported executive cognitive functioning and substance misuse in university students. Journal of Substance Use, 21(1), 3–8. https://doi.org/10.3109/14659891.2014.884175

15.

Chen

Curran

P. J.

Bollen

K. A.

Kirby

Paxton

(2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods & Research, 36(4), 462–494. https://doi.org/10.1177/0049124108314720

16.

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5

17.

Clauss

Witte

T. K.

Bardeen

J. R.

(2021). Examining the factor structure and incremental validity of the Barkley Deficits in Executive Functioning Scale–short form in a community sample. Journal of Personality Assessment, 103(6), 777–785. https://doi.org/10.1080/00223891.2021.1887879

18.

Collins

R. L.

Parks

G. A.

Marlatt

G. A.

(1985). Daily Drinking Questionnaire (DDQ) [Database record]. APA PsycTests. https://doi.org/10.1037/t02146-000

19.

Conner

E. R.

(2015). The college experience: Exploring the relationship between sleep, executive function, and alcohol use. Chancellor’s Honors Program Projects. https://trace.tennessee.edu/utk_chanhonoproj/1815

20.

Costa

Bianco

Scifo

Alesi

(2022). Preliminary evaluation of a short version questionnaire for Executive Functioning Self-Report (EF-SR). Current Psychology: A Journal for Diverse Perspectives on Diverse Psychological Issues, 41(4), 2099–2108. https://doi.org/10.1007/s12144-020-00733-0

21.

Day

A. M.

Kahler

C. W.

Ahern

D. C.

Clark

U. S.

(2015). Executive functioning in alcohol use studies: A brief review of findings and challenges in assessment. Current Drug Abuse Reviews, 8(1), 26–40.

22.

Dehili

V. M.

Prevatt

Coffman

T. P.

(2017). An analysis of the Barkley Deficits in Executive Functioning Scale in a college population: Does it predict symptoms of ADHD better than a visual-search task? Journal of Attention Disorders, 21(7), 567–574. https://doi.org/10.1177/1087054713498932

23.

Diamond

(2013). Executive functions. Annual Review of Psychology, 64(1), 135–168. https://doi.org/10.1146/annurev-psych-113011-143750

24.

Feldman

Knouse

L. E.

Robinson

(2013). Executive functioning difficulties and depression symptoms: Multidimensional assessment, incremental validity, and prospective associations. Journal of Cognitive and Behavioral Psychotherapies, 13(2), 259–274.

25.

Fernández-Serrano

M. J.

Pérez-García

Schmidt Río-Valle

Verdejo-García

(2010). Neuropsychological consequences of alcohol and drug abuse on different components of executive functions. Journal of Psychopharmacology, 24(9), 1317–1332. https://doi.org/10.1177/0269881109349841

26.

Goldman

M. S.

Brown

S. A.

Christiansen

B. A.

Smith

G. T.

(1991). Alcoholism and memory: Broadening the scope of alcohol-expectancy research. Psychological Bulletin, 110(1), 137–146. https://doi.org/10.1037/0033-2909.110.1.137

27.

Goudriaan

A. E.

Grekin

E. R.

Sher

K. J.

(2011). Decision making and response inhibition as predictors of heavy alcohol use: A prospective study. Alcohol: Clinical and Experimental Research, 35(6), 1050–1057. https://doi.org/10.1111/j.1530-0277.2011.01437.x

28.

Gray-Burrows

Taylor

O’Connor

Sutherland

Stoet

Conner

(2019). A systematic review and meta-analysis of the executive function-health behaviour relationship. Health Psychology and Behavioral Medicine, 7(1), 253–268. https://doi.org/10.1080/21642850.2019.1637740

29.

Gustavson

D. E.

Stallings

M. C.

Corley

R. P.

Miyake

Hewitt

J. K.

Friedman

N. P.

(2017). Executive functions and substance use: Relations in late adolescence and early adulthood. Journal of Abnormal Psychology, 126, 257–270. https://doi.org/10.1037/abn0000250

30.

Hilton

D. C.

Canu

W. H.

Jarrett

M. A.

(2024). The importance of executive functioning for social skills in college students: A relative weights analysis. Journal of American College Health, 72(7), 2287–2294. https://doi.org/10.1080/07448481.2022.2109038

31.

L.-t.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

32.

Hurlocker

Madson

M. B.

Lui

P. P.

Dvorak

Ham

L. S.

Leffingwell

Looby

Meier

Montes

Napper

L. E.

Prince

M. A.

Skewes

Zamboanga

B. L.

, & Harm Reduction Research Team. (2022). Mental health risk profiles and related substance use during coronavirus pandemic among college students who use substances. International Journal of Mental Health and Addiction, 21, 3641–3658. https://doi.org/10.1007/s11469-022-00813-1

33.

Saylor

Earle

F. S.

(2021). Sufficient sleep attenuates COVID-19 pandemic-related executive dysfunction in late adolescents and young adults. Sleep Medicine, 85, 21–24. https://doi.org/10.1016/j.sleep.2021.06.027

34.

Kahler

C. W.

Strong

D. R.

Read

J. P.

(2005). Toward efficient and comprehensive measurement of the alcohol problems continuum in college students: The Brief Young Adult Alcohol Consequences Questionnaire. Alcoholism: Clinical and Experimental Research, 29(7), 1180–1189. https://doi.org/10.1097/01.ALC.0000171940.95813.A5

35.

Kamradt

J. M.

Nikolas

M. A.

Burns

G. L.

Garner

A. A.

Jarrett

M. A.

Luebbe

A. M.

Becker

S. P.

(2021). Barkley Deficits in Executive Functioning Scale (BDEFS): Validation in a large multisite college sample. Assessment, 28(3), 964–976. https://doi.org/10.1177/1073191119869823

36.

Karr

J. E.

Areshenkoff

C. N.

Rast

Hofer

S. M.

Iverson

G. L.

Garcia-Barrera

M. A.

(2018). The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychological Bulletin, 144(11), 1147–1185. https://doi.org/10.1037/bul0000160

37.

Kline

R. B.

(2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press.

38.

Knouse

L. E.

Feldman

Blevins

E. J.

(2014). Executive functioning difficulties as predictors of academic performance: Examining the role of grade goals. Learning and Individual Differences, 36, 19–26. https://doi.org/10.1016/j.lindif.2014.07.001

39.

Kroenke

Spitzer

R. L.

Williams

J. B. W.

(2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 19, 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x

40.

Kwako

L. E.

Koob

G. F.

(2017). Neuroclinical framework for the role of stress in addiction. Chronic Stress, 1, 247054701769814. https://doi.org/10.1177/2470547017698140

41.

Kwako

L. E.

Momenan

Litten

R. Z.

Koob

G. F.

Goldman

(2016). Addictions neuroclinical assessment: A neuroscience-based framework for addictive disorders. Biological Psychiatry, 80(3), 179–189. https://doi.org/10.1016/j.biopsych.2015.10.024

42.

Lace

J. W.

McGrath

Merz

Z. C.

(2022). A factor analytic investigation of the Barkley deficits in executive functioning scale, short form. Current Psychology, 41(4), 2297–2305. https://doi.org/10.1007/s12144-020-00756-7

43.

Langberg

J. M.

Becker

S. P.

Dvorsky

M. R.

(2014). The association between sluggish cognitive tempo and academic functioning in youth with Attention-Deficit/Hyperactivity Disorder (ADHD). Journal of Abnormal Child Psychology, 42, 91–103. https://doi.org/10.1007/s10802-013-9722-3

44.

Lindgren

K. P.

Hendershot

C. S.

Ramirez

J. J.

Bernat

Rangel-Gomez

Peterson

K. P.

Murphy

J. G.

(2019). A dual process perspective on advances in cognitive science and alcohol use disorder. Clinical Psychology Review, 69, 83–96. https://doi.org/10.1016/j.cpr.2018.04.002

45.

Martens

M. P.

Ferrier

A. G.

Sheehy

M. J.

Corbett

Anderson

D. A.

Simmons

(2005). Development of the protective behavioral strategies survey. Journal of Studies on Alcohol, 66(5), 698–705. https://doi.org/10.15288/jsa.2005.66.698

46.

Martens

M. P.

Martin

J. L.

Littlefield

A. K.

Murphy

J. G.

Cimini

M. D.

(2011). Changes in protective behavioral strategies and alcohol use among college students. Drug and Alcohol Dependence, 118(2), 504–507. https://doi.org/10.1016/j.drugalcdep.2011.04.020

47.

McGrath

A. B.

Weinstock

Cloutier

Christensen

Taylor

D. J.

Henderson

C. E.

(2021). Examination of college student health behaviors and self-reported executive functions. Journal of American College Health, 71, 639–649. https://doi.org/10.1080/07448481.2021.1904951

48.

Meade

A. W.

Johnson

E. C.

Braddy

P. W.

(2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. The Journal of Applied Psychology, 93(3), 568–592. https://doi.org/10.1037/0021-9010.93.3.568

49.

Milioni

A. L. V.

Chaim

T. M.

Cavallet

de Oliveira

N. M.

Annes

dos Santos

Louzã

da Silva

M. A.

Miguel

C. S.

Serpa

M. H.

Zanetti

M. V.

Busatto

Cunha

P. J.

(2017). High IQ May “mask” the diagnosis of ADHD by compensating for deficits in executive functions in treatment-naïve adults with ADHD. Journal of Attention Disorders, 21(6), 455–464. https://doi.org/10.1177/1087054714554933

50.

Muthen

Asparouhov

(2002). Latent variable analysis with categorical outcomes: Multiple-group and growth modeling in Mplus. http://www.statmodel.com/download/webnotes/CatMGLong.pdf

51.

Nixon

S. J.

(2013). Executive functioning among young people in relation to alcohol use. Current Opinion in Psychiatry, 26(4), 305–309. https://doi.org/10.1097/YCO.0b013e328361ea3c

52.

Pagliaccio

Luking

K. R.

Anokhin

A. P.

Gotlib

I. H.

Hayden

E. P.

Olino

T. M.

Peng

C.-Z.

Hajcak

Barch

D. M.

(2016). Revising the BIS/BAS Scale to study development: Measurement invariance and normative effects of age and sex from childhood through adulthood. Psychological Assessment, 28(4), 429–442. https://doi.org/10.1037/pas0000186

53.

Patel

Siegel

Hatchard

Veltman

McKinnon

M. C.

Syan

S. K.

Merrifield

Roth

S. L.

Georgiades

Archie

Wolf

Nicholson

A. A.

(2022). The influence of minority stress on the neurobiological correlates of executive functioning. Quantitative Imaging in Medicine and Surgery, 12(7), 4013–4015. https://doi.org/10.21037/qims-22-206

54.

Patrick

Schulenberg

Miech

Johnston

O’Malley

Bachman

(2022). Monitoring the Future Panel Study annual report: National data on substance use among adults ages 19 to 60, 1976-2021. University of Michigan, Institute for Social Research. https://doi.org/10.7826/ISR-UM.06.585140.002.07.0001.2022

55.

Peeters

Janssen

Monshouwer

Boendermaker

Pronk

Wiers

Vollebergh

(2015). Weaknesses in executive functioning predict the initiating of adolescents’ alcohol use. Developmental Cognitive Neuroscience, 16, 139–146. https://doi.org/10.1016/j.dcn.2015.04.003

56.

Rodriguez

Reise

S. P.

Haviland

M. G.

(2016). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249

57.

Ruiz

S. M.

Oscar-Berman

(2013). Closing the gender gap: The case for gender-specific alcoholism research. Journal of Alcoholism and Drug Dependence, 1(6), Article e106. https://doi.org/10.4172/2329-6488.1000e106

58.

Sass

D. A.

(2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29(4), 347–363.

59.

Sass

D. A.

Schmitt

T. A.

Marsh

H. W.

(2014). Evaluating model fit with ordered categorical data within a measurement invariance framework: A comparison of estimators. Structural Equation Modeling: A Multidisciplinary Journal, 21(2), 167–180. https://doi.org/10.1080/10705511.2014.882658

60.

Suchy

(2009). Executive functioning: Overview, assessment, and research issues for non-neuropsychologists. Annals of Behavioral Medicine: A Publication of the Society of Behavioral Medicine, 37(2), 106–116. https://doi.org/10.1007/s12160-009-9097-4

61.

Tabachnick

B. G.

Fidell

L. S.

(2007). Using multivariate statistics (5th ed.). Allyn & Bacon/Pearson Education.

62.

Toplak

M. E.

West

R. F.

Stanovich

K. E.

(2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, 54(2), 131–143. https://doi.org/10.1111/jcpp.12001

63.

Treloar

Martens

M. P.

McCarthy

D. M.

(2015). The Protective Behavioral Strategies Scale-20: Improved content validity of the Serious Harm Reduction subscale. Psychological Assessment, 27(1), 340–346. https://doi.org/10.1037/pas0000071

64.

Volkow

N. D.

Wang

G.-J.

Fowler

J. S.

Tomasi

(2012). Addiction circuitry in the human brain. Annual Review of Pharmacology and Toxicology, 52(1), 321–336. https://doi.org/10.1146/annurev-pharmtox-010611-134625

65.

Votaw

V. R.

Pearson

M. R.

Stein

Witkiewitz

(2020). The Addictions Neuroclinical Assessment negative emotionality domain among treatment-seekers with alcohol use disorder: Construct validity and measurement invariance. Alcohol Clinical & Experimental Research, 44, 679–688. https://doi-org.libproxy.unm.edu/10.1111/acer.14283

66.

Warren

S. L.

Heller

Miller

G. A.

(2021). The structure of executive dysfunction in depression and anxiety. Journal of Affective Disorders, 279, 208–216. https://doi.org/10.1016/j.jad.2020.09.132

67.

Wiers

Ames

S. L.

Hofmann

Krank

Stacy

(2010). Impulsivity, impulsive and reflective processes and the development of alcohol use and misuse in adolescents and young adults. Frontiers in Psychology, 1, Article 144. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2010.00144