Impulsive States and Impulsive Traits: A Study of the Multilevel Structure and Validity of a Multifaceted Measure of Impulsive States

Abstract

Emerging evidence suggests impulsive states may be reliably measured in the moment using ecological momentary assessment (EMA); however, research has not investigated whether the multi-factor structure of impulsive traits also characterizes impulsive states. In two independent samples spanning adolescence through young adulthood (n = 211, n = 222), we adapted global self-report measures of impulsive traits to EMA and conducted multilevel confirmatory factor analyses to characterize the within- and between-person factor structure of five impulsive traits (negative urgency, planning, persistence, sensation seeking, and positive urgency). Across both studies, factor models with one factor for each UPPS-P facet fit the data well at both levels, though some latent factors were highly correlated. Aggregated impulsive states, especially negative urgency, predicted oppositional defiant disorder symptoms, emotional problems, alcohol problems, and attention deficit hyperactivity disorder symptoms. Our results suggest that EMA measures can capture a range of impulsive states that mirrors the heterogeneity seen in the trait literature.

Keywords

ecological momentary assessment impulsivity measurement factor analysis

Get full access to this article

View all access options for this article.

References

Babinski

L. M.

Hartsough

C. S.

Lambert

N. M.

(1999). Childhood conduct problems, hyperactivity-impulsivity, and inattention as predictors of adult criminal activity. Journal of Child Psychology and Psychiatry, 40(3), 347-355. https://doi.org/10.1111/1469-7610.00452

Barkley

R. A.

Murphy

K. R.

Fischer

(2010). ADHD in adults: What the science says. Guilford Press.

Berg

J. M.

Latzman

R. D.

Bliwise

N. G.

Lilienfeld

S. O.

(2015). Parsing the heterogeneity of impulsivity: A meta-analytic review of the behavioral implications of the UPPS for psychopathology. Psychological Assessment, 27(4), 1129-1146. https://doi.org/10.1037/pas0000111

Biederman

Petty

C. R.

Fried

Doyle

A. E.

Mick

Aleardi

Monuteaux

M. C.

Seidman

L. J.

Spencer

Faneuil

A. R.

Holmes

Faraone

S. V.

(2008). Utility of an abbreviated questionnaire to identify individuals with ADHD at risk for functional impairments. Journal of Psychiatric Research, 42(4), 304-310. https://doi.org/10.1016/j.jpsychires.2006.12.004

Campbell

D. T.

Fiske

D. W.

(1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81-105. https://doi.org/10.1037/h0046016

Carver

C. S.

Johnson

S. L.

Joormann

(2008). Serotonergic function, two-mode models of self-regulation, and vulnerability to depression: What depression has in common with impulsive aggression. Psychological Bulletin, 134(6), 912-943. https://doi.org/10.1037/a0013740

Clark

L. A.

(1993). Manual for the schedule for nonadaptive and adaptive personality. University of Minnesota Press.

Coskunpinar

Dir

A. L.

Cyders

M. A.

(2013). Multidimensionality in impulsivity and alcohol use: A meta-analysis using the UPPS model of impulsivity. Alcoholism: Clinical and Experimental Research, 37(9), 1441-1450. https://doi.org/10.1111/acer.12131

Cross

C. P.

Copping

L. T.

Campbell

(2011). Sex differences in impulsivity: A meta-analysis. Psychological Bulletin, 137(1), 97-130. https://doi.org/10.1037/a0021591

10.

Curran

P. J.

Bauer

D. J.

(2011). The disaggregation of within-person and between-person effects in longitudinal models of change. Annual Review of Psychology, 62(January), 583-619. https://doi.org/10.1146/annurev.psych.093008.100356

11.

Cyders

M. A.

Coskunpinar

(2011). Measurement of constructs using self-report and behavioral lab tasks: Is there overlap in nomothetic span and construct representation for impulsivity ? Clinical Psychology Review, 31(6), 965-982. https://doi.org/10.1016/j.cpr.2011.06.001

12.

Cyders

M. A.

Smith

G. T.

(2007). Mood-based rash action and its components: Positive and negative urgency. Personality and Individual Differences, 43(4), 839-850. https://doi.org/10.1016/j.paid.2007.02.008

13.

Cyders

M. A.

Smith

G. T.

Spillane

N. S.

Fischer

Annus

A. M.

Peterson

(2007). Integration of impulsivity and positive mood to predict risky behavior: Development and validation of a measure of positive urgency. Psychological Assessment, 19(1), 107-118. https://doi.org/10.1037/1040-3590.19.1.107

14.

Duckworth

A. L.

Kern

M. L.

(2011). A meta-analysis of the convergent validity of self-control measures. Journal of Research in Personality, 45(3), 259-268. https://doi.org/10.1016/j.jrp.2011.02.004

15.

Dyer

N. G.

Hanges

P. J.

Hall

R. J.

(2005). Applying multilevel confirmatory factor analysis techniques to the study of leadership. Leadership Quarterly, 16(1), 149-167. https://doi.org/10.1016/j.leaqua.2004.09.009

16.

Enders

C. K.

Keller

B. T.

Levy

(2018). A fully conditional specification approach to multilevel imputation of categorical and continuous variables. Psychological Methods, 23(2), 298-317. https://doi.org/10.1037/met0000148

17.

Eysenck

M. W.

Mogg

(1992). Clinical anxiety, trait anxiety, and memory bias. In Christianson

S.-Å.

(Ed.), The handbook of emotion and memory: Research and theory (pp. 429-450). Lawrence Erlbaum.

18.

Fisher

A. J.

Medaglia

J. D.

Jeronimus

B. F.

(2018). Lack of group-to-individual generalizability is a threat to human subjects research. Proceedings of the National Academy of Sciences, 115(27), E6106-E6115. https://doi.org/10.1073/pnas.1711978115

19.

Geldhof

G. J.

Preacher

K. J.

Zyphur

M. J.

(2014). Reliability estimation in a multilevel confirmatory factor analysis framework. Psychological Methods, 19(1), 72-91. https://doi.org/10.1037/a0032138

20.

Graham

J. W.

(2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60(January), 549-576. https://doi.org/10.1146/annurev.psych.58.110405.085530

21.

Graham

J. W.

Taylor

B. J.

Olchowski

A. E.

Cumsille

P. E.

(2006). Planned missing data designs in psychological research. Psychological Methods, 11(4), 323-343. https://doi.org/10.1037/1082-989X.11.4.323

22.

Gullo

M. J.

Loxton

N. J.

Dawe

(2014). Impulsivity: Four ways five factors are not basic to addiction. Addictive Behaviors, 39(11), 1547-1556. https://doi.org/10.1016/j.addbeh.2014.01.002

23.

Hasler

B. P.

Wallace

M. L.

White

S. J.

Molina

B. S. G.

Pedersen

S. L.

(2019). Preliminary evidence that real world sleep timing and duration are associated with laboratory-assessed alcohol response. Alcoholism: Clinical & Experimental Research, 43(7), 1575-1584. https://doi.org/10.1111/acer.14076

24.

Heywood

H. B.

(1931). On finite sequences of real numbers. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 134(824), 486-501. https://doi.org/10.1098/rspa.1931.0209

25.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

26.

Hunt

Auriemma

Cashaw

A. C. A.

(2003). Self-report bias and underreporting of depression on the BDI-II. Journal of Personality Assessment, 80(1), 26-30. https://doi.org/10.1207/S15327752JPA8001

27.

Hurlburt

S. C.

Sher

K. J.

(1992). Assessing negative alcohol consequences in college students. Journal of American College Health, 41(2), 700-709. https://doi.org/10.1080/07448481.1992.10392818

28.

Jackson

D. L.

Gillaspy

J. A.

Jr. Purc-Stephenson

(2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6-23. https://doi.org/10.1037/a0014694

29.

Jahng

Wood

P. K.

Trull

T. J.

(2008). Analysis of affective instability in ecological momentary assessment: Indices using successive difference and group comparison via multilevel modeling. Psychological Methods, 13(4), 354-375. https://doi.org/10.1037/a0014173

30.

Keller

B. T.

Enders

C. K.

(2018). Blimp User’s Manual (Version 1.1).

31.

Kenny

D. A.

McCoach

D. B.

(2003). Effect of the number of variables on measures of fit in structural equation modeling. Structural Equation Modeling, 10(3), 333-351. https://doi.org/10.1207/S15328007SEM1003_1

32.

Kenrick

D. T.

Funder

D. C.

(1988). Profiting from controversy: Lessons from the person-situation debate. The American Psychologist, 43(1), 23-34. https://doi.org/10.1037/0003-066X.43.1.23

33.

King

K. M.

Patock-Peckham

J. A.

Dager

A. D.

Thimm

Gates

J. R.

(2014). On the mismeasurement of impulsivity: Trait, behavioral, and neural models in alcohol research among adolescents and young adults. Current Addiction Reports, 1(1), 19-32. https://doi.org/10.1007/s40429-013-0005-4

34.

Lydon-Staley

D. M.

Falk

E. B.

Bassett

D. S.

(2020). Within-person variability in sensation-seeking during daily life: Positive associations with alcohol use and self-defined risky behaviors. Psychology of Addictive Behaviors, 34(2), 257. https://doi.org/10.31234/osf.io/djb5c

35.

Lynam

D. R.

Smith

G. T.

Whiteside

S. P.

Cyders

M. A.

(2006). The UPPS-P: Assessing five personality pathways to impulsive behavior. Purdue University.

36.

Marsh

H. W.

Hau

K.-T.

Wen

(2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11(3), 320-341. https://doi.org/10.1207/s15328007sem1103_2

37.

Mischel

Shoda

(1995). A cognitive-affective system theory of personality: Reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. Psychological Review, 102(2), 246-268. https://doi.org/10.1037/0033-295X.102.2.246

38.

Mischel

Shoda

Mendoza-Denton

(2002). Situation-behavior profiles as a locus of consistency in personality. Current Directions in Psychological Science, 11(2), 50-54. https://doi.org/10.1111/1467-8721.00166

39.

Molina

B. S. G.

Pelham

W. E.

Gnagy

E. M.

Thompson

A. L.

Marshal

M. P.

(2007). Attention-deficit/hyperactivity disorder risk for heavy drinking and alcohol use disorder is age specific. Alcoholism: Clinical & Experimental Research, 31(4), 643-654. https://doi.org/10.1111/j.1530-0277.2007.00349.x

40.

Molina

B. S. G.

Sibley

M. H.

Pedersen

S. L.

Pelham

W. E.

(2017). The Pittsburgh ADHD Longitudinal Study. In Attention-deficit hyperactivity disorder: Adult outcomes and its predictors (pp. 105-155). Oxford University Press.

41.

Muthén

B. O.

(1994). Multilevel covariance structure analysis. Sociological Methods & Research, 22(3), 376-398. https://doi.org/10.1177/0049124194022003006

42.

Muthén

L. K.

Muthén

B. O.

(2017). Mplus user’s guide (8th ed.). Muthén & Muthén.

43.

Nock

M. K.

Kazdin

A. E.

Hiripi

Kessler

R. C.

(2007). Lifetime prevalence, correlates, and persistence of oppositional defiant disorder: Results from the National Comorbidity Survey Replication. Journal of Child Psychology and Psychiatry and Allied Disciplines, 48(7), 703-713. https://doi.org/10.1111/j.1469-7610.2007.01733

44.

Patton

J. H.

Stanford

M. S.

Barratt

E. S.

(1995). Factor structure of the Barratt impulsiveness scale. Journal of Clinical Psychology, 51(6), 768-774. https://doi.org/10.1002/1097-4679(199511)51:6<768::AID-JCLP2270510607>3.0.CO;2-1

45.

Pedersen

S. L.

King

K. M.

Louie

K. A.

Fournier

J. C.

Molina

B. S.

(2019). Momentary fluctuations in impulsivity domains: Associations with a history of childhood ADHD, heavy alcohol use, and alcohol problems. Drug and Alcohol Dependence, 205(December), Article 107683. https://doi.org/10.1016/j.drugalcdep.2019.107683

46.

Pedersen

S. L.

Walther

C. A. P.

Harty

S. C.

Gnagy

E. M.

Pelham

W. E.

Molina

B. S. G.

(2016). The indirect effects of childhood ADHD on alcohol problems in adulthood through unique facets of impulsivity. Addiction, 111(9), 1582-1589. https://doi.org/10.1002/jmri.25711.PET/MRI

47.

Pilkonis

P. A.

Choi

S. W.

Reise

S. P.

Stover

A. M.

Riley

W. T.

Cella

(2011). Item banks for measuring emotional distress from the patient-reported outcomes measurement information system (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263-283. https://doi.org/10.1177/1073191111411667

48.

Robinson

M. D.

Clore

G. L.

(2002). Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 128(6), 934-960. https://doi.org/10.1037/0033-2909.128.6.934

49.

Roley

M. E.

Contractor

A. A.

Weiss

N. H.

Armour

Elhai

J. D.

(2017). Impulsivity facets’ predictive relations with DSM-5 PTSD symptom clusters. Psychological Trauma, 9(1), 76-79. https://doi.org/10.1037/tra0000146

50.

Schuetzenmeister

Dufey

(2016). VCA: Variance Component Analysis. R Package Version 1.

51.

Settles

R. E.

Zapolski

T. C. B.

Smith

G. T.

(2014). Longitudinal test of a developmental model of the transition to early drinking. Journal of Abnormal Psychology, 123(1), 141-151. https://doi.org/10.1037/a0035670

52.

Sharma

Kohl

Morgan

T. A.

Clark

L. A.

(2013). “Impulsivity”: Relations between self-report and behavior. Journal of Personality and Social Psychology, 104(3), 559-575. https://doi.org/10.1037/a0031181

53.

Sharma

Markon

K. E.

Clark

L. A.

(2013). Toward a theory of distinct types of “impulsive” behaviors: A meta-analysis of self-report and behavioral measures. Psychological Bulletin, 140(2), 374-408. https://doi.org/10.1037/a0034418

54.

Shiffman

Stone

A. A.

Hufford

M. R.

(2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4(April), 1-32. https://doi.org/10.1146/annurev.clinpsy.3.022806.091415

55.

Shrout

P. E.

Lane

S. P.

(2014). Psychometrics. In Mehl

M. R.

Conner

T. S.

(Eds.), Handbook of research methods for studying daily life (pp. 302-320). Guilford Press.

56.

Smith

G. T.

Cyders

M. A.

(2016). Integrating affect and impulsivity: The role of positive and negative urgency in substance use risk. Drug and Alcohol Dependence, 163(Suppl. 1), S3-S12. https://doi.org/10.1016/j.drugalcdep.2015.08.038

57.

Smith

G. T.

Fischer

Cyders

M. A.

Annus

A. M.

Spillane

N. S.

McCarthy

D. M.

(2007). On the validity and utility of discriminating among impulsivity-like traits. Assessment, 14(2), 155-170. https://doi.org/10.1177/1073191106295527

58.

Stautz

Cooper

(2013). Impulsivity-related personality traits and adolescent alcohol use: A meta-analytic review. Clinical Psychology Review, 33(4), 574-592. https://doi.org/10.1016/j.cpr.2013.03.003

59.

Tomko

R. L.

Solhan

M. B.

Carpenter

R. W.

Brown

W. C.

Jahng

Wood

P. K.

Trull

T. J.

(2014). Measuring impulsivity in daily life: The Momentary Impulsivity Scale. Psychological Assessment, 26(2), 339-349. https://doi.org/10.1037/a0035083

60.

von Neumann

Kent

R. H.

Bellinson

H. R.

Hart

B. I

. (1941). The mean square successive difference. Annals of Mathematical Statistics, 12(2), 153-162. https://doi.org/10.1214/09-STS284

61.

White

H. R.

Labouvie

E. W.

(1989). Towards the assessment of adolescent problem drinking. Journal of Studies on Alcohol, 50(1), 30-37.

62.

Whiteside

S. P.

Lynam

D. R.

(2001). The five factor model and impulsivity: Using a structural model of personality to understand impulsivity. Personality and Individual Differences, 30(4), 669-689. https://doi.org/10.1016/S0191-8869(00)00064-7

63.

K. D.

Clark

L. A.

(2003). Relations between personality traits and self-reports of daily behavior. Journal of Research in Personality, 37(4), 231-256. https://doi.org/10.1016/S0092-6566(02)00539-1