More of a Good Thing Is Not Always Better: Validation of a Distress Overtolerance Measure

Abstract

Distress tolerance (DT) refers to the ability to tolerate aversive psychological states. Research has mainly focused on the link between low DT and psychopathology with little empirical work on individuals on the high end (i.e., distress overtolerance). Distress overtolerance has been conceptualized as a tendency to tolerate very high levels of distress despite the negative consequences to one’s well-being. Currently, no measures of distress overtolerance have been developed, and current measures for DT are not well-suited for measuring distress overtolerance. To establish distress overtolerance as a construct, an exploratory factor analysis (N = 251) of the distress overtolerance scale was conducted and revealed a two-factor structure (i.e., Capacity for Harm and Fear of Negative Evaluation). In Study 2 (N = 257), a confirmatory factor analysis revealed strong psychometric properties, the expected nomological network, good construct validity, and incremental criterion utility. Results showed that this scale can be used as a starting point for the theoretical framework behind distress overtolerance.

Keywords

distress tolerance distress overtolerance measurement assessment validation

Get full access to this article

View all access options for this article.

References

Anestis

M. D.

Gratz

K. L.

Bagge

C. L.

Tull

M. T.

(2012). The interactive role of distress tolerance and borderline personality disorder in suicide attempts among substance users in residential treatment. Comprehensive Psychiatry, 53, 1208-1216.

Anestis

M. D.

Tull

M. T.

Bagge

C. L.

Gratz

K. L.

(2012). The moderating role of distress tolerance in the relationship between posttraumatic stress disorder symptom clusters and suicidal behavior among trauma exposed substance users in residential treatment. Archives of Suicide Research, 16, 198-211.

Asendorpf

J. B.

Denissen

J. J.

van Aken

M. A.

(2008). Inhibited and aggressive preschool children at 23 years of age: Personality and social transitions into adulthood. Developmental Psychology, 44, 997-1011.

Berman

A. H.

Bergman

Palmstierna

Schlyter

(2005). Evaluation of the Drug Use Disorders Identification Test (DUDIT) in criminal justice and detoxification settings and in a Swedish population sample. European Addiction Research, 11, 22-31.

Bieling

P. J.

Israeli

A. L.

Antony

M. M.

(2004). Is perfectionism good, bad, or both? Examining models of the perfectionism construct. Personality and Individual Differences, 36, 1373-1385.

Bingham

T. A.

Harawa

N. T.

Williams

J. K.

(2013). Gender role conflict among African American men who have sex with men and women: Associations with mental health and sexual risk and disclosure behaviors. American Journal of Public Health, 103, 127-133.

Bohn

M. J.

Babor

T. F.

Kranzler

H. R.

(1995). The Alcohol Use Disorders Identification Test (AUDIT): Validation of a screening instrument for use in medical settings. Journal of Studies on Alcohol, 56, 423-432.

Bornovalova

M. A.

Gratz

K. L.

Daughters

S. B.

Hunt

E. D.

Lejuez

C. W.

(2012). Initial RCT of a distress tolerance treatment for individuals with substance use disorders. Drug and Alcohol Dependence, 122, 70-76.

Brandon

T. H.

Herzog

T. A.

Juliano

L. M.

Irvin

J. E.

Lazev

A. B.

Simmons

V. N.

(2003). Pretreatment task persistence predicts smoking cessation outcome. Journal of Abnormal Psychology, 112, 448-456.

10.

Brown

R. A.

Palm

K. M.

Strong

D. R.

Lejuez

C. W.

Kahler

C. W.

Zvolensky

M. J.

. . . Gifford

E. V.

(2008). Distress tolerance treatment for early-lapse smokers: Rationale, program description, and preliminary findings. Behavior Modification, 32, 302-332.

11.

Browne

M. W.

(2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36, 111-150.

12.

Buhrmester

Kwang

Gosling

S. D.

(2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3-5.

13.

Bujarski

S. J.

Norberg

M. M.

Copeland

(2012). The association between distress tolerance and cannabis use-related problems: The mediating and moderating roles of coping motives and gender. Addictive Behaviors, 37, 1181-1184.

14.

Bunderson

J. S.

Sutcliffe

K. M.

(2003). Management team learning orientation and business unit performance. Journal of Applied Psychology, 88, 552-560.

15.

Burns

U. D.

(1980, November). The perfectionist’s script for self-defeat. Psychology Today, pp. 34-51.

16.

Carter

N. T.

Dalal

D. K.

Boyce

A. S.

O’Connell

M. S.

Kung

M. C.

Delgado

K. M.

(2013). Uncovering curvilinear relationships between conscientiousness and job performance: How theoretically appropriate measurement makes an empirical difference. Journal of Applied Psychology, 99, 564-586.

17.

Chapman

A. L.

Lynch

T. R.

Rosenthal

M. Z.

Cheavens

J. S.

Smoski

M. J.

Krishnan

K. R. R.

(2007). Risk aversion among depressed older adults with obsessive compulsive personality disorder. Cognitive Therapy and Research, 31, 161-174.

18.

Cianci

A. M.

Klein

H. J.

Seijts

G. H.

(2010). The effect of negative feedback on tension and subsequent performance: The main and interactive effects of goal content and conscientiousness. Journal of Applied Psychology, 95, 618-630.

19.

Clark

L. A.

Watson

(1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309.

20.

Comrey

A. L.

Lee

H. B.

(1992). Interpretation and application of factor analytic results. In Comrey

A. L.

Lee

H. B.

(Eds.), A first course in factor analysis (pp. 240-263). Hillsdale, NJ: Lawrence Erlbaum.

21.

Cook

L. C.

Kearney

C. A.

(2009). Parent and youth perfectionism and internalizing psychopathology. Personality and Individual Differences, 46, 325-330.

22.

Daughters

S. B.

Reynolds

E. K.

MacPherson

Kahler

C. W.

Danielson

C. K.

Zvolensky

Lejuez

C. W.

(2009). Distress tolerance and early adolescent externalizing and internalizing symptoms: The moderating role of gender and ethnicity. Behaviour Research and Therapy, 47, 198-205.

23.

Derogatis

L. R.

Melisaratos

(1983). The brief symptom inventory: An introductory report. Psychological Medicine, 13, 595-605.

24.

Dunkley

D. M.

Blankstein

K. R.

Zuroff

D. C.

Lecce

Hui

(2006). Self-critical and personal standards factors of perfectionism located within the five-factor model of personality. Personality and Individual Differences, 40, 409-420.

25.

Ebner-Priemer

U. W.

Kuo

Schlotz

Kleindienst

Rosenthal

M. Z.

Detterer

. . . Bohus

(2008). Distress and affective dysregulation in patients with borderline personality disorder: A psychophysiological ambulatory monitoring study. Journal of Nervous and Mental Disease, 196, 314-320.

26.

Eisenberger

(1992). Learned industriousness. Psychological Review, 99, 248-267.

27.

Ersche

K. D.

Roiser

J. P.

Robbins

T. W.

Sahakian

B. J.

(2008). Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology, 197, 421-431.

28.

Flora

D. B.

Curran

P. J.

(2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491.

29.

Floyd

F. J.

Widaman

K. F.

(1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7, 286-299.

30.

George

Mallery

(2010). SPSS for Windows step by step: A simple guide and reference, 17.0 update (10th ed.). Boston, MA: Pearson.

31.

Gorka

S. M.

Ali

Daughters

S. B.

(2012). The role of distress tolerance in the relationship between depressive symptoms and problematic alcohol use. Psychology of Addictive Behaviors, 26, 621-626.

32.

Hays

R. D.

Merz

J. F.

Nicholas

(1995). Response burden, reliability, and validity of the CAGE, Short MAST, and AUDIT alcohol screening measures. Behavior Research Methods, Instruments, & Computers, 27, 277-280.

33.

Horn

J. L.

(1984). Alcohol dependence scale (ADS) user’s guide. Toronto: Addiction Research Foundation 1984.

34.

Howell

A. N.

Leyro

T. M.

Hogan

Buckner

J. D.

Zvolensky

M. J.

(2010). Anxiety sensitivity, distress tolerance, and discomfort intolerance in relation to coping and conformity motives for alcohol use and alcohol use problems among young adult drinkers. Addictive Behaviors, 35, 1144-1147.

35.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.

36.

Joinson

A. N.

(2001). Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity. European Journal of Social Psychology, 31, 177-192.

37.

Langer

E. J.

Imber

L. G.

(1979). When practice makes imperfect: Debilitating effects of overlearning. Journal of Personality and Social Psychology, 37, 2014-2024.

38.

Ledesma

R. D.

Valero-Mora

(2007). Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research & Evaluation, 12(2), 1-11.

39.

Lejuez

C. W.

Kahler

C. W.

Brown

R. A.

(2003). A modified computer version of the Paced Auditory Serial Addition Task (PASAT) as a laboratory-based stressor. The Behavior Therapist, 26, 290-293.

40.

Leyro

T. M.

Zvolensky

M. J.

Bernstein

(2010). Distress tolerance and psychopathological symptoms and disorders: A review of the empirical literature among adults. Psychological Bulletin, 136, 576-600.

41.

Linehan

M. M.

(1993). Skills training manual for treating borderline personality disorder. New York: Guilford Press.

42.

Lynch

T. R.

Hempel

R. J.

Dunkley

(2015). Radically Open-Dialectical Behavior Therapy for disorders of over-control: Signaling matters. American Journal of Psychotherapy, 69, 141-162.

43.

Lynch

T. R.

Mizon

G. A.

(2011). Distress over-tolerance and distress intolerance: A behavioral perspective. In Zvolensky

M. J.

Bernstein

Vujanovic

A. A.

(Eds.), Distress tolerance: Theory, research, and clinical applications (pp. 52-79). New York, NY: Guilford.

44.

Muthén

L. K.

Muthén

B. O.

(1998-2012). Mplus user’s guide (Version 7). Los Angeles, CA: Author.

45.

Patrick

C. J.

Curtin

J. J.

Tellegen

(2002). Development and validation of a brief form of the Multidimensional Personality Questionnaire. Psychological Assessment, 14, 150-163.

46.

Pyszczynski

Greenberg

(1987). Self-regulatory perseveration and the depressive self-focusing style: A self-awareness theory of reactive depression. Psychological Bulletin, 102, 122-138.

47.

Quinn

E. P.

Brandon

T. H.

Copeland

A. L.

(1996). Is task persistence related to smoking and substance abuse? The application of learned industriousness theory to addictive behaviors. Experimental and Clinical Psychopharmacology, 4, 186-190.

48.

Rice

K. G.

Van Arsdale

A. C.

(2010). Perfectionism, perceived stress, drinking to cope, and alcohol-related problems among college students. Journal of Counseling Psychology, 57, 439-450.

49.

Samuel

D. B.

(2011). Assessing personality in the DSM-5: The utility of bipolar constructs. Journal of Personality Assessment, 93, 390-397.

50.

Samuel

D. B.

Widiger

T. A.

(2011). Conscientiousness and obsessive-compulsive personality disorder. Personality Disorders: Theory, Research, and Treatment, 2, 161-174.

51.

Sargeant

M. N.

Daughters

S. B.

Curtin

J. J.

Schuster

Lejuez

C. W.

(2011). Unique roles of antisocial personality disorder and psychopathic traits in DT. Journal of Abnormal Psychology, 120, 987-992.

52.

Serpell

Waller

Fearon

Meyer

(2009). The roles of persistence and perseveration in psychopathology. Behavior Therapy, 40, 260-271.

53.

Shafran

Mansell

(2001). Perfectionism and psychopathology: A review of research and treatment. Clinical Psychology Review, 21, 879-906.

54.

Shapiro

D. N.

Chandler

Mueller

P. A.

(2013). Using Mechanical Turk to study clinical populations. Clinical Psychological Science, 1, 213-220.

55.

Simons

J. S.

Gaher

R. M.

(2005). The Distress Tolerance Scale: Development and validation of a self-report measure. Motivation and Emotion, 29, 83-102.

56.

Skinner

H. A.

Allen

B. A.

(1982). Alcohol dependence syndrome: Measurement and validation. Journal of Abnormal Psychology, 91, 199-209.

57.

Tellegen

(1982). Brief manual for the multidimensional personality questionnaire. Unpublished manuscript, University of Minnesota, MN.

58.

Vujanovic

A. A.

Bonn-Miller

M. O.

Potter

C. M.

Marshall

E. C.

Zvolensky

M. J.

(2011). An evaluation of the relation between distress tolerance and posttraumatic stress within a trauma-exposed sample. Journal of Psychopathology and Behavioral Assessment, 33, 129-135.