The current behavioral tasks assessing distress tolerance measure tolerance to frustration and tolerance to physical discomfort, but do not explicitly assess tolerance to negative emotion. We closely evaluated the conceptual distinctions between current behavioral tasks and self-report tasks assessing distress tolerance, and then developed a new behavioral distress tolerance task called the Emotional Image Tolerance (EIT) task. The EIT task retains elements of existing behavioral tasks (e.g., indices of persistence) while augmenting the reliability and content sufficiency of existing measures by including multiple trials, including a variety of negative affect stimuli, and separating overall task persistence from task persistence after onset of distress. In a series of three studies, we found that the EIT correlated with extant behavioral measures of distress tolerance, the computerized mirror-tracing task and a physical cold pressor task. Across all of the studies, we also evaluated whether the EIT correlated with self-report measures of distress tolerance and measures of psychopathology (e.g., depression, anxiety, and binge eating). Implications for the refinement of the distress tolerance construct are discussed.
AldaoA.SheppesG.GrossJ. J. (2015). Emotion regulation flexibility. Cognitive Therapy and Research, 39, 263-278. doi:10.1007/s10608-014-9662-4
2.
AmeralV.ReedK. M.CameronA.ArmstrongC. (2014). What are measures of distress tolerance really capturing? A mixed methods analysis. Psychology of Consciousness, 1, 357-369. doi:10.1037/cns0000024
3.
AnestisM. D.LavenderJ. M.Marshall-BerenzE. C.GratzK. L.TullM. T.JoinerT. E. (2012). Evaluating distress tolerance measures: Interrelations and associations with impulsive behaviors. Cognitive Therapy and Research, 36, 593-602. doi:10.1007/s10608-011-9377-8
4.
BemD. J. (1972). Self-perception theory. Advances in Experimental Social Psychology, 6, 1-62. doi:10.1016/S0065-2601(08)60024-6
5.
BernsteinA.BrantzH. (2013). Tolerance of Negative Affective States (TNAS): Development and evaluation of a novel construct and measure. Cognitive Therapy and Research, 37, 421-433. doi:10.1007/s10608-012-9471-6
6.
BernsteinA.MarshallE. C.ZvolenskyM. J. (2011). Multi-method evaluation of distress tolerance measures and construct(s): Concurrent relations to mood and anxiety psychopathology and quality of life. Journal of Experimental Psychopathology, 2, 386-399. doi:10.5127/jep.006610
7.
BodenM. T.ThompsonR. J. (2015). Facets of emotional awareness and associations with emotion regulation and depression. Emotion, 15, 399-410. doi:10.1037/emo0000057
8.
BornovalovaM.GratzK.DaughtersS.NickB.Delany-BrumseyA.LynchT. (2008). A multimodal assessment of the relationship between emotion dysregulation and borderline personality disorder among inner-city substance users in residential treatment. Journal of Psychiatric Research, 42, 717-726. doi:10.1016/j.jpsychires.2007.07.014
9.
BrownR. A.LejuezC. W.KahlerC. W.StrongD. R. (2002). Distress tolerance and duration of past smoking cessation attempts. Journal of Abnormal Psychology, 111, 180-185. doi:10.1037//0021-843X.111.1.180
10.
BurnsJ. W.BruehlS.CaceresC. (2004). Anger management style, blood pressure reactivity, and acute pain sensitivity: Evidence for “trait × situation” models. Annals of Behavioral Medicine, 27, 195-204. doi:10.1207/s15324796abm2703_7
11.
CoanJ. A.AllenJ. J. (Eds.). (2007). Handbook of emotion elicitation and assessment. New York, NY: Oxford University Press.
12.
CochranC. D.HaleD. (1985). College student norms on the brief symptom inventory. Journal of Clinical Psychology, 41, 777-779.
13.
CougleJ. R.BernsteinA.ZvolenskyM. J.VujanovicA. A.MacateeR. J. (2013). Validation of self-report measures of emotional and physical distress tolerance. Journal of Psychopathology and Behavioral Assessment, 35, 76-84. doi:10.1007/s10862-012-9317-2
14.
DaughtersS. B.LejuezC.BornovalovaM. A.KahlerC. W.StrongD. R.BrownR. A. (2005). Distress tolerance as a predictor of early treatment dropout in a residential substance abuse treatment facility. Journal of Abnormal Psychology, 114, 729-734. doi:10.1037/0021-843X.114.4.729
15.
DaughtersS. B.SargeantM. N.BornovalovaM. A.GratzK. L.LejuezC. W. (2008). The relationship between distress tolerance and antisocial personality disorder among male inner-city treatment-seeking substance users. Journal of Personality Disorders, 22, 509-524. doi:10.1521/pedi.2008.22.5.509
16.
DerogatisL. R.MelisaratosN. (1983). The brief symptom inventory: An introductory report. Psychological Medicine, 13, 595-605.
17.
DomesG.SchulzeL.HerpertzS. C. (2009). Emotion recognition in borderline personality disorder: A review of the literature. Journal of Personality Disorders, 23, 6-19.
18.
DunningJ. P.HajcakG. (2008). See no evil: Directing visual attention within unpleasant images modulates the electrocortical response. Psychophysiology, 46, 28-33. doi:10.1111/j.1469-8986.2008.00723.x
19.
EkmanP.CordaroD. (2011). What is meant by calling emotions basic. Emotion Review, 3, 364-370. doi:10.1177/1754073911410740
20.
EllardK. K.FarchioneT. J.BarlowD. H. (2012). Relative effectiveness of emotion induction procedures and the role of personal relevance in a clinical sample: A comparison of film, images, and music. Journal of Psychopathology and Behavioral Assessment, 34, 232-243. doi:10.1007/s10862-011-9271-4
21.
FeldmanG.DunnE.StemkeC.BellK.GreesonJ. (2014). Mindfulness and rumination as predictors of persistence with a distress tolerance task. Personality and Individual Differences, 56, 154-158. doi:10.1016/j.paid.2013.08.040
22.
FleesonW. (2001). Toward a structure- and process-integrated view of personality: Traits as density distributions of states. Journal of Personality and Social Psychology, 80, 1011-1027.
23.
GlassmanL. H.MartinL. M.BradleyL. E.IbrahimA.GoldsteinS. P.FormanE. M.HerbertJ. D. (2016). A brief report on the assessment of distress tolerance: Are we measuring the same construct?Journal of Rational-Emotive & Cognitive-Behavior Therapy, 34, 87-99. doi:10.1007/s10942-015-0224-9
24.
GormallyJ.BlackS.DastonS.RardinD. (1982). The assessment of binge eating severity among obese persons. Addictive Behaviors, 7, 47-55.
25.
HaggerM. S.ChatzisarantisN. L. (2015). A multi-lab pre-registered replication of the ego-depletion effect. Perspectives on Psychological Science, 11, 546-573. doi:10.1177/1745691616652873
26.
HarringtonN. (2005). The Frustration Discomfort Scale: Development and psychometric properties. Clinical Psychology & Psychotherapy, 12, 374-387.
27.
HenryJ. D.CrawfordJ. R. (2005). The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44, 227-239. doi:10.1348/014466505X29657
28.
KiselicaA. M.RojasE.BornovalovaM. A.DubeC. (2015). The nomological network of self-reported distress tolerance. Assessment, 22, 715-729. doi:10.1177/1073191114559407
29.
KiselicaA. M.WebberT.BornovalovaM. A. (2014). Stability and change in distress tolerance and it’s prospective relationship with borderline personality features: A short-term longitudinal study. Personality Disorders: Theory, Research, and Treatment, 3, 247-256. doi:10.1037/per0000076
30.
LangP. J.BradleyM. M.CuthbertB. N. (2008). International Affective Picture System (IAPS): Affective ratings of pictures and instruction manual (Technical Report A-8). Gainesville: University of Florida.
31.
LejuezC. W.KahlerC. W.BrownR. A. (2003). A modified computer version of the Paced Auditory Serial Addition Task (PASAT) as a laboratory-based stressor. The Behavior Therapist, 26, 290-293.
32.
LeyroT. M.ZvolenskyM. J.BernsteinA. (2010). Distress tolerance and psychopathological symptoms and disorders: A review of the empirical literature among adults. Psychological Bulletin, 136, 576-600. doi:10.1037/a0019712
33.
LinehanM. (1993). Cognitive-behavioral treatment of borderline personality disorder. New York, NY: Guilford.
34.
LovibondP. F.LovibondS. H. (1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 33, 335-343.
35.
MacateeR. J.CougleJ. R. (2015). Development and evaluation of a computerized intervention for low distress tolerance and its effect on performance on a neutralization task. Journal of Behavior Therapy and Experimental Psychiatry, 48, 33-39. doi:10.1016/j.jbtep.2015.01.007
36.
MacPhersonL.StipelmanB. A.DuplinskyM.BrownR. A.LejuezC. W. (2008). Distress tolerance and pre-smoking treatment attrition: Examination of moderating relationships. Addictive Behaviors, 33, 1385-1393. doi:10.1016/j.addbeh.2008.07.001
37.
McHughR. K.DaughtersS. B.LejuezC. W.MurrayH. W.HearonB. A.GorkaS. M.OttoM. W. (2011). Shared variance among self-report and behavioral measures of distress intolerance. Cognitive Therapy and Research, 35, 266-275. doi:10.1007/s10608-010-9295-1
38.
McHughR. K.OttoM. W. (2011). Domain-general and domain-specific strategies for the assessment of distress intolerance. Psychology of Addictive Behaviors, 25, 745-749. doi:10.1037/a0025094
39.
McNallyR. J. (2002). Disgust has arrived. Anxiety Disorders, 16, 561-566.
40.
MischelW. (1968). Personality and assessment. Mahwah, NJ: Lawrence Erlbaum.
41.
NisbettR. E.WilsonT. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231-259. doi:10.1037/0033-295X.84.3.231
42.
PodsakoffP. M.MacKenzieS. B.LeeJ. Y.PodsakoffN. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903. doi:10.1037/0021-9010.88.5.879
43.
QuartanaP. J.BurnsJ. W. (2007). Painful consequences of anger suppression. Emotion, 7, 400-414. doi:10.1037/1528-3542.7.2.400
44.
RossL.NisbettR. E. (1991). The person and the situation. Philadelphia, PA: Temple University Press.
45.
SaloveyP.GrewalD. (2005). The science of emotional intelligence. Current Directions in Psychological Science, 14, 281-285.
46.
SchmidtN. B.RicheyJ. A.FitzpatrickK. K. (2006). Discomfort intolerance: Development of a construct and measure relevant to panic disorder. Journal of Anxiety Disorders, 20, 263-280. doi:10.1016/j.janxdis.2005/02.2002
47.
SimonsJ. S.GaherR. M. (2005). The Distress Tolerance Scale: Development and validation of a self-report measure. Motivation and Emotion, 29, 83-102. doi:10.1007/s11031-005-7955-3
48.
StrongD.LejuezC.DaughtersS.MarinelloM.KahlerC.BrownR. (2003). The computerized mirror tracing task. Unpublished manual.
49.
SzuhanyK. L.OttoM. W. (2015). Contextual influences on distress intolerance: Priming effects on behavioral persistence. Cognitive Therapy and Research, 39, 499-507. doi:10.1007/s10608-015-9672-x
50.
TamirM. (2016). Why do people regulate their emotions? A taxonomy of motives in emotion regulation. Personality and Social Psychology Review, 20, 199-222.
51.
Van ReekumC. M.JohnstoneT.UrryH. L.ThurowM. E.SchaeferH. S.AlexanderA. L.DavidsonR. J. (2007). Gaze fixations predict brain activation during the voluntary regulation of picture-induced negative affect. NeuroImage, 36, 1041-1055.
52.
WatsonD.ClarkL. A.TellegenA. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54, 1063-1070. doi:10.1037/0022-3514.54.6.1063
53.
ZvolenskyM. J.FeldnerM. T.EifertG. H.BrownR. A. (2001). Affective style among smokers: Understanding anxiety sensitivity, emotional reactivity, and distress tolerance using biological challenge. Addictive Behaviors, 26, 901-915.
54.
ZvolenskyM. J.VujanovicA. A.BernsteinA.LeyroT. (2010). Distress tolerance theory, measurement, and relations to psychopathology. Current Directions in Psychological Science, 19, 406-410.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
