Normative Values and Psychometric Properties of the Penn State Worry Questionnaire in Substance Use Disorder Treatment Population

Abstract

This study evaluated the Penn State Worry Questionnaire (PSWQ) as a tool for measuring worry and anxiety levels among individuals entering treatment for substance use disorders (SUDs). The sample included 75,047 individuals admitted to SUD treatment centers, with assessments conducted weekly. Individuals entering SUD treatment exhibited higher baseline levels of worry; however, worry levels declined over the course of treatment. The PSWQ demonstrated good internal consistency, high test-retest reliability, and good discriminant validity when correlated with measures of depression and stress. The factor structure analysis confirmed that the PSWQ measures the same underlying construct of worry in the SUD treatment population, with a single-factor model showing satisfactory fit. This extends the reach of the PSWQ to the SUD treatment population by reaffirming its reliability, validity, and factor structure, with the expectation of higher levels of worry compared to a non-SUD population at the beginning of treatment, which decline over time.

Keywords

substance use disorder anxiety Penn State Worry Questionnaire psychometric properties treatment population

Get full access to this article

View all access options for this article.

References

Acock

(2014). A gentle introduction to stata. 4. izdaja. Stata Press.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (Vol. 5). American Psychiatric Association.

Beck

J. G.

Stanley

M. A.

Zebb

B. J.

(1995). Psychometric properties of the Penn State Worry Questionnaire in older adults. Journal of Clinical Geropsychology, 1(1), 33–42.

Behar

Alcaine

Zuellig

A. R.

Borkovec

(2003). Screening for generalized anxiety disorder using the Penn State Worry Questionnaire: A receiver operating characteristic analysis. Journal of Behavior Therapy and Experimental Psychiatry, 34(1), 25–43.

Bergeria

C. L.

Strickland

J. C.

Huhn

A. S.

Strain

E. C.

Dunn

K. E.

(2021). A preliminary examination of the multiple dimensions of opioid craving. Drug and Alcohol Dependence, 219, 108473. https://doi.org/10.1016/j.drugalcdep.2020.108473

Bluthenthal

R. N.

Simpson

Ceasar

R. C.

Zhao

Wenger

Kral

A. H.

(2020). Opioid withdrawal symptoms, frequency, and pain characteristics as correlates of health risk among people who inject drugs. Drug and Alcohol Dependence, 211, 107932. https://doi.org/https://doi.org/10.1016/j.drugalcdep.2020.107932

Boschloo

Vogelzangs

van den Brink

Smit

J. H.

Beekman

A. T.

Penninx

B. W.

(2012). Predictors of the 2-year recurrence and persistence of alcohol dependence. Addiction, 107(9), 1639–1640.

Brenes

G. A.

Johnco

Mohlman

Wetherell

J. L.

Wuthrich

V. M.

(2022). Evidence-based assessment of treatment outcomes for late-life generalized anxiety disorder using the Penn State Worry Questionnaire (PSWQ) and Penn State Worry Questionnaire—Abbreviated (PSWQ-A). International Psychogeriatrics, 34(5), 489–501. https://doi.org/10.1017/S1041610221000351

Brown

S. A.

Schuckit

M. A.

(1988). Changes in depression among abstinent alcoholics. Journal of Studies on Alcohol, 49(5), 412–417.

10.

Brown

T. A.

(2003). Confirmatory factor analysis of the Penn State Worry Questionnaire: Multiple factors or method effects? Behaviour Research and Therapy, 41(12), 1411–1426. https://doi.org/10.1016/S0005-7967(03)00059-7

11.

Brown

T. A.

(2015). Confirmatory factor analysis for applied research. Guilford publications.

12.

Brown

T. A.

Antony

M. M.

Barlow

D. H.

(1992). Psychometric properties of the Penn State Worry Questionnaire in a clinical anxiety disorders sample. Behaviour Research and Therapy, 30(1), 33–37.

13.

Chartoff

E. H.

Carlezon

W. A.

Jr. (2014). Drug withdrawal conceptualized as a stressor. Behavioural Pharmacology, 25(5 and 6), 337–339. https://journals.lww.com/behaviouralpharm/fulltext/2014/09000/drug_withdrawal_conceptualized_as_a_stressor.13.aspx

14.

Cheung

G. W.

Cooper-Thomas

H. D.

Lau

R. S.

Wang

L. C.

(2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 745–783. https://doi.org/10.1007/s10490-023-09871-y

15.

Chorpita

B. F.

Tracey

S. A.

Brown

T. A.

Collica

T. J.

Barlow

D. H.

(1997). Assessment of worry in children and adolescents: An adaptation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 35(6), 569–581. https://www.sciencedirect.com/science/article/pii/S0005796796001167?via%3Dihub

16.

Clark

L. A.

Watson

(1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319.

17.

Clark

L. A.

Watson

(2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412.

18.

Cohen

(2013). Statistical power analysis for the behavioral sciences. Academic Press.

19.

Crittendon

Hopko

D. R.

(2006). Assessing worry in older and younger adults: Psychometric properties of an abbreviated Penn State Worry Questionnaire (PSWQ-A). Journal of Anxiety Disorders, 20(8), 1036–1054.

20.

Davey

G. C.

(1993). A comparison of three worry questionnaires. Behaviour Research and Therapy, 31(1), 51–56.

21.

Ediati

Utari

(2019). Assessing worry in children: Psychometric evaluation of the Indonesian version of Penn State Worry Questionnaire (PSWQ). Program Magister Psikologi Universitas Ahamd Dahlan, 8(1), 54–66.

22.

Ellis

J. D.

Rabinowitz

J. A.

Wells

Liu

Finan

P. H.

Stein

M. D.

Antoine

D. G.

II Hobelmann

G. J.

Huhn

A. S.

(2022). Latent trajectories of anxiety and depressive symptoms among adults in early treatment for nonmedical opioid use. Journal of Affective Disorders, 299, 223–232.

23.

Fatséas

Denis

Lavie

Auriacombe

(2010). Relationship between anxiety disorders and opiate dependence—A systematic review of the literature: Implications for diagnosis and treatment. Journal of Substance Abuse Treatment, 38(3), 220–230. https://doi.org/10.1016/j.jsat.2009.12.003

24.

Fey

C. F.

Delios

(2023). The Measurement and communication of effect sizes in management research. Management and Organization Review, 19(1), 176–197.

25.

Fortune

D. G.

Richards

H. L.

Griffiths

C. E. M.

Main

C. J.

(2005). Worry and pathological worry in patients with psoriasis: Cross sectional and longitudinal analyses of the Penn State Worry Questionnaire (PSWQ) in four samples of patients. Journal of Clinical Psychology in Medical Settings, 12(2), 143–152. https://doi.org/10.1007/s10880-005-3274-9

26.

Fresco

D. M.

Heimberg

R. G.

Mennin

D. S.

Turk

C. L.

(2002). Confirmatory factor analysis of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 40(3), 313–323. https://doi.org/10.1016/S0005-7967(00)00113-3

27.

Garey

Olofsson

Garza

Rogers

A. H.

Kauffman

B. Y.

Zvolensky

M. J.

(2020). Directional effects of anxiety and depressive disorders with substance use: A review of recent prospective research. Current Addiction Reports, 7, 344–355.

28.

Henseler

Ringle

C. M.

Sarstedt

(2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43, 115–135.

29.

Jesse

Bråthen

Ferrara

Keindl

Ben-Menachem

Tanasescu

Brodtkorb

Hillbom

Leone

M. A.

Ludolph

A. C.

(2017). Alcohol withdrawal syndrome: mechanisms, manifestations, and management. Acta Neurologica Scandinavica, 135(1), 4–16. https://doi.org/https://doi.org/10.1111/ane.12671

30.

Johnco

Wuthrich

V. M.

Brenes

G. A.

Wetherell

J. L.

Mohlman

(2022). Evidence-based assessment of treatment outcomes for late-life generalized anxiety disorder using the Penn State Worry Questionnaire (PSWQ) and Penn State Worry Questionnaire–Abbreviated (PSWQ-A). International Psychogeriatrics, 34(5), 489–501.

31.

Kelly

J. F.

Hoeppner

B. B.

(2013). Does alcoholics anonymous work differently for men and women? A moderated multiple-mediation analysis in a large clinical sample. Drug Alcohol Depend, 130(1–3), 186–193. https://doi.org/10.1016/j.drugalcdep.2012.11.005

32.

Kelly

W. E.

(2008). Anxiety and stress as contributory factors in pathological and nonpathological worry. Psychology Journal, 5(3), 147–157.

33.

Kertz

S. J.

Lee

Björgvinsson

(2014). Psychometric properties of abbreviated and ultra-brief versions of the Penn State Worry Questionnaire. Psychological Assessment, 26(4), 1146–1154. https://doi.org/10.1037/a0037251

34.

Kline

R. B.

(2023). Principles and practice of structural equation modeling. Guilford Publications.

35.

Koo

T. K.

M. Y.

(2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012

36.

Koob

G. F.

(2015). The dark side of emotion: The addiction perspective. European Journal of Pharmacology, 753, 73–87.

37.

Koob

G. F.

Volkow

N. D.

(2016). Neurobiology of addiction: A neurocircuitry analysis. The Lancet Psychiatry, 3(8), 760–773.

38.

Lai

H. M. X.

Cleary

Sitharthan

Hunt

G. E.

(2015). Prevalence of comorbid substance use, anxiety and mood disorders in epidemiological surveys, 1990–2014: A systematic review and meta-analysis. Drug and Alcohol Dependence, 154, 1–13. https://doi.org/10.1016/j.drugalcdep.2015.05.031

39.

Marsh

H. W.

(1996). Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70(4), 810.

40.

McGraw

K. O.

Wong

S. P.

(1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30.

41.

McHugh

R. K.

(2015). Treatment of co-occurring anxiety disorders and substance use disorders. Harvard Review of Psychiatry, 23(2), 99–111.

42.

Meyer

T. J.

Miller

M. L.

Metzger

R. L.

Borkovec

T. D.

(1990). Development and validation of the penn state worry questionnaire. Behaviour Research and Therapy, 28(6), 487–495. https://doi.org/10.1016/0005-7967(90)90135-6

43.

Molina

Borkovec

T. D.

(1994). The Penn State Worry Questionnaire: Psychometric properties and associated characteristics. In Davey

G. C. L.

Tallis

(Eds.) Worrying: Perspectives on theory, assessment and treatment. (pp. 265–283). John Wiley & Sons.

44.

Motooka

Tanaka-Matsumi

Hayashi

(2009). The reliability and validity of a Japanese version of The Penn State Worry Questionnaire (PSWQ): A self-report inventory of “worry”. Japanese Journal of Counseling Science, 42(3), 247–255.

45.

Nieminen

(2022). Application of standardized regression coefficient in meta-analysis. BioMedInformatics, 2(3), 434–458. https://www.mdpi.com/2673-7426/2/3/28

46.

Nitschke

J. B.

Heller

Imig

J. C.

McDonald

R. P.

Miller

G. A.

(2001). Distinguishing dimensions of anxiety and depression. Cognitive Therapy and Research, 25, 1–22.

47.

Oliveira

J. T.

Faustino

Freitas

Gonçalves

M. M.

Ribeiro

Gonçalves

Machado

P. P. P.

(2023). Penn State Worry Questionnaire in emotional disorders: Validation and normative data for Portuguese population. British Journal of Guidance & Counselling, 51(2), 251–261. https://doi.org/10.1080/03069885.2021.1897969

48.

Pallesen

Nordhus

I. H.

Carlstedt

Thayer

J. F.

Johnsen

T. B.

(2006). A Norwegian adaptation of the Penn State Worry Questionnaire: Factor structure, reliability, validity and norms. Scandinavian Journal of Psychology, 47(4), 281–291. https://doi.org/10.1111/j.1467-9450.2006.00518.x

49.

Puccinelli

Cameron

D. H.

Ouellette

M. J.

McCabe

R. E.

Rowa

(2023). Psychometric properties of the Penn State Worry Questionnaire-Past Week (PSWQ-PW) in an anxiety and related disorders sample. Journal of Psychopathology and Behavioral Assessment, 45(2), 549–557.

50.

R Core Team. (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

51.

Rabinowitz

J. A.

Ellis

J. D.

Wells

Strickland

J. C.

Maher

B. S.

Hobelmann

J. G.

Huhn

(2023). Correlates and consequences of anxiety and depressive symptom trajectories during early treatment for alcohol use. Alcohol, 108, 44–54.

52.

Revelle

(2023). psych: Procedures for psychological, psychometric, and personality research. Northwestern University. https://CRAN.R-project.org/package=psych.

53.

Rodríguez-Biglieri

Vetere

G. L.

(2011). Psychometric characteristics of the Penn State Worry Questionnaire in an Argentinean sample: A cross-cultural contribution. The Spanish Journal of Psychology, 14(1), 452–463. https://doi.org/10.5209/rev_SJOP.2011.v14.n1.41

54.

Rönkkö

Cho

(2022). An updated guideline for assessing discriminant validity. Organizational Research Methods, 25(1), 6–14.

55.

Rosseel

(2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

56.

Ruiz

F. J.

Monroy-Cifuentes

Suárez-Falcón

J. C.

(2018). Penn State Worry Questionnaire-11 validity in Colombia and factorial equivalence across gender and nonclinical and clinical samples. Anales de Psicología/Annals of Psychology, 34(3), 451–457.

57.

Schuckit

M. A.

(2014). Recognition and management of withdrawal delirium (delirium tremens). New England Journal of Medicine, 371(22), 2109–2113. https://doi.org/10.1056/NEJMra1407298

58.

Schuckit

M. A.

(2006). Comorbidity between substance use disorders and psychiatric conditions. Addiction, 101, 76–88.

59.

Shrout

P. E.

Fleiss

J. L.

(1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420.

60.

Stöber

Bittencourt

. (1998). Weekly assessment of worry: An adaptation of the Penn State Worry Questionnaire for monitoring changes during treatment. Behaviour Research and Therapy, 36(6), 645–656. https://doi.org/10.1016/S0005-7967(98)00031-X

61.

Stoeber

(1995). Besorgnis: Ein Vergleich dreier Inventare zur Erfassung allgemeiner Besorgnis [Worry: A comparison of three inventories to assess general worries]. Zeitschrift für Differentielle und Diagnostische Psychologie, 16, 50–63.

62.

Tallis

Eysenck

Mathews

(1992). A questionnaire for the measurement of nonpathological worry. Personality and Individual Differences, 13(2), 161–168.

63.

van Rijsoort

Emmelkamp

Vervaeke

. (1999). The Penn State Worry Questionnaire and the worry domains questionnaire: Structure, reliability and validity. Clinical Psychology & Psychotherapy, 6(4), 297–307. https://doi.org/10.1002/(SICI)1099-0879(199910)6:4<297::AID-CPP206>3.0.CO;2-E

64.

Voorhees

C. M.

Brady

M. K.

Calantone

Ramirez

(2016). Discriminant validity testing in marketing: An analysis, causes for concern, and proposed remedies. Journal of the Academy of Marketing Science, 44(1), 119–134. https://doi.org/10.1007/s11747-015-0455-4

65.

Vorspan

Mehtelli

Dupuy

Bloch

Lépine

J.-P.

(2015). Anxiety and substance use disorders: Co-occurrence and clinical issues. Current Psychiatry Reports, 17, 1–7.

66.

Wuthrich

V. M.

Johnco

Knight

(2014). Comparison of the Penn State Worry Questionnaire (PSWQ) and abbreviated version (PSWQ-A) in a clinical and non-clinical population of older adults. Journal of Anxiety Disorders, 28(7), 657–663. https://doi.org/10.1016/j.janxdis.2014.07.005

67.

Xie

S.-S.

Xiao

H.-W.

Lin

R.-M.

(2023). Abbreviated version of Penn State Worry Questionnaire for Chinese adolescents: Age, gender and longitudinal invariance. Frontiers in Psychiatry, 14, 1086592. https://doi.org/10.3389/fpsyt.2023.1086592

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.02 MB