Sage Journals: Discover world-class research

Abstract

Screening tools commonly used for psychological distress among cancer patients have high rates of false positives, thus warranting a brief, detailed screening measure of distress. This study assessed the feasibility, acceptability, reliability, and validity of the Psychological Distress Profile (PDP) in an online sample of cancer patients. One hundred and seventy-four participants with a self-reported diagnosis of cancer were included in this study. Participants completed the study via Amazon’s Mechanical Turk (MTurk). Results yielded high ratings of acceptability, ease of completion, and willingness to complete the PDP. The PDP demonstrated high internal consistency (Cronbach’s α = .94). The PDP depression subscale had large positive correlations with the PDP hopelessness subscale (r = .84, p < .001), PHQ-9 (r = .67, p < .001), and CES-D (r = .67, p < .001). The PDP anxiety subscale had large positive correlations with the PROMIS Emotional Distress-Anxiety-Short Form (r = .68, p < .001) and GAD-7 (r = .70, p < .001). Finally, the PDP anger subscale had a large positive correlation with the PROMIS Emotional Distress-Anger-Short Form (r = .76, p < .001). The mean PDP total score (N = 174) was 69.0 (sd = 16.4). The PDP total score demonstrated a small, significant positive correlation with the DT (r = .21, p = .005) and is likely more sensitive to distress associated with depression, hopelessness, anxiety, and anger. The PDP emerges as a theory-driven distress assessment tool for use with cancer patients.

Keywords

cancer distress distress screening psycho-oncology Mechanical Turk

Get full access to this article

View all access options for this article.

References

Arch

J. J.

Carr

A. L.

(2017). Using Mechanical Turk for research on cancer survivors. Psycho-Oncology, 26(10), 1593–1603. https://doi.org/10.1002/pon.4173

Basch

Deal

A. M.

Dueck

A. C.

Scher

H. I.

Kris

M. G.

Hudis

Schrag

(2017). Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment. Journal of the American Medical Association, 318(2), 197–198. https://doi.org/10.1001/jama.2017.7156

Biggs

Elkins

(2024). PDP Dissertation Full Dataset (Version 1) [Dataset]. Texas Data Repository. https://doi.org/10.18738/T8/K45HSF

Bjelland

Dahl

A. A.

Haug

T. T.

Neckelmann

(2002). The validity of the Hospital Anxiety and Depression Scale. An updated literature review. Journal of Psychosomatic Research, 52(2), 69–77. https://doi.org/10.1016/s0022-3999(01)00296-3

Black

L. L.

(2016). Analysis of the Distress Thermometer’s psychometric properties and applicability to subgroups. University of Kansas. [Unpublished doctoral dissertation].

Braeken

A. P.

Kempen

G. I.

Eekers

D. B.

Houben

R. M.

van Gils

F. C.

Ambergen

Lechner

(2013). Psychosocial screening effects on health-related outcomes in patients receiving radiotherapy. A cluster randomised controlled trial. Psycho-Oncology, 22(12), 2736–2746. https://doi.org/10.1002/pon.3340

Buhrmester

Kwang

Gosling

S. D.

(2011). Amazon's mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science: A journal of the Association for Psychological Science, 6(1), 3–5. https://doi.org/10.1177/1745691610393980

Carlsen

Jensen

A. B.

Jacobsen

Krasnik

Johansen

(2005). Psychosocial aspects of lung cancer. Lung Cancer, 47(3), 293–300. https://doi.org/10.1016/j.lungcan.2004.08.002

Carlson

L. E.

(2013). Screening alone is not enough: The importance of appropriate triage, referral, and evidence-based treatment of distress and common problems. Journal of Clinical Oncology: Official Journal of the American Society of Clinical Oncology, 31(29), 3616–3617. https://doi.org/10.1200/JCO.2013.51.4315

10.

Carlson

L. E.

Zelinski

E. L.

Toivonen

K. I.

Sundstrom

Jobin

C. T.

Damaskos

Zebrack

(2019). Prevalence of psychosocial distress in cancer patients across 55 North American cancer centers. Journal of Psychosocial Oncology, 37(1), 5–21. https://doi.org/10.1080/07347332.2018.1521490

11.

Casler

Bickel

Hackett

(2013). Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Computers in Human Behavior, 29(6), 2156–2160. https://doi.org/10.1016/j.chb.2013.05.009

12.

Cutillo

O'Hea

Person

Lessard

Harralson

Boudreaux

(2017). The Distress Thermometer: Cutoff points and clinical use. Oncology Nursing Forum, 44(3), 329–336. https://doi.org/10.1188/17.ONF.329-336

13.

Ehlers

S. L.

Davis

Bluethmann

S. M.

Quintiliani

L. M.

Kendall

Ratwani

R. M.

Diefenbach

M. A.

Graves

K. D.

(2019). Screening for psychosocial distress among patients with cancer: Implications for clinical practice, healthcare policy, and dissemination to enhance cancer survivorship. Translational Behavioral Medicine, 9(2), 282–291. https://doi.org/10.1093/tbm/iby123

14.

Elkins

Johnson

(2015). Psychological distress profile. Mind Garden.

15.

Faul

Erdfelder

Buchner

Lang

A. G.

(2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149

16.

Funk

Cisneros

Williams

R. C.

Kendall

Hamann

H. A.

(2016). What happens after distress screening? Patterns of supportive care service utilization among oncology patients identified through a systematic screening protocol. Supportive Care in Cancer: Official Journal of the Multinational Association of Supportive Care in Cancer, 24(7), 2861–2868. https://doi.org/10.1007/s00520-016-3099-0

17.

Granek

Nakash

Ariad

Shapira

Ben-David

(2018). Oncologists’ identification of mental health distress in cancer patients: Strategies and barriers. European Journal of Cancer Care, 27(3), Article e12835. https://doi.org/10.1111/ecc.12835

18.

Hann

Winter

Jacobsen

(1999). Measurement of depressive symptoms in cancer patients: Evaluation of the center for epidemiological studies depression scale (CES-D). Journal of Psychosomatic Research, 46(5), 437–443. https://doi.org/10.1016/s0022-3999(99)00004-5

19.

Howlader

Noone

A. M.

Krapcho

Miller

Brest

Ruhl

Tatalovich

Mariotto

Lewis

D. R.

Chen

H. S.

Feuer

E. J.

Cronin

K. A.

(2021). SEER cancer statistics Review, 1975-2018. National Cancer Institute. https://seer.cancer.gov/csr/1975_2018/

20.

Hughes

K. L.

Sargeant

Hawkes

A. L.

(2011). Acceptability of the Distress Thermometer and Problem List to community-based telephone cancer helpline operators, and to cancer patients and carers. BMC Cancer, 11(1), 46. https://doi.org/10.1186/1471-2407-11-46

21.

IBM Corp. Released . (2021). IBM SPSS statistics for windows, version 28.0. IBM Corp.

22.

Jacobsen

P. B.

(2007). Screening for psychological distress in cancer patients: Challenges and opportunities. Journal of Clinical Oncology: Official Journal of the American Society of Clinical Oncology, 25(29), 4526–4527. https://doi.org/10.1200/JCO.2007.13.1367

23.

Jacobsen

P. B.

Ransom

(2007). Implementation of NCCN distress management guidelines by member institutions. Journal of the National Comprehensive Cancer Network: Journal of the National Comprehensive Cancer Network, 5(1), 99–103. https://doi.org/10.6004/jnccn.2007.0010

24.

Krebber

A. M.

Jansen

Cuijpers

Leemans

C. R.

Verdonck-de Leeuw

I. M.

(2016). Screening for psychological distress in follow-up care to identify head and neck cancer patients with untreated distress. Supportive Care in Cancer: Official Journal of the Multinational Association of Supportive Care in Cancer, 24(6), 2541–2548. https://doi.org/10.1007/s00520-015-3053-6

25.

Kroenke

Spitzer

R. L.

Williams

J. B.

(2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x

26.

Lazenby

Dixon

Bai

McCorkle

(2014). Comparing the distress thermometer (DT) with the patient health questionnaire (PHQ)-2 for screening for possible cases of depression among patients newly diagnosed with advanced cancer. Palliative & Supportive Care, 12(1), 63–68. https://doi.org/10.1017/S1478951513000394

27.

Loevinger

(1957). Objective tests as instruments of psychological theory. Psychological Reports, 3(3), 635–694. https://doi.org/10.2466/pr0.1957.3.3.635

28.

Loevinger

(1972). Some limitations of objective personality tests. In Butcher

J. N.

(Ed.), Objective personality assessment (pp. 45–58). Academic Press.

29.

Mausbach

B. T.

Schwab

R. B.

Irwin

S. A.

(2015). Depression as a predictor of adherence to adjuvant endocrine therapy (aet) in women with breast cancer: A systematic review and meta-analysis. Breast Cancer Research and Treatment, 152(2), 239–246. https://doi.org/10.1007/s10549-015-3471-7

30.

Mehnert

Hartung

T. J.

Friedrich

Vehling

Brähler

Härter

Keller

Schulz

Wegscheider

Weis

Koch

Faller

(2017). One in two cancer patients is significantly distressed: Prevalence and indicators of distress. Psycho-Oncology, 27(1), 75–82. https://doi.org/10.1002/pon.4464

31.

Meijer

Roseman

Delisle

V. C.

Milette

Levis

Syamchandra

Stefanek

M. E.

Stewart

D. E.

de Jonge

Coyne

J. C.

Thombs

B. D.

(2013). Effects of screening for psychological distress on patient outcomes in cancer: A systematic review. Journal of Psychosomatic Research, 75(1), 1–17. https://doi.org/10.1016/j.jpsychores.2013.01.012

32.

Miao

Verkooijen

H. M.

Kee-Seng

Bouchardy

Pukkala

Larønningen

Mellemkjær

Czene

Hartman

(2011). Incidence and outcome of male breast cancer: An international population-based study. Journal of Clinical Oncology, 29(33), 4381–4386. https://doi.org/10.1200/JCO.2011.36.8902

33.

Mitchell

A. J.

(2007). Pooled results from 38 analyses of the accuracy of distress thermometer and other ultra-short methods of detecting cancer-related mood disorders. Journal of Clinical Oncology: Official Journal of the American Society of Clinical Oncology, 25(29), 4670–4681. https://doi.org/10.1200/JCO.2006.10.0438

34.

Mitchell

A. J.

Baker-Glenn

E. A.

Park

Granger

Symonds

(2010). Can the distress thermometer be improved by additional mood domains? Part II. What is the optimal combination of emotion thermometers? Psycho-Oncology, 19(2), 134–140. https://doi.org/10.1002/pon.1557

35.

Mortensen

Hughes

T. L.

(2018). Comparing Amazon's Mechanical Turk platform to conventional data collection methods in the health and medical research literature. Journal of General Internal Medicine, 33(4), 533–538. https://doi.org/10.1007/s11606-017-4246-0

36.

Nakash

Levav

Aguilar-Gaxiola

Alonso

Andrade

L. H.

Angermeyer

M. C.

Bruffaerts

Caldas-de-Almeida

J. M.

Florescu

de Girolamo

Gureje

de Jonge

Karam

E. G.

Kovess-Masfety

Medina-Mora

M. E.

Moskalewicz

Murphy

Scott

K. M.

(2014). Comorbidity of common mental disorders with cancer and their treatment gap: Findings from the World Mental Health Surveys. Psycho-Oncology, 23(1), 40–51. https://doi.org/10.1002/pon.3372

37.

National Comprehensive Cancer Network (NCCN) . (2020a). NCCN Distress Thermometer and Problem List for Patients. https://www.nccn.org/docs/default-source/patient-resources/nccn_distress_thermometer.pdf?sfvrsn=ef1df1a2_4

38.

National Comprehensive Cancer Network (NCCN) . (2020b). NCCN Clinical Practice Guidelines in Oncology (NCCN Guidelines®): Distress Management. https://apos-society.org/wp-content/uploads/2021/02/distress.pdf

39.

National Comprehensive Cancer Network (NCCN) . (2020c). NCCN Guidelines for Patients®: Distress During Cancer Care. https://www.nccn.org/patients/guidelines/content/PDF/distress-patient.pdf

40.

Pilkonis

P. A.

Choi

S. W.

Reise

S. P.

Stover

A. M.

Riley

W. T.

Cella

PROMIS Cooperative Group . (2011). Item banks for measuring emotional distress from the patient-reported outcomes measurement information system (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283. https://doi.org/10.1177/1073191111411667

41.

Polsky

Doshi

J. A.

Marcus

Oslin

Rothbard

Thomas

Thompson

C. L.

(2005). Long-term risk for depressive symptoms after a medical diagnosis. Archives of Internal Medicine, 165(11), 1260–1266. https://doi.org/10.1001/archinte.165.11.1260

42.

Radloff

L. S.

(1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385–401. https://doi.org/10.1177/014662167700100306

43.

Rosenfeld

Pessin

Lewis

Abbey

Olden

Sachs

Amakawa

Kolva

Brescia

Breitbart

(2011). Assessing hopelessness in terminally ill cancer patients: Development of the hopelessness assessment in illness questionnaire. Psychological Assessment, 23(2), 325–336. https://doi.org/10.1037/a0021767

44.

Ryan

Schofield

Cockburn

Butow

Tattersall

Turner

Girgis

Bandaranayake

Bowman

(2005). How to recognize and manage psychological distress in cancer patients. European Journal of Cancer Care, 14(1), 7–15. https://doi.org/10.1111/j.1365-2354.2005.00482.x

45.

Söllner

DeVries

Steixner

Lukas

Sprinzl

Rumpold

Maislinger

(2001). How successful are oncologists in identifying patient distress, perceived social support, and need for psychosocial counselling? British Journal of Cancer, 84(2), 179–185. https://doi.org/10.1054/bjoc.2000.1545

46.

Spitzer

R. L.

Kroenke

Williams

J. B.

(1999). Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. Primary care evaluation of mental disorders. Patient health questionnaire. Journal of the American Medical Association, 282(18), 1737–1744. https://doi.org/10.1001/jama.282.18.1737

47.

Spitzer

R. L.

Kroenke

Williams

J. B.

Löwe

(2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092

48.

Steele

I. H.

Thrower

Noroian

Saleh

F. M.

(2018). Understanding suicide across the lifespan: A United States perspective of suicide risk factors, assessment & management. Journal of Forensic Sciences, 63(1), 162–171. https://doi.org/10.1111/1556-4029.13519

49.

Traeger

Cannon

Keating

N. L.

Pirl

W. F.

Lathan

Martin

M. Y.

Park

E. R.

(2014). Race by sex differences in depression symptoms and psychosocial service use among non-Hispanic black and white patients with lung cancer. Journal of Clinical Oncology: Official Journal of the American Society of Clinical Oncology, 32(2), 107–113. https://doi.org/10.1200/JCO.2012.46.6466

50.

Veit

C. T.

Ware

J. E.

Jr. (1983). The structure of psychological distress and well-being in general populations. Journal of Consulting and Clinical Psychology, 51(5), 730–742. https://doi.org/10.1037//0022006x.51.5.730

51.

Zabora

BrintzenhofeSzoc

Curbow

Hooker

Piantadosi

(2001). The prevalence of psychological distress by cancer site. Psycho-Oncology, 10(1), 19–28. https://doi.org/10.1002/1099-1611(200101/02)10:1<19::aid-pon501>3.0.co;2-6

52.

Zebrack

Kayser

Bybee

Padgett

Sundstrom

Jobin

Oktay

(2017). A practice-based evaluation of distress screening protocol adherence and medical service utilization. Journal of the National Comprehensive Cancer Network: Journal of the National Comprehensive Cancer Network, 15(7), 903–912. https://doi.org/10.6004/jnccn.2017.0120

53.

Zigmond

A. S.

Snaitbh

R. P.

(1983). The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica, 67(6), 361–370. https://doi.org/10.1111/j.1600-0447.1983.tb09716.x

Feasibility and Acceptability of the Psychological Distress Profile for Evaluating Distress Among Cancer Patients

Abstract

Keywords

Get full access to this article

References