Construct Validity of DSM-5 Level 2 Assessments (PROMIS Depression,Anxiety,and Anger): Evidence From the MMPI-2-RF

Abstract

The Patient Reported Outcome Measurement Information System (PROMIS) is a NIH-funded measure that has item banks assessing a variety of physical, social, and mental health domains. Short forms from the emotional distress item bank (which includes measures of Depression, Anxiety, and Anger) were included in the Diagnostic and Statistical Manual for Mental Disorders–Fifth edition as emerging measures to be administered at intake to aid diagnosis and throughout treatment to track progress. The purpose of the current study was to further investigate the PROMIS distress item bank’s construct validity using the Minnesota Multiphasic Personality Inventory–2–Restructured Form (MMPI-2-RF). The sample included 344 college students (119 males, 225 females) who were administered the MMPI-2-RF and the PROMIS Anxiety, Anger, and Depression short forms. Zero-order correlations between the PROMIS scales and the Restructured Clinical Scales and Internalizing Specific Problems Scales were examined. Overall, these results suggest that scores from the PROMIS Anxiety, Anger, and Depression scales evidence convergent validity but have problematic construct validity (particularly for Depression). Future revision of the scales should be considered and sufficient external validation evidence should be available for review before psychological assessments are recommended and distributed for widespread clinical use.

Keywords

PROMIS psychometrics validity MMPI-2-RF

Get full access to this article

View all access options for this article.

References

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorder (5th ed.). Author.

Beck

Epstein

Brown

Steer

(1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56(6), 893-897. https://doi.org/10.1037/0022-006X.56.6.893

Beck

Steer

Brown

(1996). Manual for the Beck Depression Inventory. Psychological Corporation.

Ben-Porath

Y. S.

Tellegen

(2008/2011). MMPI-2-RF: Manual for administration, scoring and interpretation. University of Minnesota Press.

Buss

A. H.

Perry

(1992). The aggression questionnaire. Journal of Personality and Social Psychology, 63(3), 452-459. https://doi.org/10.1037/0022-3514.63.3.452

Butcher

Graham

J. R.

Ben-Porath

Y. S.

Tellegen

Dahlstrom

G. W.

Kaemmer

(2001). Minnesota Multiphasic Personality Inventory-2: Manual for administration, scoring, and interpretation. University of Minnesota Press.

Choi

S. W.

Schalet

Cook

K. F.

Cella

(2014). Establishing a common metric for depressive symptoms: Linking the BDI-II, CES-D, and PHQ-9 to PROMIS Depression. Psychological Assessment, 26(2), 513-527. https://doi.org/10.1037/A0035768

Clarke

Kuhl

(2014). DSM-5 cross-cutting symptom measures: A step towards the future of psychiatric care? World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 13(3), 314-316. https://doi.org/10.1002/wps.20154

Cohen

(1992). A power primer. Psychological Bulletin, 112(1), 155-159. https://doi.org/10.1037/0033-2909.112.1.155

10.

Frank

J. D.

(1974). Psychotherapy: The restoration of morale. American Journal of Psychiatry, 131(3), 271-274. https://doi.org/10.1176/ajp.131.3.271

11.

Klein

D. F.

(1974). Endogenomorphic depression: A conceptual and terminological revision. Archives of General Psychiatry, 31(4), 447-454. https://doi.org/10.1001/archpsyc.1974.01760160005001

12.

Kotov

Krueger

R. F.

Watson

Achenbach

T. M.

Althoff

R. R.

Bagby

R. M.

Brown

T. A.

Carpenter

W. T.

Caspi

Clark

L. A.

Eaton

N. R.

Forbes

M. K.

Forbush

K. T.

Goldberg

Hasin

Hyman

S. E.

Ivanova

M. Y.

Lynam

D. R.

Markon

. . . Zimmerman

(2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126(4), 454-477. https://doi.org/10.1037/abn0000258

13.

Kroenke

Spitzer

R. L.

Williams

J. B.

(2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606-613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x

14.

Pilkonis

P. A.

Choi

S. W.

Reise

S. P.

Stover

A. M.

Riley

W. T.

Cella

, & PROMIS Cooperative Group. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263-283. https://doi.org/10.1177/1073191111411667

15.

Pilkonis

P. A.

Dodds

N. E.

Johnston

K. L.

Maihoefer

C. C.

Lawrence

S. M.

(2014). Validation of the depression item bank from the Patient-Reported Outcomes Measurement Information System (PROMIS®) in a three-month observational study. Journal of Psychiatric Research, 56, 112-119. https://doi.org/10.1016/j.jpsychires.2014.05.010

16.

Radloff

L. S.

(1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385-401. https://doi.org/10.1177/014662167700100306

17.

Regier

D. A.

Kuhl

E. A.

Kupfer

D. J.

(2013). The DSM-5: Classification and criteria changes. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 12(2), 92-98. https://doi.org/10.1002/wps.20050

18.

Schalet

B. D.

Cook

K. F.

Choi

S. W.

Cella

(2014). Establishing a common metric for self-reported anxiety: Linking the MASQ, PANAS, and GAD-7 to PROMIS Anxiety. Journal of Anxiety Disorders, 28(1), 88-96. https://doi.org/10.1016/j.janxdis.2013.11.006

19.

Sellbom

Ben-Porath

Y. S.

Bagby

R. M.

(2008). On the hierarchical structure of mood and anxiety disorders: Confirmatory evidence and elaboration of a model of temperament markers. Journal of Abnormal Psychology, 117(3), 576-590. https://doi.org/10.1037/a0012536

20.

Spitzer

R. L.

Kroenke

Williams

J. B.

Löwe

(2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092-1097. https://doi.org/10.1001/archinte.166.10.1092

21.

Tellegen

(1985). Structures of mood and personality and their relevance to assessing anxiety, with an emphasis on self-report. In Tuma

A. H.

Masere

J. D.

(Eds.), Anxiety and anxiety disorders (pp. 681-706). Lawrence Erlbaum.

22.

Tellegen

Ben-Porath

Y. S.

(2008/2011). Minnesota Multiphasic Personality Inventory-2-Restructured Form: Technical manual. University of Minnesota Press.

23.

Tellegen

Ben-Porath

Y. S.

McNulty

J. L.

Arbisi

P. A.

Graham

J. R.

Kaemmer

(2003). The MMPI-2 Restructured Clinical (RC) scales: Development, validation, and interpretation. University of Minnesota Press.

24.

Vilagut

Forero

C. G.

Adroher

N. D.

Olariu

Cella

Alonso

(2015). Testing the PROMIS® Depression measures for monitoring depression in a clinical sample outside the US. Journal of Psychiatric Research, 68, 140-150. https://doi.org/10.1016/j.jpsychires.2015.06.009

25.

Watson

Clark

Tellegen

(1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063-1070. https://doi.org/10.1037/0022-3514.54.6.1063

26.

Watson

Weber

Assenheimer

Clark

Strauss

McCormick

(1995). Testing a tripartite model: I. Evaluating the convergent and discriminant validity of anxiety and depression symptom scales. Journal of Abnormal Psychology, 104(1), 3-14. https://doi.org/10.1037/0021-843X.104.1.3

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.02 MB