An Item Response Theory Analysis of the Clinician-Administered PTSD Scale for DSM-5 Among Veterans

Abstract

We used item response theory (IRT) analysis to examine Clinician-Administered PTSD Scale for DSM-5 (CAPS-5) item performance using data from three large samples of veterans (total N = 808) using both binary and ordinal rating methods. Relative to binary ratings, ordinal ratings provided good coverage from well below to well above average within each symptom cluster. However, coverage varied by cluster, and item difficulties were unevenly distributed within each cluster, with numerous instances of redundancy. For both binary and ordinal scores, flashbacks, dissociative amnesia, and self-destructive behavior items showed a pattern of high difficulty but relatively poor discrimination. Results indicate that CAPS-5 ordinal ratings provide good severity coverage and that most items accurately differentiated between participants by severity. Observed uneven distribution and redundancy in item difficulty suggest there is opportunity to create an abbreviated version of the CAPS-5 for determining PTSD symptom severity, but not DSM-5 PTSD diagnosis, without sacrificing precision.

Keywords

CAPS-5 IRT psychometrics PTSD assessment

Get full access to this article

View all access options for this article.

References

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.).

Bovin

M. J.

Kimerling

Weathers

F. W.

Prins

Marx

B. P.

Post

E. P.

Schnurr

P. P.

(2021). Diagnostic accuracy and acceptability of the primary care posttraumatic stress disorder screen for the diagnostic and statistical manual of mental disorders among U.S. veterans. Journal of the American Medical Association Network Open, 4(2), Article e2036733.

Brewin

C. R.

Lanius

R. A.

Novac

Schnyder

Galea

(2009). Reformulating PTSD for DSM-V: Life after criterion A. Journal of Traumatic Stress, 22, 366–373.

Haynes

S. N.

Richard

D. C. S.

Kubany

E. S.

(1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238–247. https://doi.org/10.1037/1040-3590.7.3.238

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. https://doi.org/10.1080/10705519909540118

Kline

R. B.

(2011). Principles and practice of structural equation modeling (3rd ed.). Guilford Press.

Lee

D. J.

Bovin

M. J.

Weathers

F. W.

Schnurr

P. P.

Palmieri

P. A.

Sloan

D. M.

Keane

T. M.

Marx

B. P.

(2019). Latent factor structure of DSM-5 posttraumatic stress disorder: Evaluation of method variance and construct validity of novel symptom clusters. Psychological Assessment, 31, 46–58.

Miller

M. W.

Wolf

E. J.

Kilpatrick

Resnick

Marx

B. P.

Holowka

D. W.

Keane

T. M.

Rosen

R. C.

Friedman

M. J.

(2013). The prevalence and latent structure of proposed DSM-5 posttraumatic stress disorder symptoms in U.S. national and veteran samples. Psychological Trauma: Theory, Research, Practice, and Policy, 5, 501–512. https://doi.org/10.1037/a0029730

Muthén

L. K.

Muthén

B. O.

(1998–2017). Mplus Version 7 user’s guide.

10.

Palmieri

P. A.

Weathers

F. W.

Difede

King

D. W.

(2007). Confirmatory factor analysis of the PTSD Checklist and the Clinician-Administered PTSD Scale in disaster workers exposed to the World Trade Center Ground Zero. Journal of Abnormal Psychology, 116, 329–341. https://doi.org/10.1037/0021-843X.116.2.329

11.

Peterson

A. L.

Resick

P. A.

Mintz

Young-McCaughan

McGeary

D. D.

McGeary

C. A.

Velligan

D. I.

Macdonald

Mata-Galan

Holliday

S. L.

Dillon

K. H.

Roache

J. D.

Christians

I. W.

Moring

J. C.

Bira

L. M.

Nabity

P. S.

Hancock

A. K.

Hale

W. J.

, & STRONG STAR Consortium. (2018). Design of a clinical effectiveness trial of in-home cognitive processing therapy for combat-related PTSD. Contemporary Clinical Trials, 73, 27–35. https://doi.org/10.1016/j.cct.2018.08.005

12.

Reise

S. P.

Ainsworth

A. T.

Haviland

M. G.

(2005). Item response theory fundamentals, applications, and promise in psychological research. Current Directions in Psychological Science, 14, 95–101. https://doi.org/10.1111/j.0963-7214.2005.00342.x

13.

Reise

S. P.

Waller

N. G.

(2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48.

14.

Samejima

(1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34, 1–97.

15.

Schnurr

P. P.

Chard

K. M.

Ruzek

J. I.

Chow

B. K.

Shih

M. C.

Resick

P. A.

Foa

E. B.

Marx

B. P.

Hung

G. D.

(2015). Design of VA Cooperative Study# 591: CERV-PTSD, comparative effectiveness research in veterans with PTSD. Contemporary Clinical Trials, 41, 75–84. https://doi.org/10.1016/j.cct.2014.11.017

16.

Silverstein

M. W.

Petri

J. M.

Kramer

L. B.

Weathers

F. W.

(2020). An item response theory analysis of the PTSD checklist for DSM-5: Implications for DSM-5 and ICD-11. Journal of Anxiety Disorders, 70, Article 102190.

17.

Sloan

D. M.

Unger

Lee

D. J.

Beck

J. G.

(2018). A randomized controlled trial of group cognitive behavioral treatment for veterans diagnosed with chronic posttraumatic stress disorder. Journal of Traumatic Stress, 31, 886–898. https://doi.org/10.1002/jts.22338

18.

Spearman

(1904). The proof and measurement of association between two things. American Journal of Psychology, 15, 72–101.

19.

Weathers

F. W.

Blake

D. D.

Schnurr

P. P.

Kaloupek

D. G.

Marx

B. P.

Keane

T. M.

(2013a). The Clinician-Administered PTSD Scale for DSM-5 (CAPS-5). National Center for PTSD. www.ptsd.va.gov

20.

Weathers

F. W.

Bovin

M. J.

Lee

D. J.

Sloan

D. M.

Schnurr

P. P.

Kaloupek

D. G.

Keane

T. M.

Marx

B. P.

(2018). The Clinician-Administered PTSD Scale for DSM–5 (CAPS-5): Development and initial psychometric evaluation in military veterans. Psychological Assessment, 30, 383–395. https://doi.org/10.1037/pas0000486

21.

Weathers

F. W.

Litz

B. T.

Keane

T. M.

Palmieri

P. A.

Marx

B. P.

Schnurr

P. P.

(2013b). The PTSD Checklist for DSM-5 (PCL-5) [Scale]. National Center for PTSD. www.ptsd.va.gov

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.70 MB