Comparative Efficacy Between Self-Report and Clinician-Administered Assessments of Posttraumatic Stress Disorder Symptoms Across Seven Studies

Abstract

A meta-analysis of seven studies using self-report and clinician-administered assessments to evaluate the effectiveness of a cognitive processing therapy (CPT) intervention among 684 participants. A secondary moderation analysis was completed to investigate the effect of assessment type, type of comparison group, and publication date with effect size reporting in seven studies evaluating the effectiveness of CPT for treating posttraumatic stress disorder. Results indicated no significant differences and modest effect sizes for assessment format (self-report vs. clinician administered) and publication date. A medium effect size was detected for type of comparison group implemented within individual studies. Implications for counseling practice and future research are discussed.

Keywords

assessment counseling practice counselor education quantitative research treatment efficacy specialty

Get full access to this article

View all access options for this article.

References

Ægisdóttir

White

M. J.

Spengler

P. M.

Maugherman

A. S.

Anderson

L. A.

Cook

R. S.

Rush

J. D.

(2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist, 34, 341–382. doi:10.1177/0011000005285875

American Counseling Association. (2005). ACA code of ethics. Alexandria, VA: Author. Retrieved from http://www.counseling.org/Resources/aca-code-of-ethics.pdf

American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental Disorders: DSM-5 (5th ed.). Arlington, VA: Author.

Bengston

Långström

(2007). Unguided clinical and actuarial assessment of re-offending risk: a direct comparison with sex offenders in Denmark. Sex Abuse, 19, 135–153.

Benson

Newsome

(2010). Potential utility of actuarial methods for identifying specific learning disabilities. Psychology in Schools, 47, 538–550. doi:10.1002/pits.20489

Blake

D. D.

Weathers

F. W.

Nagy

L. M.

Kaloupek

D. G.

Gusman

F. D.

Charney

D. S.

Keane

T. M.

(1995). The development of a clinician-administered PTSD Scale. Journal of Traumatic Stress, 8, 75–90.

Borenstein

Hedges

L. V.

Higgins

J. P. T.

Rothstein

H. R.

(2009). Introduction to meta-analysis. West Sussex, England: John Wiley.

Borofsky

Kellerman

Baucom

Oliver

Margolin

(2013). Community violence exposure and adolescents’ school engagement and academic achievement over time. Psychology of Violence, 3, 381–395. doi:10.1037/a0034121

10.

Bouch

Marshall

J. J.

(2005). Suicide risk: Structured professional judgment. Advances in Psychiatric Treatment, 11, 84–91. doi:10.1192/apt.11.2.84

11.

Brewin

Andrews

Valentine

(2000). Meta-analysis of risk factors for posttraumatic stress disorder in trauma-exposed adults. Journal of Consulting and Clinical Psychology, 68, 748–766. doi:10.1037/0022-006X.68.5.748

12.

Bury

A. S.

Bagby

R. M.

(2002). The detection of feigned uncoached and coached posttraumatic stress disorder with the MMPI-s in a sample of workplace accident victims. Psychological Assessment, 14, 472–484. doi:10.1037/1040-3590.14.4.472

13.

Calhoun

P. S.

Boggs

C. D.

Crawford

E. F.

Beckham

J. C.

(2009). Diagnostic efficiency of the Personality Assessment Inventory LOGIT function for posttraumatic stress disorder in women. Journal of Personality Assessment, 91, 409–415. doi:10.1080/00223890903087497

14.

Chambless

D. L.

Baker

M. J.

Baucom

D. H.

Beutler

L. E.

Calhoun

K. S.

Crits-Christoph

Woody

S. R.

(1998). Update on empirically validated therapies, II. The Clinical Psychologist, 51, 3–16.

15.

Chambless

D. L.

Sanderson

W. C.

Shoham

Bennett Johnson

Pope

K. S.

Crits-Christoph

McCurry

(1996). An update on empirically validated therapies. The Clinical Psychologist, 49, 5–18.

16.

*Chard

K. M.

(2005). An evaluation of cognitive processing therapy for the treatment of posttraumatic stress disorder related to childhood sexual abuse. Journal of Consulting and Clinical Psychology, 73, 965–971. doi:10.1037/0022-006X.73.5.965

17.

Clark

D. A.

Beck

A. T.

(2010). Cognitive therapy of anxiety disorders (2nd ed.). New York, NY: The Guilford Press.

18.

Cooper

L. V.

(2010). Research synthesis and meta-analysis: A step by step approach (4th ed.). Thousand Oaks, CA: Sage.

19.

Cooper

Hedges

L. V.

(2009). Potentials and limitations. In Cooper

Hedges

L. V.

Valentine

J. C.

(Eds.), The handbook of research synthesis and meta-analysis (pp. 561–572). New York, NY: Russell Sage Foundation.

20.

Cooper

Hedges

L. V.

Valentine

J. C.

(Eds.). (2009). The handbook of research synthesis and meta-analysis. New York, NY: Russell Sage Foundation.

21.

Dawes

R. M.

Faust

Meehl

P. M.

(1989). Clinical versus actuarial judgment. Science, 243, 1668–1674. doi:10.1126/science.2648573

22.

DerSimonian

Laird

(1986). Meta-analysis in clinical trials. Controlled Clinical Trials, 7, 177–188. doi:10.1016/0197-2456(86)90046-2

23.

Dyer

K. F.

Dorahy

M. J.

Shannon

Cory

(2013). Trauma typology as a risk factor for aggression and self-harm in a complex PTSD population: The mediating role of alterations in self-perception. Journal of Trauma & Dissociation, 14, 56–68. doi:10.1080/15299732.2012.710184

24.

Erford

B. T.

Savin-Murphy

Butler

(2010). Conducting a meta-analysis of counseling outcome research: Twelve steps and practical procedures. Counseling Outcome Research and Evaluation, 1, 19–43. doi:10.1177/2150137809356682

25.

Foa

E. B.

(1995). Posttraumatic Stress Disorder Diagnostic Scale manual. San Antonio, TX: Pearson.

26.

Foa

E. B.

Keane

T. M.

Friedman

M. J.

Cohen

J. A.

(2009). Effective treatments for PTSD: Practice guidelines from the International Society of Traumatic Stress Studies (2nd ed.). New York, NY: The Guilford Press.

27.

Foa

E. B.

Riggs

Dancu

Rothbaum

(1993). Reliability and validity of a brief instrument for assessing posttraumatic stress disorder. Journal of Traumatic Stress, 6, 459–473. doi:10.1002/jts.2490060405

28.

*Forbes

Lloyd

Nixon

R. D. V.

Elliott

Varker

Perry

Creamer

(2012). A multisite randomized controlled effectiveness trial of cognitive processing therapy for military-related posttraumatic stress disorder. Journal of Anxiety Disorders, 26, 442–452. doi:10.1016/j.janxdis.2012.01.006

29.

Haggård-Grann

(2007). Assessing violence risk: A review and clinical recommendations. Journal of Counseling and Development, 85, 294–301. doi:10.1002/j.1556-6678.2007.tb00477.x

30.

Hedges

L. V.

Olkin

(1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.

31.

Hedges

L. V.

Pigott

T. D.

(2004). The power of statistical tests for moderators in meta-analysis. Psychological Methods, 9, 426–445. doi:10.1037/1082-989X.9.4.426

32.

Hedges

L. V.

Tipton

Johnson

M. C.

(2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39–65. doi:10.1002/jrsm.5

33.

Kessler

R. C.

Chiu

W. T.

Demler

Merikangas

K. R.

Walters

E. E.

(2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 617–627. doi:10.1001/archpsyc.62.6.617

34.

Kunst

M. J.

(2011). Employment status and posttraumatic stress disorder following compensation seeking in victims of violence. Journal of Interpersonal Violence, 28, 377–393. doi:10.1177/0886260510362894

35.

Lenz

A. S.

(2013). Calculating effect size in single-case research: A comparison of nonoverlap methods. Measurement and Evaluation in Counseling and Development, 46, 64–73. doi:10.1177/0748175612456401

36.

Lenz

A. S.

(in press). Experimental research designs. In Sheperis

C. J.

Young

J. S.

(Eds.), Counseling research: Quantitative, qualitative, and mixed methods (2nd ed.). Upper Saddle River, NJ: Prentice Hall.

37.

Lipsey

M. W.

Wilson

(2001). Practical meta-analysis. Thousand Oaks, CA: Sage.

38.

*Monson

C. M.

Schnurr

P. P.

Resick

P. A.

Friedman

M. J.

Young-Xu

Stevens

S. P.

(2006). Cognitive processing therapy for veterans with military-related posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 74, 898–907. doi:10.1037/0022-006X.74.5.898

39.

Paulhus

D. L.

Vazire

(2007) The self-report method. In Robins

R. W.

Fraley

R. C.

Kruger

R. F.

(Eds.), Handbook of research methods in personality psychology (pp. 224–239). New York, NY: The Guilford Press.

40.

Pietrzak

R. H.

Goldstein

R. B.

Southwick

S. M.

Grant

B. F.

(2011). Prevalence and axis I comorbidity of full and partial posttraumatic stress disorder in the United States: Results from wave 2 of the National Epidemiologic Survey on Alcohol and Related Conditions. Journal of Anxiety Disorders, 25, 456–465. doi:10.1016/j.janxdis.2010.11.010

41.

Pinna

K. L.

Johnson

D. M.

Delahny

D. L.

(2014). PTSD, comorbid depression, and the cortisol waking response in victims of intimate partner violence: Preliminary evidence. Anxiety, Stress & Coping: An International Journal, 27, 253–259. doi:10.1080/10615806.2013.852185

42.

Plana

Lavoie

Battaglia

Achim

(2014). A meta-analysis and scoping review of social cognition performance in social phobia, posttraumatic stress disorder and other anxiety disorders. Journal of Anxiety Disorders, 28, 169–177. doi: 10.1016/j.janxdis.2013.09.005

43.

R Core Development Team. (2013). R: A language and environment for statistical computing . Vienna, Austria: R Foundation for Statistical Computing.

44.

*Resick

P. A.

Galovski

T. A.

Uhlmansiek

M. O.

Scher

C. D.

Clum

G. A.

Young-Xu

. (2008). A randomized clinical trial to dismantle components of cognitive processing therapy for posttraumatic stress disorder in female victims of interpersonal violence. Journal of Consulting and Clinical Psychology, 76, 243–258. doi.10.1037/0022-006X.76.2.243

45.

*Resick

P. A.

Nishith

Weaver

Astin

Feuer

(2002). A comparison of cognitive-processing therapy with prolonged exposure and a waiting condition for the treatment of chronic posttraumatic stress disorder in female rape victims. Journal of Consulting and Clinical Psychology, 70, 867–879. doi:10.1037/0022-006X.70.4.867

46.

*Resick

Williams

Suvak

Monson

Gradus

(2012). Long-term outcomes of cognitive–behavioral treatments for posttraumatic stress disorder among female rape survivors. Journal of Consulting and Clinical Psychology, 80, 201–210. doi:10.1037/a0026602

47.

Rubin

Bellamy

(2012). Practitioner’s guide to using research for evidence-based practice (2nd ed.). Hoboken, NJ: Wiley.

48.

*Suris

Link-Malcolm

Chard

Ahn

North

(2013). A randomized clinical Trial of cognitive processing therapy for veterans with PTSD related to military sexual trauma. Journal of Traumatic Stress, 26, 28–37. doi:10.1002/jts.21765

49.

Taylor

J. G.

Baker

S. B.

(2007). Psychosocial and moral development of PTSD diagnosed combat veterans. Journal of Counseling and Development, 85, 364–369. doi:10.1002/j.1556-6678.2007.tb00485.x

50.

Tipton

(2013). Robust variance estimation in meta-regression with binary dependent effects. Research Synthesis Methods, 4, 169–187. doi:10.1002/jrsm.1070

51.

Tipton

(in press). Small sample adjustments for robust variance estimation with meta-regression. Psychological Methods.

52.

Valentine

Pigott

Rothstein

(2010). How many studies do you need?: A primer on statistical power for meta-analysis. Journal of Educational and Behavioral Statistics, 35, 215–247. doi:10.3102/1076998609346961

53.

Viechtbauer

(2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36, 1–48.

54.

Wampold

B. E.

Lichtenberg

W. E.

Waehler

(2002). Principles of empirically supported interventions in counseling psychology. The Counseling Psychologist, 30, 197–217.doi:10.1177/0011000002302001

55.

Weathers

F. W.

Litz

B. T.

Herman

D. S.

Huska

J. A.

Keane

T. M.

(1993, October). The PTSD Checklist (PCL): Reliability, validity, and diagnostic utility. Paper presented at the 9th Annual Conference of the ISTSS, San Antonio, TX.

56.

Weathers

F. W.

Litz

B. T.

Keane

T. M.

Palmieri

P. A.

Marx

B. P.

Schnurr

P. P.

(2013). The PTSD Checklist for DSM-5 (PCL-5). Retrieved from www.ptsd.va.gov

57.

Whiston

(2011). Meta-analysis: A systematic method for synthesizing counseling research. Journal of Counseling and Development, 89, 273–281. doi:10.1002/j.1556-6678.2011.tb00089.x

58.

Williams

R. T.

(2012). Using robust standard errors to combine multiple regression estimates with meta-analysis (Unpublished doctoral dissertation). Chicago, IL: Loyola University.