Treatment Evaluation in Forensic Psychiatry. Which One Should Be Used: The Clinical Judgment or the Instrument-based Assessment of Change?

Abstract

In forensic psychiatry, it is common practice to use an unstructured clinical judgment for treatment evaluation. From risk assessment studies, it is known that the unstructured clinical judgment is unreliable and the use of instruments is recommended. This paper aims to explore the clinical judgment of change compared to the calculated change using the Instrument for Forensic Treatment Evaluation (IFTE) in relation to changes in inpatient violence This study shows that the clinical judgment is much more positive about patient’s behavioral changes than the calculated change. And that the calculated change is more in accordance with the change in the occurrence of inpatient violence, suggesting that the calculated change reflects reality closer than the unstructured clinical judgment. Therefore, it is advisable to use the IFTE as a base to make a structured professional judgment of the treatment evaluation of a forensic psychiatric patient.

Keywords

IFTE clinical judgment calculated change forensic treatment evaluation inpatient violence

Get full access to this article

View all access options for this article.

References

Ǣgisdóttir

White

M. J.

Spengler

P. M.

Maugherman

A. S.

Anderson

L. A.

Cook

R. S.

Nichols

C. N.

Lampropoulos

G. K.

Walker

B. S.

Cohen

Rush

J. D.

(2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist, 34(3), 341–382. https://doi.org/10.1177/0011000005285875

American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Author.

Andrews

D. A.

Bonta

(2010). Rehabilitating criminal justice policy and practice. Psychology, Public Policy, and Law, 16(1), 39–55. https://doi.org/10.1037/a0018362

Andrews

D. A.

Bonta

Hoge

R. D.

(1990). Classification for effective rehabilitation: Rediscovering psychology. Criminal Justice and Behavior, 17(1), 19–52. https://doi.org/10.1177/0093854890017001004

Andrews

D. A.

Bonta

Wormith

J. S.

(2006). The recent past and near future of risk and/or need assessment. Crime & Delinquency, 52(1), 7–27. https://doi.org/10.1177/0011128705281756

Baird

Stocks

(2013). Risk assessment and management: Forensic methods, human results. Advances in Psychiatric Treatment, 19(5), 358–365. https://doi.org/10.1192/apt.bp.111.009407

Belfrage

Douglas

K. S.

(2002). Treatment effects on forensic psychiatric patients measured with the HCR-20 violence risk assessment scheme. International Journal of Forensic Mental Health, 1(1), 25–36. https://doi.org/10.1080/14999013.2002.10471158

Bell

Mellor

(2009). Clinical judgments: Research and Practice. Australian Psychologist, 44(2), 112–121. https://doi.org/10.1080/00050060802550023

Bonta

Andrews

D. A.

(2007). Risk-need-responsivity model for offender assessment and rehabilitation. Public Safety Canada.

10.

Bonta

Rugge

Scott

T-L

Bourgon

Yessine

A. K.

(2008). Exploring the black box of community supervision. Journal of Offender Rehabilitation, 47(3), 248–270. https://doi.org/10.1080/10509670802134085

11.

Bosker

Witteman

Hermanns

(2013). Agreement about intervention plans by probation officers. Criminal Justice and Behavior, 40(5), 569–581. https://doi.org/10.1177/0093854812464220

12.

Chin-Yee

Upshur

(2018). Clinical judgment in the era of big data and predictive analytics. Journal of Evaluation in Clinical Practice, 24(3), 638–645. https://doi.org/10.1111/jep.12852

13.

Cooper

B. S.

Griesel

Yuille

J. C.

(2008). Clinical-forensic risk assessment: The past and current state of affairs. Journal of Forensic Psychology Practice, 7(4), 1–63. https://doi.org/10.1300/J158v07n04_01

14.

Dack

Ross

Papadopoulos

Stewart

Bowers

(2013). A review and meta-analysis of the patient factors associated with psychiatric in-patient aggression. Acta Psychiatrica Scandinavica, 127(4), 255–268. https://doi.org/10.1111/acps.12053

15.

Daffern

Jones

Howels

Shine

Mikton

Tunbridge

(2007). Editorial refining the definition of offence paralleling behavior. Criminal Behaviour and Mental Health, 17(5), 265–273. https://doi.org/10.1002/cbm.671

16.

Dawes

R. M.

Faust

Meehl

P. E.

(1989). Clinical versus actuarial judgment. Science, 243(4899), 1668–1674.

17.

Day

M. D.

Wilson

H. A.

Bodwin

Monson

C. M.

(2017). Change in Level of Service Inventory-Ontario Revised (LSI-OR) risk scores over time: An examination of overall growth curves and subscale-dependent growth curves. International Journal of Offender Therapy and Comparative Criminology, 61(14), 1606–1622. https://doi.org/10.1177/0306624X15623016

18.

Douglas

K. S.

Skeem

J. L.

(2005). Violence risk assessment: Getting specific about being dynamic. Psychology, Public Policy, and Law, 11(3), 347–383. https://doi.org/10.1037/1076-8971.11.3.347

19.

Duwe

Kim

(2018). The neglected “R” in the risk-needs-responsivity model: A new approach for assessing responsivity to correctional interventions. Justice Evaluation Journal, 1(2), 130–150. https://doi.org/10.1080/24751979.2018.1502622

20.

Gower

J. C.

Legendre

(1986). Metric and Euclidean properties of dissimilarity coefficients. Journal of Classification, 3, 5–48. https://doi.org/10.1007/BF01896809

21.

Grove

W. M.

Zald

D. H.

Lebow

B. S.

Snitz

B. E.

Nelson

(2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12(1), 19–30. https://doi.org/10.1037//1040-3590.12.1.19

22.

Hannan

Lamberts

M. J.

Harmon

Nielsen

S. L.

Smart

D. W.

Shimokawa

Sutton

S. W.

(2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61(2), 155–163. https://doi.org/10.1002/jclp.20108

23.

Hansen

N. B.

Labert

M. J.

Forman

E. M.

(2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology Science Practice, 9(3), 329–343. https://doi.org/10.1093/clipsy.9.3.329

24.

Harris

G. T.

Rice

M. E.

(2007). Characterizing the value of actuarial violence risk assessments. Criminal Justice and Behavior, 34(12), 1638–1658. https://doi.org/10.1177/0093854807307029

25.

Jacobson

N. S.

Truax

(1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19. https://doi.org/10.1037/0022-006X.59.1.12

26.

Jeandarme

Wittouck

Vander Laenen

Pouls

Oei

T. I.

Bogaerts

(2019). Risk factors associated with inpatient violence during medium security treatment. Journal of Interpersonal Violence, 34(17), 3711–3736. https://doi.org/10.1177/0886260516670884

27.

Lilienfeld

S. O.

Ritschel

L. A.

Lynn

S. J.

Cautin

R. L.

Latzman

R. D.

(2013). Why many clinical psychologists are resistant to evidence-based practice: Root causes and constructive remedies. Clinical Psychology Review, 33(7), 883–900. https://doi.org/10.1016/j.cpr.2012.09.008

28.

Lilienfeld

S. O.

Ritschel

L. A.

Lynn

S. J.

Cautin

R. L.

Latzman

R. D.

(2014). Why ineffective psychotherapies appear to work: A taxonomy of causes of spurious therapeutic effectiveness. Perspectives on Psychological Science, 9(4), 355–387. https://doi.org/10.1177/1745691614535216

29.

Lockhart

J. J.

Satya-Murti

(2017). Diagnosing crime and diagnosing disease: Bias reduction strategies in the forensic and clinical sciences. Journal of Forensic Sciences, 62(6), 1534–1541. https://doi.org/10.1111/1556-4029.13453

30.

Miller

D. J.

Spengler

E. S.

Spengler

P. M.

(2015). A meta-analysis of confidence and judgment accuracy in clinical decision making. Journal of Counseling Psychology, 62(4), 553–567. https://doi.org/10.1037/cou0000105

31.

Nagtegaal

M. H.

van der Horst

R. P.

Schonberger

H. J. M.

(2011). Inzicht in de verblijfsduur van tbs-gestelden. [Insight in duration of tbs-order persons]. Boom Juridische uitgevers.

32.

Olver

M. E.

Wong

S. C. P.

(2011). A comparison of static and dynamic assessment of sexual offender risk and need in a treatment context. Criminal Justice and Behavior, 38(2), 113–126. https://doi.org/10.1177/0093854810389534

33.

Papalia

Spivak

Daffern

Ogloff

J. R. P.

(2019). A meta-analytic review of the efficacy of psychological treatments for violent offenders in correctional and forensic mental health settings. Clinical Psychology, Science and Practice, 26(2), 1–28. https://doi.org/10.1111/cpsp.12282

34.

Polaschek

D. L. L.

(2012). An appraisal of the risk-need-responsivity (RNR) model of offender rehabilitation and its application in correctional treatment. Legal and Criminological Psychology, 17(1), 1–17. https://doi.org/10.1016/j.brat.2008.10.018

35.

Schuringa

Heininga

V. E.

Spreen

Bogaerts

(2016). Concurrent and predictive validity of the Instrument for Forensic Treatment Evaluation. International Journal of Offender Therapy and Comparative Criminology, 62(5), 1281–1299. https://doi.org/10.1177/0306624X16676100

36.

Schuringa

Spreen

Bogaerts

(2014). Inter-rater and test-retest reliability, internal consistency, and factorial structure of the Instrument for Forensic Treatment Evaluation. Journal of Forensic Psychology Practice, 14(2), 127–144. https://doi.org/10.1080/15228932.2014.897536

37.

Schuringa

Spreen

Bogaerts

(2018). Voorspellen van intramuraal geweld op korte termijn met het Instrument voor Forensische Behandel Evaluatie (IFBE), ROM-instrument in de tbs voor verschillende doelgroepen. [Predicting short term inpatient violence with the Instrument for Forensic Treatment Evaluation (IFTE), ROM-instrument in the tbs for different target groups.]. Tijdschrift voor Psychiatrie, 60(10), 662–671.

38.

Schuringa

Spreen

Bogaerts

(2019). Inpatient violence in forensic psychiatry: Does change in dynamic risk indicators of the IFTE help predict short term inpatient violence? International Journal of Law and Psychiatry, 66, 1–7. https://doi.org/10.1016/j.ijlp.2019.05.002

39.

Serin

R. C.

Lloyd

C. D.

Helmus

Derkzen

D. M.

Luong

(2013) Does intra-individual change predict offender recidivism? Searching for the holy grail in assessing offender change. Aggression and Violent Behavior, 18(1), 32–53. https://doi.org/10.1016/j.avb.2012.09.002

40.

Skeem

J. L.

Steadman

H. J.

Manchak

S. M.

(2015). Applicability of the Risk-Need-Responsivity model to persons with mental illness involved in the criminal justice system. Psychiatric Services, 66(9), 916–922. https://doi.org/10.1176/appi.ps.201400448

41.

Spengler

P. M.

White

M. J.

Ǣgisdóttir

Maugherman

A. S.

Anderson

L. A.

Cook

R. S.

Nichols

C. N.

Lampropoulos

G. K.

Walker

B. S.

Cohen

G. R.

Rush

J. D.

(2009). The meta-analysis of clinical judgment project. Effects of experience on judgment accuracy. The Counseling Psychologist, 37(3), 350–399. https://doi.org/10.1177/0011000006295149

42.

Spreen

Brand

ter Horst

Bogaerts

(2014). Handleiding HKT-R. [Manual of the HKT-R]. Stichting FPC Dr. S. van Mesdag.

43.

Spreen

Timmerman

M.E.

ter Horst

Schuringa

(2010). Formalizing clinical decisions in individual treatments: Some first steps. Journal of Forensic Psychology Practice, 10, 285–299. https://doi.org/10.1080/15228932.2010.481233

44.

Tasma

Liemburg

E. J.

Knegtering

Delespaul

P. A. E. G.

Boonstra

Castelein

(2017). Exploring the use of Routine Outcome Monitoring in the treatment of patients with a psychotic disorder. European Psychiatry, 42, 89–94. https://doi.org/10.1016/j.eurpsy.2016.12.008

45.

Troquete

N. A. C.

Van den Brink

R. H. S.

Beintema

Mulder

van Os

T. W. D. P.

Schoevers

R. A.

Wiersma

(2013). Risk assessment and shared care planning in out-patient forensic psychiatry: Cluster randomised controlled trial. British Journal of Psychiatry, 202(5), 365–371. https://doi.org/10.1192/bjp.bp.112.113043

46.

van der Veeken

F. C. A.

Lucieer

Bogaerts

. (2016). Routine outcome monitoring and clinical decision-making in forensic psychiatry based on the Instrument for Forensic Treatment Evaluation. PLoS One, 11(8), e0160787. https://doi.org/10.1371/journal.pone.0160787

47.

van der Veeken

F. C. A.

Lucieer

Bogaerts

. (2018). Forensic psychiatric treatment evaluation: The clinical evaluation of treatment progress with repeated forensic routine outcome monitoring measures. International Journal of Law and Psychiatry, 57, 9–16. https://doi.org/10.1016/j.ijlp.2017.12.002

48.

van Marle

H. J. C

. (2002). The Dutch Entrustment Act (TBS): Its principles and innovations. International Journal of Forensic Mental Health, 1(1), 83–92. https://doi.org/10.1080/14999013.2002.10471163

49.

Vess

(2001). Development and implementation of a functional skills measure for forensic psychiatric inpatients. Journal of Forensic Psychiatry, 12(3), 592–609. https://doi.org/10.1080/09585180110092001

50.

Waller

(2009). Evidence-based treatment and therapist drift. Behaviour Research and Therapy, 47(2), 119–127. https://doi.org/10.1016/j.brat.2008.10.018

51.

Waller

Turner

(2016). Therapist drift redux: Why well-meaning clinicians fail to deliver evidence-based therapy, and how to get back on track. Behaviour Research and Therapy, 77, 129–137. https://doi.org/10.1016/j.brat.2015.12.005

52.

Wilson

C. M.

Desmarais

S. L.

Nicholls

T. L.

Hart

S. D.

Brink

(2013). Predictive validity of dynamic factors: Assessing violence risk in forensic psychiatric inpatients. Law and Human Behavior, 37(6), 377–388. https://doi.org/10.1037lhb0000025

53.

Zimmerman

McGlinchey

J. B.

(2008). Why don’t psychiatrists use scales to measure outcome when treating depressed patients? Journal of Clinical Psychiatry, 69(12), 1916–1919. https://doi.org/10.4088/jcp.v69n1209