Considerable progress has been made in recent years towards implementing routine outcome measures within mental health services. However, the applicability of these tools for forensic-mental health populations has been questioned. A review and analysis was conducted to identify tools that could validly be applied in a forensic context, to provide a measure of functioning, recovery, risk, and placement pathways. Nineteen instruments were initially identified and evaluated against a hierarchy of criteria. While no tool assessed all domains of interest, six tools were ultimately considered to have potential utility as outcome measures for users of forensic mental health services.
Get full access to this article
View all access options for this article.
References
1.
AndresenR.CaputiP.OadesL. G. (2010). Do clinical outcome measures assess consumer-defined recovery?Psychiatry Research, 177, 309–317.
2.
AndrewsD. A.BontaJ. (1995). The Level of Service Inventory–Revised. Toronto, ON, Canada: Multi-Health Systems.
3.
AndrewsD. A.BontaJ. (1998). The Level of Service Inventory–Revised: Screening version. Toronto, ON, Canada: Multi-Health Systems.
4.
AndrewsD. A.BontaJ. (2006). The psychology of criminal conduct(4th ed.). Cincinnati, OH: Anderson Publishing Co.
5.
AndrewsD. A.BontaJ.WormithS. J. (2004). The Level of Service / Case Management Inventory. Toronto, ON, Canada: Multi-Health Systems.
6.
AndrewsG.PetersL.TeessonM. (1994). Measurement of consumer outcome in mental health: A report to the National Mental Health Information Strategy Committee. Sydney, Australia: Clinical Research Unit for Anxiety Disorders.
7.
Australian Mental Health Outcomes & Classification Network. (2005). Adult national outcomes and casemix collection standard reports. 1st edition, version 1.1. Brisbane, Queensland, Australia.
BeveridgeJ.PappsR.BowerA.SmithM. (2012). Mental health outcomes information collection protocol – HoNOS family (v2.1). Retrieved fromhttp://www.tepou.co.nz/download/asset/502
10.
BraithwaiteE., CharetteY.CrockerA. G.ReyesA. (2010). The predictive validity of clinical ratings of the Short-Term Assessment of Risk and Treatability (START). The International Journal of Forensic Mental Health, 9, 271–281.
11.
BrownP.PirkisJ. (2009). Mental health quality and outcome measurement and improvement in Australia. Current Opinion in Psychiatry, 22, 610–618.
12.
BullockW. A. (2005). The Mental Health Recovery Measure. In Campbell-OrdeT., ChamberlinJ., CarpenterJ., & LeffH. S. (Ed.), Measuring the promise of recovery: A compendium of recovery measures, Volume II (pp. 36–41). Cambridge, MA: The Evaluation Center.
13.
BullockW. A.O’RourkeM.FarrerE.BreedloveA.SmithM. K.ClaggettA. (2005). Evaluation of the Illness Management and Recovery (IMR) Program. Paper presented at the 113th annual meeting of the American Psychological Association Meeting, Washington, DC.
14.
BullockW. A.SageJ.HuppD.O’RourkeM.SmithM. K. (2009). From illness management and recovery (IMR) to wellness management and recovery (WMR): implementation and evaluation of Ohio's WMR program. New Research in Mental Health, 18, 312–321.
15.
BullockW. A.WuttkeG. H.KleinM.BechtoldtH.MartinJ. (2002). Promoting mental health recovery in an urban county jail. New Research in Mental Health, 15, 305–314.
16.
BullockW. A.YoungS. L. (2003). The Mental Health Recovery Measure (MHRM). Paper presented at the 111th annual meeting of the American Psychological Association Meeting, Toronto, Canada.
Campbell-OrdeT.ChamberlinJ.CarpenterJ.LeffH. S. (2005). Measuring the promise: a compendium of recovery measures. Cambridge, MA: Human Services Research Institute.
19.
CarrollA. (2008). Risk assessment and management in practice: the Forensicare Risk Assessment and Management Exercise. Australasian Psychiatry, 16, 412–417.
20.
ChambersJ. C.YiendJ.BarrettB.BurnsT.DollH.FazelS. (2009). Outcome measures used in forensic mental health research: a structured review. Criminal Behaviour and Mental Health, 19, 9–27.
21.
CoombsT.MeehanT. (2003). Mental health outcomes in Australia: issues for mental health nurses. International Journal of Mental Health Nursing, 12, 163–164.
22.
CorradoR. R.CohenI. M.HartS. D.RoeschR. (2000). Diagnosing mental disorders in offenders: conceptual and methodological issues. Criminal Behaviour and Mental Health, 10, 29–39.
23.
CrockerA. G.BraithwaiteE.LaferriereD.GagnonD. C., V.JenkinsT. (2011). START changing practice: implementing a risk assessment and management tool in a civil psychiatric setting. International Journal of Forensic Mental Health, 10, 13–28.
Department of Health and Ageing. (2003). Mental health national outcomes and casemix collection: technical specification of State and Territory reporting requirements for the outcomes and casemix components of ‘agreed data’, Version 1.50. Canberra, Australia: Commonwealth Department of Health and Ageing.
26.
Department of Human Services. (2008). Because mental health matters: a new focus for mental health and wellbeing in Victoria, consultation paper. Melbourne, Australia: Victorian Government Department of Human Services.
27.
DerogatisL. R. (1993). Brief Symptom Inventory (BSI): Administration, scoring and procedures manual(3rd ed.). Minneapolis, MN: NCS Pearson, Inc.
28.
DickensG., SugarmanP.PicchioniM.LongC. G. (2010). HoNOS-Secure: tracking risk and recovery for men in secure care. British Journal of Forensic Practice, 12(4), 36–46.
29.
DickensG.SugarmanP.WalkerL. (2007). HoNOS-secure: a reliable outcome measure for users of secure and forensic mental health services. Journal of Forensic Psychiatry & Psychology, 18, 507–514.
DouglasK. S.HartS. D.WebsterC. D.BelfrageH. (2013). HCR-20V3: Assessing risk of violence – User guide. Burnaby, Canada: Mental Health, Law, and Policy Institute, Simon Fraser University.
32.
DouglasK. S.ReevesK. (2009). The HCR-20 violence risk assessment scheme: overview and review of the research. In OttoR. & DouglasK. S. (Eds.), Handbook of violence risk assessment(pp. 147–185). Oxford, UK: Routledge/Taylor & Francis.
33.
DoyleM., LewisG.BrisbaneM. (2008). Implementing the Short-Term Assessment of Risk and Treatability in a forensic mental health service. Psychiatric Bulletin, 32, 406–408.
34.
DwyerS.DavorenM.AbidinZ.DoyleE.McDonnellK.KennedyH. G. (2011). The DUNDRUM Quartet: validation of structured professional judgement instruments DUNDRUM-3 assessment of programme completion and DUNDRUM-4 assessment of recovery in forensic mental health services. BMC Research Notes4, 1–12.
35.
EagarK.TrauerT.MellsopG. (2005). Performance of routine outcome measures in adult mental health care. Australian and New Zealand Journal of Psychiatry, 39, 713–718.
36.
EisenS. V.DillD. L.GrobM. C. (1994). Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation. Hospital and Community Psychiatry, 45, 242–247.
37.
EmmanuelM. K.CampbellM. H. (2009). Comparing staff and client perceptions of needs in a British single-sex medium secure unit. Psychological Reports, 104, 1033–1034.
38.
FergusonC. J.NegyC. (2006). Development and preliminary validation of a defendant and offender screening tool for psychopathology in inmate populations. Criminal Justice and Behavior, 33, 325–346.
39.
FitzpatrickR.ChambersJ.BurnsT.DollH.FazelS.JenkinsonC.KaurA.KnappM.SuttonL.YiendJ. (2010). A systematic review of outcome measures used in forensic mental health research with consensus panel opinion. Health Technology Assessment, 14.
40.
FlynnG., O’NeillC.KennedyH. G. (2011). DUNDRUM-2: Validation of a structured professional judgment Instrument assessing priority for admission from the waiting list for a Forensic Mental Health Hospital. BMC Research Notes, 4. Retrieved fromhttp://www.biomedcentral.com/1756-0500/4/230
41.
FlynnG.O’NeillC.McInerneyC.KennedyH. G. (2011). The DUNDRUM-1 structured professional judgement for triage to appropriate levels of therapeutic security: retrospective-cohort validation study. BMC Psychiatry, 11. Retrieved fromhttp://www.biomedcentral.com/1471-244X/11/43
42.
GarlandA.KruseM.AaronsG. (2003). Clinicians and Outcome measurement: what's the use?Journal of Behavioural & Health Services Research, 30, 393–405.
43.
GarnerB. R.KnightK.FlynnP. M.MoreyJ. T.SimpsonD. D. (2007). Measuring offender attributes and engagement in treatment using the Client Evaluation of Self and Treatment. Criminal Justice and Behavior, 34, 1113–1130.
44.
GreenwoodA.BurtG. (2001). Validity of the brief psychiatric rating scale within a forensic inpatient hospital. Expert evidence, 8, 15–30.
45.
HartS. D.KroppP. R.LawsD. R.KlaverJ.LoganC.WattK. A. (2003). The Risk for Sexual Violence Protocol (RSVP): structured professional guidelines for assessing risk of sexual violence. Vancouver, BC, Canada: The British Columbia Institute Against Family Violence.
46.
Health Research Council of New Zealand. (2003). Partnerships for evidence-based policy and practice. Auckland, New Zealand: Health Research Council of New Zealand.
47.
HopewellS.McDonaldS.ClarkeM.J.EggerM. (2007). Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database of Systematic Reviews.
48.
KayS. R.OplerL. AFiszbeinA. (2000). The Positive and Negative Syndrome Scale (PANSS) manual. Toronto, ON, Canada: Multi-Health Systems Inc.
49.
KesslerR. C.BarkerP. R.ColpeL. J.EpsteinJ. F.GfroererJ. C.HiripiE.HowesM.J.NormandS.-L.T.ManderscheidR.W.WaltersE.E.ZaslavskyA. M. (2003). Screening for serious mental illness in the general population. Archives of General Psychiatry, 60, 184–189.
50.
KennedyH. G.O’NeillC.FlynnG.GillP. (2010). Dangerousness understanding, recovery and urgency manual (the DUNDRUM quartet) v1.0.22. Dublin National Forensic Mental Health Service.
51.
KroppanE.NessetM. B.NonstadK.PedersenT. W.AlmvikR.PalmstiernaT. (2011). Implementation of the Short-Term Assessment of Risk and Treatability (START) in a forensic high secure unit. The International Journal of Forensic Mental Health, 10, 7–12.
52.
LeeseM., ThornicroftG.ShawJ.ThomasS.MohanR.HartyM. A.DolanM. (2006). Ethnic differences among patients in high-security psychiatric hospitals in England. The British Journal of Psychiatry, 188, 380–385.
53.
LongC. G.DickensG.SugarmanP.CraigL.MochtyU.HollinC. R. (2010). Tracking risk profiles and outcome in a medium secure service for women: use of the HoNOS-Secure. International Journal of Forensic Mental Health, 9, 215–225.
54.
LongC. G.WebsterP.WaineJ.MotalaJ.HollinC. R. (2008). Usefulness of the CANFOR-S for measuring needs among mentally disordered offenders resident in medium or low secure hospital services in the UK: a pilot evaluation. Criminal Behaviour and Mental Health, 18, 39–48.
55.
MarshallM.HoggL. I.GathD. H.LockwoodA. (1995). The Cardinal Needs Schedule - a modified version of the MRC Needs for Care Assessment Schedule. Psychological Medicine, 25, 605–617.
56.
McKayR.McDonaldR. (2008). Expensive detour or a way forward? The experience of routine outcome measurement in an aged care psychiatry service. Australasian Psychiatry, 16, 428–432.
57.
†MueserK. T.GingerichS.SalyersM. P.McGuireA. B.ReyesR. U.CunninghamH. (2004). The Illness Management and Recovery (IMR) scales (client and clinician versions). Concord, NH: Dartmouth Psychiatric Research Center.
58.
MullenP. E. (2006). Schizophrenia and violence: from correlations to preventive strategies. Advances in Psychiatric Treatment, 12, 239–248.
†NagiC.OstapiukE. B.CraigL. A.HackerD.BeechA. R. (2009). Using the revised Problem Identification Checklist to predict inpatient and community violence: a pilot study. British Journal of Forensic Practice, 11(3), 4–13.
National Mental Health Working Group. (2003). Mental health national outcomes and casemix collection: technical specification of state and territory reporting requirements for the outcomes and casemix components of ‘agreed data’, Version 1.50. Canberra, Australia: Commonwealth Department of Health and Ageing.
63.
NichollsT. L.BrinkJ.DesmariasS.WebsterC. D.MartinM.-L. (2006). The Short-Term Assessment of Risk and Treatability (START), a prospective validation study in a forensic sample. Assessment, 13, 313–327.
64.
NichollsT.L.ViljoenJ.CruiseK.DesmaraisS.L.WebsterC.D. (2010). Short-Term Assessment of Risk and Treatability: Adolescent Version (START:AV)(Abbreviated manual). Port Coquitlam, Canada: BC Mental Health and Addictions Services.
65.
NonstadK., NessetM. B.KroppanE.PedersenT. W.NøttestadJ.AlmvikR.PalmstiernaT. (2010). Predictive validity and other psychometric properties of the Short-Term Assessment of Risk and Treatability (START) in a Norwegian high secure hospital. The International Journal of Forensic Mental Health, 4, 294–299.
66.
OgloffJ.LemphersA.DwyerC. (2004). Dual diagnosis in an Australian forensic psychiatric hospital: prevalence and implications for services. Behavioral Sciences and the Law, 22, 543–562.
67.
OgloffJ. R. P.DavisM. R.RiversG.RossS. (2006). The identification of mental disorders in the criminal justice system. Canberra, Australia: Australian Institute of Criminology.
68.
Ohio Department of Mental Health. (2004). Procedural manual(6th ed.). Columbus, OH: Ohio Department of Mental Health.
69.
OsherF.ScottJ. E.SteadmanH. J.RobbinsP. C. (2004). Validating a brief jail mental health screen: Final report for National Institute of Justice. Washington, DC: National Institute of Justice.
70.
OstapiukE.StringerI.CraigL. (2000). Some modifications and revisions to the Problem Identification Checklist. Unpublished manuscript. Available from Forensic Psychology Practice Ltd, 98 Sheffield Road, Boldmere, Sutton and Coldfield, Birmingham, UK.
71.
OverallJ. E.GorhamD. R. (1962). The Brief Psychiatric Rating ScalePsychological Reports, 10, 799–812.
72.
PillayS. M.OliverB.ButlerL.KennedyH. G. (2008). Risk stratification and the care pathway. Irish Journal of Psychological Medicine, 25, 123–127.
73.
PirkisJ.BurgessP.CoombsT.ClarkeA.Jones-EllisD.DicksonR. (2005). Routine measurement of outcomes in Australia's public sector mental health services. Melbourne, Australia: The University of Melbourne.
74.
PirkisJ.BurgessP.KirkP.DodsonS.CoombsT. (2005). Review of standardised measures used in the National Outcomes and Casemix Collection (NOCC). Sydney, Australia: NSW Institute of Psychiatry.
75.
Private Mental Health Alliance. (2009). Annual statistical report from the PMHA's centralised data management service regarding the services provided by participating private hospitals with psychiatric beds and private psychiatric day hospitals: 1 July 2007 to 30 June 2008. Canberra, Australia: Strategic Planning Group for Private Psychiatric Services.
76.
Quality Network for Forensic Mental Health Services. (2009). Outcome and activity measures working group: Summary document. London, UK: Royal College of Psychiatrists.
77.
QuinseyV. L.HarrisG. T.RiceM. E.CormierC. (1998). Violent offenders: appraising and managing risk. Washington, DC: American Psychological Association.
78.
RomevaG. E.RubioL. G. G.GüerreS. O.MiravetM. J. R.CáceresA. G.ThomasS. D. M. (2010). Validación clínica de la escala Camberwell Assessment of Need-Forensic version, CANFOR para la evaluación de necesidades de personas con trastorno mental en el ámbito penitenciario. [Clinical validation of the CANFOR scale (Camberwell Assessment of Need-Forensic version) for the needs assessment of people with mental health problems in the forensic services]. Actas Españolas de Psiquiatría, 38, 129–137.
79.
RosenA.Hadzi-PavlovicD.ParkerG. (1989). The Life Skills Profile: A measure assessing function and disability in schizophrenia. Schizophrenia Bulletin, 15, 325–337.
80.
SalyersM. P.GodfreyJ. L.MueserK. T.LabriolaS. (2007). Measuring illness management outcomes: a psychometric study of clinician and consumer rating scales for illness self-management and recovery. Community Mental Health Journal, 43, 459–480.
81.
SegalA., DaffernM.ThomasS.FergusonM. (2010). Needs and risks of patients in a statewide inpatient forensic mental health population. International Journal of Mental Health Nursing, 19, 223–230.
82.
ShawJ. (2002). Needs assessment for mentally disordered offenders is different. The Journal of Forensic Psychiatry & Psychology, 13, 14–17.
83.
SimpsonD. D. (2005). TCU treatment assessment forms. Fort Worth, TX: Texas Christian University, Institute of Behavioral Research.
84.
SladeM. (2002). The use of patient-level outcomes to inform treatment. Epidemiologia e Psichiatria Sociale, 11, 20–27.
85.
SladeM.McCroneP.KuipersE.LeeseM.CahillS.ParabiaghiA.PriebeS.ThornicroftG. (2006). Use of standardised outcome measures in adult mental health services: randomised controlled trial. British Journal of Psychiatry, 189, 330–336.
86.
StedmanT.YellowleesP.MellsopG.ClarkeR.DrakeS. (1997). Measuring consumer outcomes in mental health: Field testing of selected measures of consumer outcome in mental health. Canberra, Australia: Department of Health and Family Services.
87.
SugarmanP.EverestH. (1999). An audit of five regional secure psychiatric services: South Thames NHS Multi-Authority Clinical Audit Group (available from the authors).
SugarmanP.WalkerL.DickensG. (2009). Managing outcome performance in mental health using HoNOS: experience at St Andrew's Healthcare. Psychiatric Bulletin, 33, 285–288.
90.
ThomasS.HartyM. A.ParrottJ.McCroneP.SladeM.ThornicroftG. (2003). The Forensic CAN (CANFOR). A needs assessment for forensic mental health service users. London, UK: Gaskell.
91.
ThomasS.McCroneP.FahyT. (2009). How do psychiatric patients on prison healthcare centres differ from inpatients in secure psychiatric inpatient units?Psychology, Crime & Law15, 729–742.
92.
ThomasS. D. M.SladeM.McCroneP.HartyM. A.ParrottJ.ThornicroftG.LeeseM. (2008). The reliability and validity of the forensic Camberwell Assessment of Need (CANFOR): a needs assessment for forensic mental health service users. International Journal of Methods in Psychiatric Research, 17, 111–120.
93.
†TimmermanI. G. H.VastenburgN. C.EmmelkampP. M. G. (2001). The Forensic Inpatient Observation Scale (FIOS): development, reliability and validity. Criminal Behaviour and Mental Health, 11, 144162.
94.
TrauerT. (2003). Analysis of outcome measurement data from the four Victorian ‘round one’ agencies. Retrieved from http://www.health.vic.gov.au/mentalhealth/outcomes/exec-summary.pdf
95.
TrauerT. (Ed.). (2010). Outcome measurement in mental health: theory and practice. Cambridge, UK: University Press.
96.
TurnerT.SalterM. (2008). Forensic psychiatry and general psychiatry: re-examining the relationship. Psychiatric Bulletin, 32, 2–6.
97.
VenturaJ.LukoffD.NuechterleinK. H.LibermanR. P.GreenM.ShanerA. (1993). Brief Psychiatric Rating Scale (BPRS): Expanded version 4.0 scales, anchor points, and administration manual. International Journal of Methods in Psychiatric Research, 3, 227–243.
98.
†VessJ. (2001). Development and implementation of a functional skills measure for forensic psychiatric inpatients. Journal of Forensic Psychiatry & Psychology, 12, 592–609.
WebsterC. D.DouglasK. S.EavesD.HartS. D. (1997). HCR-20: Assessing the risk for violence(Version 2). Vancouver, Canada: Simon Fraser University.
101.
WebsterC. D.MartinM. L.BrinkJ.NichollsT. L.DesmaraisS. (2009). Manual for the Short-Term Assessment of Risk and Treatability (START)(Version 1.1). Port Coquitlam, BC, Canada: Forensic Psychiatric Services Commission and St. Joseph's Healthcare.
102.
WebsterC. D.NichollsT.MartinM.-L.DesmaraisS. L.BrinkJ. (2006). Short-Term Assessment of Risk and Treatability (START): the case for a structured professional judgment scheme. Behavioral Sciences and the Law, 24, 747–766.
103.
WilsonC.DesmaraisS. L.NichollsT. L.BrinkJ. (2010). The role of client strengths in assessments of violence risk using the Short-Term Assessment of Risk and Treatability (START). The International Journal of Forensic Mental Health, 9(4), 282–293.
104.
WingJ. K.BeevorA. S.CurtisR. H.ParkS. B.HaddenS.BurnsA. (1998). Health of the Nation Outcome Scales (HoNOS). Research and development. British Journal of Psychiatry, 172, 11–18.
105.
WongS.GordonA. (1996). Violence Risk Scale – experimental version 1 (VRS). Saskatchewan, Canada: Regional Psychiatric Centre, Solicitor General of Canada.
106.
WoodsP.ReedV. (1999). The Behavioural Status Index (BSI): some preliminary reliability studies. International Journal of Psychiatric Nursing Research, 5, 554–561.
107.
YoungS. L.BullockW. A. (2003). The Mental Health Recovery Measure. Toledo, OH: University of Toledo, Department of Psychology.
