Risk assessment has come to be recognized as a key component of evidence-based practice and policy in psychiatric and correctional agencies. At the same time, however, there is significant debate in scientific, policy, and public arenas regarding the role of risk assessment instruments in mental health and criminal justice decision-making, and questions regarding the level of evidence supporting their usefulness. It is in light of these conflicting realities that the current commentary considers Williams, Wormith, Bonta, and Sitarenios' (2017) re-examination of the Singh, Grann, and Fazel (2011) meta-analysis and recommendations made in “The Use of Meta-Analysis to Compare and Select Offender Risk Instruments.” Additional limitations in the extant risk assessment research are identified and their implications for evidence-based practice and policy are discussed.
Get full access to this article
View all access options for this article.
References
1.
AbderhaldenC.Needhaml.DassenT.HalfensR.HaugH.FischerJ. E. (2008). Structured risk assessment and violence in acute psychiatric wards: Randomised controlled trial. British Journal Of Psychiatry, 193, 44–50. doi:10.1192/bjp.bp.107.045534
2.
American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
3.
BohlinI. (2012). Formalizing syntheses of medical knowledge: The rise of meta-analysis and systematic reviews. Perspectives on Science, 20, 273–309. doi:10.1162/POSC_a_00075
BuchananA.BinderR.NorkoM.SwartzM. (2012). Psychiatric violence risk assessment. American Journal of Psychiatry, 169, 340. [online supplement]
6.
CampbellM. A.FrenchS.GendreauP. (2009). The prediction of violence in adult offenders: A meta-analytic comparison of instruments and methods of assessment. Criminal Justice and Behavior, 36, 567–590. doi:10.1177/0093854809333610
7.
CaseyP. M.WarrenR. K.ElekJ. K. (2011). Using offender risk and needs assessment information at sentencing: Guidance for courts from a national working group. Williamsburg, VA: National Center for State Courts.
8.
CurranP. J.HussongA. M. (2009). Integrative data analysis: The simultaneous analysis of multiple data sets. Psychological Methods, 14, 81–100. doi:10.1037/a0015914
9.
DesmaraisS. L.JohnsonK. L.SinghJ. P. (2016). Performance of recidivism risk assessment instruments in U.S. correctional settings. Psychological Services, 13, 206–222. doi: 10.1037/ser0000075
10.
de Vries RobbéM.de VogelV.DouglasK. S.NijmanH. I. (2015). Changes in dynamic risk and protective factors for violence during inpatient forensic psychiatric treatment: Predicting reductions in postdischarge community recidivism. Law and Human Behavior, 39, 53–61. doi:10.1037/lhb0000089
11.
DouglasK. S.OttoR.DesmaraisS. L.BorumR. (2012). Clinical forensic psychology. In WeinerI. B.SchinkaJ. A.VelicerW. F. (Eds.), Handbook of Psychology, Volume2: Research Methods in Psychology (pp. 213–244). Hoboken, NJ: John Wiley & Sons.
12.
FazelS.SinghJ. P.DollH.GrannM. (2012). Use of risk assessment instruments to predict violence and antisocial behaviour in 73 samples involving 24,827 people: Systematic review and meta-analysis. British Medical Journal, 345, e4692. doi: http://dx.doi.org/10.1136/bmj.e4692
13.
HamiltonM. (2015). Risk-needs assessment: Constitutional and ethical challenges. American Criminal Law Review, 52, 231.
KhiroyaR.WeaverT.MadenT. (2009). Use and perceived utility of structured violence risk assessments in English medium secure forensic units. Psychiatric Bulletin, 33, 129–132. doi: 10.1192/pb.bp.108.020255
16.
KlingR. N.YassiA.SmailesE.LovatoC. Y.KoehoornM. (2011). Evaluation of a violence risk assessment system (the Alert System) for reducing violence in an acute hospital: A before and after study. International Journal of Nursing Studies, 48, 534–539. doi:10.1016/j.ijnurstu.2010.10.006
LevinS. K.NilsenP.BendtsenP.BulowP. (2015). Structured risk assessment instruments: A systematic review of implementation determinants. Psychiatry, Psychology and Law, 23, 602–628, doi: 10.1080/13218719.2015.1084661
19.
MonahanJ.SkeemJ. L. (2016). Risk assessment in criminal sentencing. Annual Review of Clinical Psychology, 12, 489–513. doi: 10.1146/annurev-clinpsy-021815-092945
20.
NeedhamI.AbderhaldenC.MeerR.DassenT.HaugH. J.HalfensR. G.FischerJ. E. (2004). The effectiveness of two interventions in the management of patient violence in acute mental inpatient settings: Report on a pilot study. Journal of Psychiatric and Mental Health Nursing, 11, 595–601. doi:10.1111/j.1365-2850.2004.00767.x
21.
NonstadK.WebsterC. D. (2011). How to fail in the implementation of a risk assessment scheme or any other new procedure in your organization. American Journal of Orthopsychiatry, 81, 94–99. doi:10.1111/j.1939-0025.2010.01076.x
22.
PenneyS. R.MarshallL. A.SimpsonA. F. (2016). The assessment of dynamic risk among forensic psychiatric patients transitioning to the community. Law and Human Behavior, 40, 374–386. doi:10.1037/lhb0000183
23.
RoychowdhuryA.AdsheadG. (2014). Violence risk assessment as a medical intervention: Ethical tensions. Psychiatric Bulletin, 38(2), 75–82. doi:10.1192/pb.bp.113.043315
24.
ScurichN.MonahanJ. (2016). Evidence-based sentencing: Public openness and opposition to using gender, age, and race as risk factors for recidivism. Law and Human Behavior, 40, 36–41. doi:10.1037/lhb0000161
25.
SinghJ. P.DesmaraisS. L.HurducasC.Arbach-LucioniK.CondemarinC.de RuiterC.… OttoR. K. (2014). International perspectives on the practical application of violence risk assessment: A global survey of 44 countries. International Journal of Forensic Mental Health, 13, 193–206. doi: 10.1080/14999013.2014.922141
26.
SinghJ. P.DesmaraisS. L.SellersB. G.HyltonT.TirottiM.Van DornR. A. (2014). From risk assessment to risk management: Matching interventions to adolescent offenders' strengths and vulnerabilities. Children and Youth Services Review, 47, 1–9. doi: 10.1016/j.childyouth.2013.09.015
27.
Singh, J. P., Grann, M., & Fazel, S. (2011). A comparative study of violence risk assessment tools: A systematic review and metaregression analysis of 68 studies involving 25,980 participants. Clinical Psychology Review, 31, 499-513. doi: 10.1016/j.cpr.2010.11.009
28.
SkeemJ. L.MonahanJ. (2011). Current directions in violence risk assessment. Current Directions in Psychological Science, 20, 38–42. doi:10.1177/0963721410397271
29.
StarrS. B. (2014). Evidence-based sentencing and the scientific rationalization of discrimination. Stanford Law Review, 66, 803–872.
30.
TroqueteN. C.van den BrinkR. S.BeintemaH.MulderT.van OsT. P.SchoeversR. A.WiersmaD. (2013). Risk assessment and shared care planning in out-patient forensic psychiatry: Cluster randomised controlled trial. British Journal of Psychiatry, 202, 365–371. doi:10.1192/bjp.bp.112.113043
31.
VälimäkiM.LanttaT.HätönenH. M.KontioR.ZhangS. (2016). Risk assessment for aggressive behaviour in schizophrenia. The Cochrane Library, 10. Art. No.: CD012397. doi: 10.1002/14651858.CD012397
32.
van de SandeR.NijmanH. I.NoorthoornE. O.WierdsmaA. I.HellendoornE.van der StaakC.MulderC. L. (2011). Aggression and seclusion on acute psychiatric wards: Effect of short-term risk assessment. British Journal Of Psychiatry, 199, 473–478. doi:10.1192/bjp.bp.111.095141
33.
Van DornR. A.DesmaraisS. L.PetrilaJ.SinghJ. P.HaynesD. (2013). Effects of outpatient treatment on risk of arrest of adults with serious mental illness and associated costs. Psychiatric Services, 64, 856–862. doi: 10.1176/appi.ps.201200406
34.
Van DornR. A.GrimmK. J.DesmaraisS. L.TuellerS. J.JohnsonK. L.SwartzM. S. (2016). Leading indicators of community-based violent events among adults with mental illness. Psychological Medicine. Advance online publication. doi: 10.1017/S0033291716003160
35.
Van ElkM.MatzkeD.GronauQ. F.GuanM.VandekerckhoveJ.WagenmakersE. J. (2015). Meta-analyses are no substitute for registered replications: A skeptical perspective on religious priming. Frontiers in Psychology, 6, 1365. doi: 10.3389/fpsyg.2015.01365
36.
VieiraT. A.SkillingT. A.Peterson-BadaliM. (2009). Matching court-ordered services with treatment needs predicting treatment success with young offenders. Criminal Justice and Behavior, 36(4), 385–401. doi: 10.1177/0093854808331249
37.
ViljoenJ. L.McLachlanK.VincentG. M. (2010). Assessing violence risk and psychopathy in juvenile and adult offenders: A survey of clinical practices. Assessment, 17, 377–395. doi:10.1177/1073191109359587
38.
ViljoenJ.NichollsT. L.CruiseK.DesmaraisS. L.WebsterC. D. (2014). Short-Term Assessment of Risk and Treatability: Adolescent Version (START: AV). Burnaby, Canada: Mental Health, Law & Policy Institute, Simon Fraser University.
39.
Vincent, G. M., Guy, L. S., Perrault, R. T., & Gershenson, B. (2016). Risk assessment matters, but only when implemented well: A multisite study in juvenile probation. Law and Human Behavior, 40, 683-696. doi:10.1037/lhb0000214
40.
VincentG. M.GuyL. S.GershensonB. G.McCabeP. (2012). Does risk assessment make a difference? Results of implementing the SAVRY in juvenile probation. Behavioral Sciences & the Law, 30, 384–405. doi:10.1002/bsl.2014
41.
VincentG. M.Paiva-SalisburyM. L.CookN. E.GuyL. S.PerraultR. T. (2012). Impact of risk/needs assessment on juvenile probation officers' decision making: Importance of implementation. Psychology, Public Policy, And Law, 18, 549–576. doi:10.1037/a0027186
42.
WandT.LargeM. (2013). Little evidence for the usefulness of violence risk assessment. British Journal of Psychiatry, 202, 468. doi:10.1192/bjp.202.6.468
43.
WebsterC. D.MartinM. L.BrinkJ.NichollsT. L.DesmaraisS. L. (2009). Manual for the Short-Term Assessment of Risk and Treatability (START) (Version 1.1). Coquitlam, Canada: British Columbia Mental Health & Addiction Services.
44.
WilliamsK.WormithS.BontaJ.SitareniosG. (2017). The use of meta-analysis to compare and select offender risk instruments: A commentary on Singh, Grann, and Fazel (2011). International Journal of Forensic Mental Health, 17.
45.
WilsonC. M.DesmaraisS. L.NichollsT. L.HartS. D.BrinkJ. (2013). Predictive validity of dynamic factors: Assessing violence risk in forensic psychiatric inpatients. Law and Human Behavior, 37, 377–388. doi: 10.1037/lhb0000025
46.
YangM.WongS. P.CoidJ. (2010). The efficacy of violence prediction: A meta-analytic comparison of nine risk assessment tools. Psychological Bulletin, 136, 740–767. doi:10.1037/a0020473
