Bridging Risk Assessments to Case Planning: Development and Evaluation of an Intervention-Planning Tool for Adolescents on Probation

Abstract

Even though risk assessment tools are often intended to inform case planning, they do not provide much direct guidance. As such, we developed an intervention-planning tool called the Adolescent Risk Reduction and Resilient Outcomes Work-Plan (ARROW) to accompany the Structured Assessment of Violence Risk in Youth. The ARROW includes a decision support system, guide, and training, and is one of the first tools of its kind. To evaluate the ARROW, we conducted two studies: (a) a vignette study with 178 professionals and (b) a field study with 320 propensity-score matched adolescents. Most professionals (>98%) rated the ARROW as useful. Moreover, compared with (a) unstructured plans and (b) a simple form, ARROW plans were more likely to include supported interventions, adhere to best practices, and integrate culturally tailored approaches for Indigenous adolescents. Formulations also showed improvements. However, further research is needed on strategies to bridge risk assessment and risk management.

Keywords

risk management risk assessment case management formulation SAVRY culture Indigenous

Get full access to this article

View all access options for this article.

References

Alexander

J. F.

Waldron

H. B.

Robbins

M. S.

Neeb

A. A.

(2013). Functional family therapy for adolescent behavior problems. Washington, DC: American Psychological Association.

American Psychological Association. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271-285. doi:10.1037/0003-066X.61.4.271

American Psychological Association. (2017). Ethical principles of psychologists and code of conduct (2002, Amended August 3, 2016, Adopted January 1, 2017). Retrieved from https://www.apa.org/ethics/code/ethics-code-2017.pdf

Austin

P. C.

(2011). A tutorial and case study in propensity score analysis: An application to estimating the effect of in-hospital smoking cessation counseling on morality. Multivariate Behavioral Research, 46, 119-151. doi:10.1080/00273171.2011.540480

Bauer

M. S.

Damschroder

Hagedorn

Smith

Kilbourne

A. M.

(2015). An introduction to implementation science for the non-specialist. BMC Psychology, 3, Article 32. doi:10.1186/s40359-015-0089-9

Beidas

R. S.

Cross

Dorsey

(2014). Show me, don’t tell me: Behavioral rehearsal as a training and analogue fidelity tool. Cognitive and Behavioral Practice, 21, 1-11. doi:10.1016/j.cbpra.2013.04.002

Bonta

Andrews

D. A.

(2017). The psychology of criminal conduct (6th ed.). New York: Routledge.

Bonta

Bourgon

Rugge

Scott

T. L.

Yessine

A. K.

Gutierrez

(2011). An experimental demonstration of training probation officers in evidence-based community supervision. Criminal Justice and Behavior, 38, 1127-1148. doi:10.1177/0093854811420678

Bonta

Rugge

Scott

Bourgon

Yessine

(2008). Exploring the black box of community supervision. Journal of Offender Rehabilitation, 47, 248-270. doi:10.1080/10509670802134085

10.

Borum

Bartel

Forth

(2006). Manual for the Structured Assessment for Violence Risk in Youth (SAVRY). Odessa, FL: Psychological Assessment Resources.

11.

Bosker

Witteman

(2016). Finding the right focus: Improving the link between risk/needs assessment and case management in probation. Psychology, Public Policy, and Law, 22, 221-233. doi:10.1037/law0000075

12.

Bosker

Witteman

Hermanns

(2013). Do intervention plans meet criteria for effective practice to reduce recidivism? How probation officers forget about social capital and basic needs. European Journal of Probation, 5, 65-85. doi:10.1177/206622031300500105

13.

Bosker

Witteman

Hermanns

Heij

(2015). Improving agreement about intervention plans in probation by decision support. International Journal of Offender Therapy and Comparative Criminology, 59, 1459-1473. doi:10.1177/0306624X14539127

14.

Bourgon

Gutierrez

Aston

(2012). The evolution of community supervision practice: The transformation from case manager to change agent. Federal Probation, 76, 27-35.

15.

Brown

Völlm

(2013). Case formulation in personality disordered offenders: Views from the front line. Criminal Behaviour and Mental Health, 23, 263-273. doi:10.1002/cbm.1887

16.

Canadian Psychological Association. (2017). Canadian code of ethics for psychologists (4th ed.). Ottawa, Ontario, Canada: Author.

17.

Chadwick

DeWolf

Serin

(2015). Effectively training community supervision officers: A meta-analytic review of the impact on offender outcome. Criminal Justice and Behavior, 42, 977-989. doi:10.1177/0093854815595661

18.

Cicchetti

D. V.

(1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284-290. doi:10.1037/1040-3590.6.4.284

19.

Cohen

(1988). Statistical power analysis for the behavioural sciences. Hillside, NJ: Lawrence Erlbaum.

20.

Douglas

K. S.

Hart

S. D.

Webster

C. D.

Belfrage

(2013). HCR-20 (version 3): Assessing risk for violence. Burnaby, British Columbia, Canada: Mental Health, Law, and Policy Institute, Simon Fraser University.

21.

Douglas

K. S.

Webster

C. D.

Hart

S. D.

Eaves

Ogloff

J. R. P.

(Eds.). (2001). HCR-20: Violence risk management companion guide. Burnaby, British Columbia, Canada: Mental Health, Law, and Policy Institute, Simon Fraser University.

22.

Dudley

Park

James

Dodgson

(2010). Rate of agreement between clinicians on the content of a cognitive formulation of delusional beliefs: The effect of qualifications and experience. Behavioural and Cognitive Psychotherapy, 38, 185-200. doi:10.1017/S1352465809990658

23.

Dyck

H. L.

(2016). An empirical evaluation of the RCMP’s youth intervention and diversion strategy in New Brunswick (Unpublished doctoral dissertation). University of New Brunswick, Fredericton, New Brunswick, Canada.

24.

Eccles

M. P.

Armstrong

Baker

Cleary

Davies

. . . Sibbald

(2009). An implementation research agenda. Implementation Science, 4, 18-25. doi:10.1186/1748-5908-4-18

25.

Fixsen

D. L.

Blase

K. A.

Naoom

S. F.

Wallace

(2009). Core implementation components. Research on Social Work Practice, 19, 531-540. doi:10.1177/1049731509335549

26.

Fixsen

D. L.

Naoom

S. F.

Blasé

K. A.

Friedman

R. M.

Wallace

(2005). Implementation research: A synthesis of the literature (FMHI Publication #231). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. Retrieved from http://fpg.unc.edu/sites/fpg.unc.edu/files/resources/reports-and-policy-briefs/NIRN-MonographFull-01-2005.pdf

27.

Giguère

Légaré

Grimshaw

Turcotte

Fiander

Grudniewicz

. . . Gagnon

(2012). Printed educational materials: Effects on professional practice and healthcare outcomes. The Cochrane Database of Systematic Reviews, 10, CD004398. doi:10.1002/14651858.CD004398.pub3

28.

Hannah-Moffat

Maurutto

(2003). Youth risk/need assessment: An overview of issues and practices. Ottawa, Ontario, Canada: Department of Justice Canada.

29.

Harris

P. M.

Gingerich

Whittaker

T. A.

(2004). The “effectiveness” of differential supervision. Crime & Delinquency, 50, 235-271. doi:10.1177/0011128703258939

30.

Hart

Sturmey

Logan

McMurran

(2011). Forensic case formulation. International Journal of Forensic Mental Health, 10, 118-126. doi:10.1080/14999013.2011.577137

31.

Hart

S. D.

Kropp

P. R.

Laws

D. R.

Klaver

Logan

Watt

K. A.

(2003). The Risk for Sexual Violence Protocol (RSVP): Structured professional guidelines for assessing risk of sexual violence. Burnaby, British Columbia, Canada: Mental Health, Law, and Policy Institute, Simon Fraser University; Pacific Psychological Assessment Corporation; and the British Columbia Institute Against Family Violence.

32.

Henggeler

S. W.

Schoenwald

S. K.

(2011). Evidence-based interventions for juvenile offenders and juvenile justice policies that support them. Social Policy Report, 25, 1-28. doi:10.1108/JACPR-01-2015-0155

33.

Holloway

E. D.

(2015). Risk assessment and case planning by juvenile probation officers: The role of trauma (M.A., Fordham University). ProQuest Dissertations and Theses. Retrieved from http://search.proquest.com.proxy.lib.sfu.ca/docview/1733682593?accountid=13800

34.

Hunt

D. L.

Haynes

Hanna

S. E.

Smith

(1998). Effects of computer-based clinical decision support systems on physician performance and patient outcomes. Journal of the American Medical Association, 280, 1339-1346. doi:10.1001/jama.280.15.1339

35.

IBM Corporation. (2013). IBM SPSS statistics for Windows, version 22.0. Armonk, NY: Author.

36.

Kirkness

Barnhardt

(2001). First Nations and higher education: The four R’s—Respect, relevance, reciprocity, responsibility. In Hayoe

Pan

(Eds.), Knowledge across cultures: A contribution to dialogue among civilizations (pp. 1-17). Pok Fu Lam, Hong Kong: Comparative Education Research Centre, The University of Hong Kong.

37.

Landenberger

N. A.

Lipsey

M. W.

(2005). The positive effects of cognitive–behavioral programs for offenders: A meta-analysis of factors associated with effective treatment. Journal of Experimental Criminology, 1, 451-476. doi:10.1007/s11292-005-3541-7

38.

Lipsey

M. W.

(2009). The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview. Victims & Offenders, 4, 124-147. doi:10.1080/15564880802612573

39.

Luong

Wormith

(2011). Applying risk/need assessment to probation practice and its impact on the recidivism of young offenders. Criminal Justice and Behavior, 38, 1177-1199. doi:10.1177/0093854811421596

40.

Maar

M. A.

Lightfoot

N. E.

Sutherland

M. E.

Strasser

R. P.

Wilson

K. J.

Lidstone-Jones

C. M.

. . . Lesage

M. T.

(2011). Thinking outside the box: Aboriginal people’s suggestions for conducting health studies with Aboriginal communities. Public Health, 125, 747-753. doi:10.1016/j.puhe.2011.08.006

41.

Mahoney

J. L.

Stattin

(2000). Leisure activities and adolescent antisocial behavior: The role of structure and social context. Journal of Adolescence, 23, 113-127. doi:10.1006/jado.2000.0302

42.

McCart

M. R.

Sheidow

A. J.

(2016). Evidence-based psychosocial treatments for adolescents with disruptive behavior. Journal of Clinical Child & Adolescent Psychology, 45, 529-563.

43.

McCaslin

W. D.

Boyer

(2009). First Nations communities at risk and in crisis: Justice and security. Journal of Aboriginal Health, 5, 61-87. doi:10.3138/ijih.v5i2.28983

44.

McGraw

K. O.

Wong

S. P.

(1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46. doi:10.1037/1082-989x.1.1.30

45.

McMurran

(2009). Motivational interviewing with offenders: A systematic review. Legal and Criminological Psychology, 14, 83-100. doi:10.1348/135532508X278326

46.

Michie

van Stralen

M. M.

West

(2011). The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implementation Science, 6, 1-11. doi:10.1186/1748-5908-6-42

47.

Moja

Kwag

K. H.

Lytras

Bertizzolo

Brandt

Pecoraro

. . . Bonovas

(2014). Effectiveness of computerized decision support systems linked to electronic health records: A systematic review and meta-analysis. American Journal of Public Health, 104, e12-e22. doi:10.2105/AJPH.2014.302164

48.

Monchalin

(2016). The colonial problem: An Indigenous perspective on crime and injustice in Canada. Toronto, Ontario, Canada: University of Toronto Press.

49.

Nelson

R. J.

Vincent

G. M.

(2018). Matching services to criminogenic needs following comprehensive risk assessment implementation in juvenile probation. Criminal Justice and Behavior, 45, 1136-1153. doi:10.1177/0093854818780923

50.

Parsons

L. S.

(2004, May). Performing a 1: N case-control match on propensity score. Paper presented at the Proceedings of the 29th Annual SAS Users Group International Conference (pp. 165-229). SAS Institute, Cary, NC.

51.

Peterson-Badali

Skilling

Haqanee

(2015). Examining implementation of risk assessment in case management for youth in the justice system. Criminal Justice and Behavior, 42, 304-320. doi:10.1177/0093854814549595

52.

Proctor

Silmere

Raghavan

Hovmand

Aarons

Bunger

. . . Hensley

(2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65-76. doi:10.1007/s10488-010-0319-7

53.

Roberts

J. V.

Reid

A. A.

(2017). Aboriginal incarceration in Canada since 1978: Every picture tells the same story. Canadian Journal of Criminology and Criminal Justice, 59, 313-345. doi:10.3138/cjccj.2016.E24

54.

Rogers

Viljoen

J. L.

(2012). Risk needs assessment and management with Aboriginal youth in BC: Aboriginal consultation. Internal report prepared for Ministry of Children and Family Development.

55.

Rosenbaum

P. R.

Rubin

D. B.

(1983). The central role of propensity score in observational studies for causal effects. Biometrika, 70, 41-55. doi:10.1093/biomet/70.1.41

56.

SAS Institute Inc. (2012). SAS 12.1 [Computer software]. Cary, NC: Author.

57.

Shepherd

S. M.

Ilalio

(2016). Maori and Pacific Islander overrepresentation in the Australian criminal justice system: What are the determinants? Journal of Offender Rehabilitation, 55, 113-128. doi:10.1080/10509674.2015.1124959

58.

Singh

J. P.

Desmarais

S. L.

Sellers

B. G.

Hylton

Tirotti

Van Dorn

R. A.

(2014). From risk assessment to risk management: Matching interventions to adolescent offenders’ strengths and vulnerabilities. Children and Youth Services Review, 47, 1-9. doi:10.1016/j.childyouth.2013.09.015

59.

Tomczak

(2014). The need to report effect size estimates revisited: An overview of some recommended measures of effect size. Trends in Sport Sciences, 1, 19-25.

60.

Trotter

(1996). The impact of different supervision practices in community corrections: Cause for optimism. Australian and New Zealand Journal of Criminology, 29, 29-46. doi:10.1177/000486589602900103

61.

Truth and Reconciliation Commission of Canada. (2015). Honouring the truth, reconciling for the future: Summary of the final report of the Truth and Reconciliation Commission of Canada. Winnipeg, Manitoba, Canada: Author.

62.

Vieira

T. A.

Skilling

T. A.

Peterson-Badali

(2009). Matching court-ordered services with treatment needs: Predicting treatment success with young offenders. Criminal Justice and Behavior, 36, 385-401. doi:10.1177/0093854808331249

63.

Viljoen

J. L.

Brodersen

Shaffer

McMahon

R. J.

(2016). Risk reduction interventions for adolescent offenders. In Heilbrun

DeMatteo

Goldstein

N. S.

(Eds.), APA handbook of psychology and juvenile justice (pp. 517-544). Washington, DC: American Psychological Association. doi:10.1037/14643-024

64.

Viljoen

J. L.

Brodersen

Shaffer

Muir

N., &

ARROW Advisory Board (2014). Adolescent Risk Reduction and Resilient Outcomes Work-Plan. Burnaby, British Columbia, Canada: Simon Fraser University.

65.

Viljoen

J. L.

Cochrane

D. M.

Jonnson

M. R.

(2018). Do risk assessment tools help to manage and reduce risk of violence and reoffending? A systematic review. Law and Human Behavior, 42, 181-214. doi:10.1037/lhb0000280

66.

Viljoen

J. L.

Shaffer

C. S.

Muir

N. M.

Cochrane

D. M.

Brodersen

E. M.

(2019). Improving case plans and interventions for adolescents on probation: The implementation of the SAVRY and a structured case planning form. Criminal Justice and Behavior, 46, 42-62. doi:10.1177/0093854818799379

67.

Vincent

G. M.

Guy

L. S.

Perrault

R. T.

Gershenson

(2016). Risk assessment matters, but only when implemented well: A multisite study in juvenile probation. Law and Human Behavior, 40, 683-696. doi:10.1037/lhb0000214.supp

68.

Wachter

(2015). Statewide risk assessment in juvenile probation. JJGPS StateScan. Pittsburgh, PA: National Center for Juvenile Justice.

69.

Wiltsey

Kimberly

Cook

Calloway

Castro

Charns

(2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, 1-19. doi:10.1186/1748-5908-7-17

70.

Wong

S. K.

(2005). The effects of adolescent activities on delinquency: A differential involvement approach. Journal of Youth and Adolescence, 34, 321-333. doi:10.1007/s10964-005-5755-4