This study examined the feasibility of and fidelity to risk/needs assessment, mental health screening, and risk-need-responsivity (RNR)-based case planning within juvenile probation in two states. The researcher-guided implementation effort included the Massachusetts Youth Screening Instrument-2 (MAYSI-2), Structured Assessment of Violence Risk in Youth (SAVRY), and policies to prioritize criminogenic needs while using mental health services only when warranted. Data from 53 probation officers (POs) and 553 youths indicated three of five offices had high fidelity to administration and case planning policies. The interrater reliability (n = 85; intraclass correlation coefficient [ICC][A, 1] = .92 [Northern state] and .80 [Southern state]) and predictive validity (n = 455; Exp[B] = 1.83) of SAVRY risk ratings were significant. There was an overreliance on mental health services; 48% of youth received these referrals when only 20% screened as having mental health needs. Barriers to fidelity to RNR practices in some offices included assessments not being conducted before disposition, lack of service availability, and limited buy-in from a few stakeholders.
AndrewsD. A.BontaJ. (2010). Rehabilitating and criminal justice policy and practice. Psychology, Public Policy, and Law, 16(1), 39–55. https://doi.org/10.1037/a0018362
2.
BarrettS. B.BradshawC. P.Lewis-PalmerT. (2008). Maryland statewide PBIS initiative: Systems, evaluation, and next steps. Journal of Positive Behavior Interventions, 10(2), 105–114. https://doi.org/10.1177/1098300707312541
3.
BorumR.BartelP.ForthA. (2006). Manual for the Structured Assessment for Violence Risk in Youth (SAVRY). Psychological Assessment Resources.
4.
BoskerJ.WittemanC. (2016). Finding the right focus: Improving the link between risk/needs assessment and case management in probation. Psychology, Public Policy, and Law, 22(2), 221–233. https://doi.org/10.1037/law0000075
5.
CarrollC.PattersonM.WoodS.BoothA.RickJ.BalainS. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), Article 40. https://doi.org/10.1186/1748-5908-2-40
6.
DrerupL. C.CroysdaleA.HoffmannN. G. (2008). Patterns of behavioral health conditions among adolescents in a juvenile justice system. Professional Psychology: Research and Practice, 39(2), 122–128. https://doi.org/10.1037/0735-7028.39.2.122
7.
FarringtonD. P. (1989). Early predictors of adolescent aggression and adult violence. Violence and Victims, 4(2), 79–100. https://doi.org/10.1891/0886-6708.4.2.79
8.
FixsenD. L.BlaseK. A.Van DykeM. K. (2019). Implementation practice & science. Active Implementation Research Network.
9.
FixsenD. L.NaoomS. F.BlaséK. A.FriedmanR. M.WallaceF. (2005). Implementation research: A synthesis of the literature. Louis de la Parte Florida Mental Health Institute, National Implementation Research Network, University of South Florida. https://nirn.fpg.unc.edu/resources/implementation-research-synthesis-literature
10.
FleissJ. L. (1986). The design and analysis of clinical experiments. John Wiley.
11.
GendreauP.SmithP.FrenchS. A. (2006). The theory of effective correctional intervention: Empirical status and future directions. In CullenF.WrightJ.ColemanM. (Eds.), Taking stock: The status of criminology theory (pp. 419–446). Transaction Press.
12.
GreenhalghT.RobertG.MacFarlaneF.BateP.KyriakidouO. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82(4), 581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x
13.
GrissoT. (2005). Why we need mental health screening and assessment in juvenile justice programs. In GrissoT.VincentG.SeagraveD. (Eds.), Mental health screening and assessment in juvenile justice (pp. 3–21). Guilford Press.
14.
GrissoT.BarnumR. (2006). Massachusetts Youth Screening Instrument-Version 2: User’s manual and technical report. Professional Resource Press.
15.
GuebertA. F.OlverM. E. (2014). An examination of criminogenic needs, mental health concerns, and recidivism in a sample of violent young offenders: Implications for risk, need, and responsivity. International Journal of Forensic Mental Health, 13(4), 295–310. https://doi.org/10.1080/14999013.2014.955220
16.
HaasS. M.DeTardo-BoraK. A. (2009). Inmate reentry and the utility of the LSI-R in case planning. Corrections Compendium, 34(1), 11–16.
17.
HaqaneeZ.Peterson-BadaliM.SkillingT. (2014). Making “what works” work: Examining POs’ experiences addressing the criminogenic needs of juvenile offenders. Journal of Offender Rehabilitation, 54(1), 37–59. https://doi.org/10.1080/10509674.2014.980485
HoeveM.McReynoldsL. S.WassermanG. A. (2014). Service referral for juvenile justice youths: Associations with psychiatric disorder and recidivism. Administration and Policy in Mental Health and Mental Health Services Research, 41(3), 379–389. https://doi.org/10.1007/s10488-013-0472-x
20.
HogeR. D.AndrewsD. A. (2011). Youth Level of Service/Case Management Inventory 2.0. Multi-Health Systems.
21.
HosmerD. W.LemeshowS.MayS. (2008). Applied survival analysis: Regression modeling of time-to-event data (2nd ed.). Wiley-Interscience.
22.
KarshB. T. (2004). Beyond usability: Designing effective technology implementation systems to promote patient safety. BMJ Quality & Safety, 13(5), 388–394. https://doi.org/10.1136/qshc.2004.010322
23.
KennealyP. J.SkeemJ. L.HernandezI. R. (2017). Does staff see what experts see? Accuracy of front line staff in scoring juveniles’ risk factors. Psychological Assessment, 29(1), 26–34. https://doi.org/10.1037/pas0000316
24.
LipseyM. W.DerzonJ. H. (1998). Predictors of violent or serious delinquency in adolescence and early adulthood: A synthesis of longitudinal research. In LoeberR.FarringtonD. P. (Eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. 86–105). SAGE.
25.
McCormickS.Peterson-BadaliM.SkillingT. A. (2017). The role of mental health and specific responsivity in juvenile justice rehabilitation. Law and Human Behavior, 41(1), 55–67. https://doi.org/10.1037/lhb0000228
26.
McGrawK. O.WongS. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30–46. https://doi.org/10.1037/1082-989X.1.1.30
27.
MillerJ.MaloneyC. (2013). Practitioner compliance with risk/needs assessment tools: A theoretical and empirical assessment. Criminal Justice and Behavior, 40(7), 716–736. https://doi.org/10.1177/0093854812468883
28.
MonchickR.ScheyettA.PfeiferJ. (2006). Drug court case management: Role, function, and utility. National Drug Court Institute.
National Research Council. (2013). Reforming juvenile justice: A developmental approach. The National Academies Press. https://doi.org/10.17226/14685
31.
NelsonR. J.VincentG. M. (2018). Matching services to criminogenic needs following comprehensive risk assessment implementation in juvenile probation. Criminal Justice and Behavior, 45(8), 1136–1153. https://doi.org/10.1177/0093854818780923
32.
OlverM. E.StockdaleK. C.WormithJ. S. (2009). Risk assessment with young offenders: A meta-analysis of three assessment measures. Criminal Justice and Behavior, 36(4), 329–353. https://doi.org/10.1177/0093854809331457
33.
PerraultR. T.VincentG. M.GuyL. S. (2017). Are risk assessments racially biased? Field study of the SAVRY and YLS/CMI in probation. Psychological Assessment, 29(6), 664–678. https://doi.org/10.1037/pas0000445
34.
Peterson-BadaliM.SkillingT.HaqaneeZ. (2015). Examining implementation of risk assessment in case management for youth in the justice system. Criminal Justice and Behavior, 42(3), 304–320. https://doi.org/10.1177/0093854814549595
35.
ProctorE.SilmereH.RaghavanR.HovmandP.AaronsG.BungerA.… HensleyM. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7
36.
SchubertC. A.MulveyE. P.GlasheenC. (2011). Influence of mental health and substance use problems and criminogenic risk on outcomes in serious juvenile offenders. Journal of the American Academy of Child & Adolescent Psychiatry, 50(9), 925–937. https://doi.org/10.1016/j.jaac.2011.06.006
37.
ShookJ. L.SaariR. C. (2007). Structured decision making in juvenile justice: Judges’ and POs’ perceptions and use. Children and Youth Services Review, 29(10), 1335–1351. https://doi.org/10.1016/j.childyouth.2007.05.008
38.
SinghJ. P.GrannM.FazelS. (2011). A comparative study of violence risk assessment tools: A systematic review and metaregression analysis of 68 studies involving 25,980 participants. Clinical Psychology Review, 31(3), 499–513. https://doi.org/10.1016/j.cpr.2010.11.009
39.
SkeemJ. L.ManchakS.PetersonJ. K. (2011). Correctional policy for offenders with mental illness: Creating a new paradigm for recidivism reduction. Law and Human Behavior, 35(2), 110–126. https://doi.org/10.1007/s10979-010-9223-7
40.
TeplinL. A.AbramK. M.McClellandG. M.DulcanM. K.MericleA. A. (2002). Psychiatric disorders in youth in juvenile detention. Archives of General Psychiatry, 59(12), 1133–1143. https://doi.org/10.1001/archpsyc.59.12.1133
41.
VieiraT. A.SkillingT. A.Peterson-BadaliM. (2009). Matching court-ordered services with treatment needs: Predicting treatment success with young offenders. Criminal Justice and Behavior, 36(4), 385–401. https://doi.org/10.1177/0093854808331249
42.
ViglioneJ.RudesD. S.TaxmanF. S. (2015). Misalignment in supervision: Implementing risk/needs assessment instruments in probation. Criminal Justice and Behavior, 42(3), 263–285. https://doi.org/10.1177/0093854814548447
43.
ViljoenJ. L.ShafferC. S.MuirN. M.CochraneD. M.BrodersenE. M. (2019). Improving case plans and interventions for adolescents on probation: The implementation of the SAVRY and a structured case planning form. Criminal Justice and Behavior, 46(1), 42–62. https://doi.org/10.1177/0093854818799379
44.
VincentG. M.FraserJ.HendersonC.GrissoT. (2017). Setting differences in mental health and traumatic experiences in juvenile justice: A national study [Unpublished manuscript]. Department of Psychiatry, University of Massachusetts Medical School.
45.
VincentG. M.GrissoT.TerryA.BanksS. (2008). Gender and race differences in mental health symptoms in juvenile justice. Journal of American Academy of Child and Adolescent Psychiatry, 47, 282–290. https://doi.org/10.1097/CHI.0b013e318160d516
46.
VincentG. M.GuyL. S.FuscoS. L.GershensonB. G. (2012). Field reliability of the SAVRY with juvenile probation officers: Implications for training. Law and Human Behavior, 36(3), 225–236. https://doi.org/10.1037/h0093974
VincentG. M.GuyL. S.PerraultR. T.GershensonB. (2016). Risk assessment matters, but only when implemented well: A multisite study in juvenile probation. Law and Human Behavior, 40(6), 683–696. https://doi.org//10.1037/lhb0000214
49.
VincentG. M.Paiva-SalisburyM.CookN. E.GuyL. S.PerraultR. (2012). Impact of Risk/Needs Assessment on juvenile probation officers’ decision-making: Importance of implementation. Psychology, Public Policy, & the Law, 18(4), 546–576. https://doi.org//10.1037/a0027186
50.
VincentG. M.SullivanC.SullivanC.GuyL.LatessaE.TysonJ.AdamsB. (2018). Studying drivers of risk and needs assessment instrument implementation in juvenile justice reform. U.S. Department of Justice, Office of Juvenile Justice and Delinquency Prevention. https://ojjdp.ojp.gov/sites/g/files/xyckuh176/files/pubs/251809.pdf
51.
WassermanG. A.McReynoldsL. S.SchwalbeC. S.KeatingJ. M.JonesS. A. (2010). Psychiatric disorder, comorbidity, and suicidal behavior in juvenile justice youth. Criminal Justice and Behavior, 37(12), 1361–1376. https://doi.org/10.1177/0093854810382751
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
