Redesigning Juvenile Probation to Align With Behavioral Health and Positive Development Principles: A Quasi-Experimental Study

Abstract

Science advisory boards and policy organizations have called for adolescent brain science to be incorporated into juvenile probation operations. To achieve this, Opportunity-Based Probation (OBP), a probation model that integrates knowledge of adolescent development and behavior change principles, was developed in collaboration with a local juvenile probation department. The current study compares outcomes (recidivism and probation violations) for youth in the OBP condition versus probation as usual. Inverse probability weighting (IPW) and coarsened exact matching (CEM) were used to estimate causal effects of OBP’s average treatment effect (ATE). Results indicated clear effects of OBP on reducing criminal legal referrals, but no significant effects were observed for probation violations. Overall, results provide promising recidivism-reduction effects in support of developmentally grounded redesigns of juvenile probation.

Keywords

juvenile probation adolescent development community supervision implementation juvenile justice recidivism

Get full access to this article

View all access options for this article.

References

The Annie E. Casey Foundation. (2018). Transforming juvenile probation: A vision for getting it right. https://www.aecf.org/resources/transforming-juvenile-probation/

Arnold

M. E.

Silliman

(2017). From theory to practice: A critical review of positive youth development program frameworks. Journal of Youth Development, 12(2), 1–20. https://doi.org/10.5195/jyd.2017.17

Austin

P. C.

(2011). An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behavioral Research, 46, 399–424. https://doi.org/10.1080/00273171.2011.568786

Austin

P. C.

Stuart

E. A.

(2017). The performance of inverse probability of treatment weighting and full matching on the propensity score in the presence of model misspecification when estimating the effect of treatment on survival outcomes. Statistical Methods in Medical Research, 26(4), 1654–1670. https://doi.org/10.1177/0962280215584401

Blackwell

Iacus

King

Porro

(2009). cem: Coarsened exact matching in Stata. The Stata Journal, 9, 524–546. https://doi.org/10.1177/1536867X0900900402

Bonell

Hinds

Dickson

Thomas

Fletcher

Murphy

Melendez-Torres

G. J.

Campbell

(2016). What is positive youth development and how might it reduce substance use and violence? A systematic review and synthesis of theoretical literature. BMC Public Health, 16, Article 13. https://doi.org/10.1186/s12889-016-2817-3

Butts

J. A.

Schiraldi

V. N.

(2018). Recidivism reconsidered: Preserving the community justice mission of community corrections. Program in Criminal Justice Policy and Management, Harvard Kennedy School. https://doi.org/10.7916/d8-gky0-5x32

Ciocanel

Power

Eriksen

Gillings

(2017). Effectiveness of positive youth development interventions: A meta-analysis of randomized controlled trials. Journal of Youth and Adolescence, 46, 483–504. https://doi.org/10.1007/s10964-016-0555-6

Davies

Mathew

Wilcock

Manthorpe

Sampson

E. L.

Lamahewa

Iliffe

(2016). A co-design process developing heuristics for practitioners providing end of life care for people with dementia. BMC Palliative Care, 15, Article 68. https://doi.org/10.1186/s12904-016-0146-z

10.

Dir

A. L.

Magee

L. A.

Clifton

R. L.

Ouyang

Wiehe

S. E.

Aalsma

M. C.

(2020). The point of diminishing returns in juvenile probation: Probation requirements and risk of technical probation violations among first-time probation-involved youth. Psychology, Public Policy, and Law, 27, 283–291. https://doi.org/10.1037/law0000282

11.

Florida Department of Juvenile Justice. (2009). Residential Positive Achievement Change Tool (R-PACT). http://www.djj.state.fl.us/docs/partners-providers-staff/rpact-v1_3-florida-20090213.pdf?sfvrsn=2

12.

Fortney

J. C.

Unützer

Wrenn

Pyne

J. M.

Smith

G. R.

Schoenbaum

Harbin

H. T.

(2017). A tipping point for measurement-based care. Psychiatric Services, 68, 179–188. https://doi.org/10.1176/appi.ps.201500439

13.

Gatti

Tremblay

R. E.

Vitaro

(2009). Iatrogenic effect of juvenile justice. Journal of Child Psychology and Psychiatry and Allied Disciplines, 50, 991–998. https://doi.org/10.1111/j.1469-7610.2008.02057.x

14.

Geldhof

G. J.

Bowers

E. P.

Boyd

M. J.

Mueller

M. K.

Napolitano

C. M.

Schmid

K. L.

Lerner

J. V.

Lerner

R. M.

(2014). Creation of short and very short measures of the five Cs of positive youth development. Journal of Research on Adolescence, 24, 163–176. https://doi.org/10.1111/jora.12039

15.

Goldstein

N. E. S.

NeMoyer

Gale-Bentz

Levick

Feierman

(2016). “You’re on the right track!”: Using graduated response systems to address immaturity of judgment and enhance youths’ capacities to successfully complete probation. Temple Law Review, 88, 803–836.

16.

Hamilton

van Wormer

Barnoski

(2015). PACT validation and weighting results: Technical report. https://s3.wp.wsu.edu/uploads/sites/436/2017/02/PACT-Study-Final3.pdf

17.

Harvell

Love

Pelletier

Warnberg

(2018). Bridging research and practice in juvenile probation: Rethinking strategies to promote long-term change. https://www.urban.org/sites/default/files/publication/99223/bridging_research_and_practice_in_juvenile_probation_1.pdf

18.

Hay

Widdows

(2013). Residential Positive Achievement Change Tool (R-PACT) validation study. https://www.djj.state.fl.us/content/download/22778/file/r-pact_validation_study_powerpoint_june2013.pdf

19.

Holland

P. W.

(1986). Statistics and causal inference. Journal of the American Statistical Association, 81, 945–960. https://doi.org/10.1080/01621459.1986.10478354

20.

Huizinga

Schumann

Ehret

Elliott

(2003). The effect of juvenile justice system processing on subsequent delinquent and criminal behavior: A cross-national study. https://www.ncjrs.gov/pdffiles1/nij/grants/205001.pdf

21.

Iacus

S. M.

King

Porro

(2012). Causal inference without balance checking: Coarsened exact matching. Political Analysis, 20, 1–24. https://doi.org/10.1093/pan/mpr013

22.

Jann

(2017, June 23). Why propensity scores should be used for matching [Keynote address]. 2017 German Stata Users Group Meeting, Berlin, Germany. https://www.stata.com/meeting/germany17/slides/Germany17_Jann.pdf

23.

Kimchi

(2019). Investigating the assignment of probation conditions: Heterogeneity and the role of race and ethnicity. Journal of Quantitative Criminology, 35, 715–745. https://doi.org/10.1007/s10940-018-9400-2

24.

Krezmien

M. P.

Mulcahy

C. A.

Leone

P. E.

(2008). Detained and committed youth: Examining differences in achievement, mental health needs, and special education status. Education and Treatment of Children, 31, 445–464. https://doi.org/10.1353/etc.0.0029

25.

Lane

Turner

Fain

Sehgal

(2005). Evaluating an experimental intensive juvenile probation program: Supervision and official outcomes. Crime & Delinquency, 51, 26–52. https://doi.org/10.1177/0011128704264943

26.

Leiber

M. J.

Peck

J. H.

(2013). Probation violations and juvenile justice decision making: Implications for Blacks and Hispanics. Youth Violence and Juvenile Justice, 11, 60–78. https://doi.org/10.1177/1541204012447960

27.

Lunceford

J. K.

Davidian

(2004). Stratification and weighting via the propensity score in estimation of causal treatment effects: A comparative study. Statistics in Medicine, 23, 2937–2960. https://doi.org/10.1002/sim.1903

28.

Mallett

C. A.

Stoddard-Dare

(2010). Predicting secure detention placement for African-American juvenile offenders: Addressing the disproportionate minority confinement problem. Journal of Ethnicity in Criminal Justice, 8, 91–103. https://doi.org/10.1080/15377931003761011

29.

National Council of Juvenile and Family Court Judges. (2018). Resolution regarding juvenile probation and adolescent development. Juvenile and Family Court Journal, 69, 55–57. https://doi.org/10.1111/jfcj.12104

30.

National Research Council. (2013). Reforming juvenile justice: A developmental approach. https://www.njjn.org/uploads/digital-library/Reforming_JuvJustice_NationalAcademySciences.pdf

31.

Paparozzi

M. A.

Gendreau

(2005). An intensive supervision program that worked: Service delivery, professional orientation, and organizational supportiveness. The Prison Journal, 85, 445–466. https://doi.org/10.1177/0032885505281529

32.

Petrosino

Turpin-Petrosino

Guckenburg

(2010). Formal system processing of juveniles: Effects on delinquency. Campbell Systematic Reviews, 6, 1–88. https://doi.org/10.4073/csr.2010.1

33.

Rosenbaum

P. R.

Rubin

D. B.

(1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55. https://doi.org/10.1093/biomet/70.1.41

34.

Rudes

D. S.

Taxman

F. S.

Portillo

Murphy

Rhodes

Stitzer

Luongo

P. F.

Friedmann

P. D.

(2012). Adding positive reinforcement in justice settings: Acceptability and feasibility. Journal of Substance Abuse Treatment, 42, 260–270. https://doi.org/10.1016/j.jsat.2011.08.002

35.

Rudes

D. S.

Viglione

Sheidow

A. J.

McCart

M. R.

Chapman

J. E.

Taxman

F. S.

(2021). Juvenile probation officers’ perceptions on youth substance use varies from task-shifting to family-based contingency management. Journal of Substance Abuse Treatment, 120, 108144. https://doi.org/10.1016/j.jsat.2020.108144

36.

Sanders

E. B.-N.

Stappers

P. J.

(2008). Co-creation and the new landscapes of design. CoDesign, 4, 5–18. https://doi.org/10.1080/15710880701875068

37.

Saunders

Midgette

Taylor

Faraji

S.-L.

(2021). A hidden cost of convenience: Disparate impacts of a program to reduce burden on probation officers and participants. Criminology & Public Policy, 20, 71–122. https://doi.org/10.1111/1745-9133.12534

38.

Schwalbe

C. S.

(2012). Toward an integrated theory of probation. Criminal Justice and Behavior, 39, 185–201. https://doi.org/10.1177/0093854811430185

39.

Schwartz

R. G.

(2018). A 21st century developmentally appropriate juvenile probation approach. Juvenile and Family Court Journal, 69, 41–54. https://doi.org/10.1111/jfcj.12108

40.

Sheidow

A. J.

McCart

M. R.

Chapman

J. E.

Drazdowski

T. K.

(2020). Capacity of juvenile probation officers in low-resourced, rural settings to deliver evidence-based substance use intervention to adolescents. Psychology of Addictive Behaviors, 34, 76–88. https://doi.org/10.1037/adb0000497

41.

Skeem

J. L.

Manchak

(2008). Back to the future: From Klockars’ model of effective supervision to evidence-based practice in probation. Juvenile and Family Court Journal, 69, 41–54. https://doi.org/10.1080/10509670802134069

42.

Smith

Rodriguez

Zatz

M. S.

(2009). Race, ethnicity, class, and noncompliance with juvenile court supervision. The ANNALS of the American Academy of Political and Social Science, 623, 108–120. https://doi.org/10.1177/0002716208330488

43.

Steinmetz

K. F.

Anderson

J. O.

(2016). A probation profanation: Race, ethnicity, and probation in a Midwestern Sample. Race and Justice, 6, 325–349. https://doi.org/10.1177/2153368715619656

44.

Thoemmes

Ong

A. D.

(2016). A primer on inverse probability of treatment weighting and marginal structural models. Emerging Adulthood, 4, 40–59. https://doi.org/10.1177/2167696815621645

45.

Torbet

P. M.

(2008). Building Pennsylvania’s comprehensive aftercare model: Probation case management essentials for youth in placement. https://www.pccd.pa.gov/Juvenile-Justice/Documents/Probation%20Case%20Management%20Essentials.pdf

46.

Trotman

A. J.

Taxman

F. S.

(2011). Implementation of a contingency management-based intervention in a community supervision setting: Clinical issues and recommendations. Journal of Offender Rehabilitation, 50, 235–251.

47.

Tuell

J. A.

Heldman

Harp

(2017). Developmental reform in juvenile justice: Translating the science of adolescent development to sustainable best practice. https://rfknrcjj.org/wp-content/uploads/2017/09/Developmental_Reform_in_Juvenile_Justice_RFKNRCJJ.pdf

48.

Walker

S. C.

Bishop

A. S.

Catena

Haumann

(2017). Deploying street outreach workers to reduce failure to appear in juvenile court for youth of color: A randomized study. Crime & Delinquency, 65, 1740–1762. https://doi.org/10.1177/0011128717739567

49.

Walker

S. C.

Valencia

Miller

Pearson

Jewell

Tran

Thompson

(2020). Developmentally-grounded approaches to juvenile probation practice: A case study. Federal Probation, 83, 33–41.

50.

Wolf

Morrison

Inns

Slavin

Risman

(2020). Average effect sizes in developer-commissioned and independent evaluations. Journal of Research on Educational Effectiveness, 13, 428–447. https://doi.org/10.1080/19345747.2020.1726537