This study examines the joint effects of race/ethnicity and sex on the classification quality of the Positive Achievement Change Tool (PACT). We assess predictive parity, calibration, and error rate balance using a statewide sample of youth who completed probation from 2007 to 2014. Similar rates of predictive parity were observed across groups. Calibration was observed consistently across groups, but only when low risk youth were used as the reference category. Black and Hispanic boys revealed the highest base rates of re-arrest and inaccurate classification (i.e., scored low risk but were rearrested). Our findings highlight the difficulty in making conclusions about test bias, especially when base rates of recidivism are not equal across groups. Implications for juvenile justice policy and practice are discussed.
AllisonP. D. (1999). Multiple regression: A primer. Pine Forge Press.
2.
BaglivioM. T. (2009). The assessment of risk to recidivate among a juvenile offending population. Journal of Criminal Justice, 37(6), 596–607.
3.
BaglivioM. T. (2018). Considering race and gender in the validity of juvenile justice risk: Assessment research. Criminology & Public Policy, 17(3), 519–523.
4.
BaglivioM. T.GreenwaldM. A.RussellM. (2015). Assessing the implications of a structured decision-making tool for recidivism in a statewide analysis. Criminology & Public Policy, 14(1), 5–49.
5.
BaglivioM. T.JackowskiK. (2013). Examining the validity of a juvenile offending risk assessment instrument across gender and race/ethnicity. Youth Violence and Juvenile Justice, 11(1), 26–43.
6.
BairdC.HealyT.JohnsonK.BogieA.DankertE. W.ScharenbrochC. (2013). A comparison of risk assessment instruments in juvenile justice. National Council on Crime and Delinquency.
7.
BelknapJ.HolsingerK. (2006). The gendered nature of risk factors for delinquency. Feminist Criminology, 1(1), 48–71.
BerkR.HeidariH.JabbariS.KearnsM.RothA. (2021). Fairness in criminal justice risk assessments: The state of the art. Sociological Methods & Research, 50(1), 3–44.
10.
BontaJ.AndrewsD. A. (2016). The psychology of criminal conduct. Routledge.
11.
BridgesG. S.SteenS. (1998). Racial disparities in official assessments of juvenile offenders: Attributional stereotypes as mediating mechanisms. American Sociological Review, 63(4), 554–570.
12.
CampbellC.PappJ.BarnesA.OnifadeE.AndersonV. (2018). Risk assessment and juvenile justice: An interaction between risk, race, and gender. Criminology & Public Policy, 17(3), 525–545.
13.
ChenaneJ. L.BrennanP. K.SteinerB.EllisonJ. M. (2015). Racial and ethnic differences in the predictive validity of the Level of Service Inventory–Revised among prison inmates. Criminal Justice and Behavior, 42(3), 286–303.
14.
CohenT. H.LowenkampC. T. (2019). Revalidation of the Federal PTRA: Testing the PTRA for predictive biases. Criminal Justice and Behavior, 46(2), 234–260.
15.
CrenshawK. (1991). Mapping the margins: Identity politics, intersectionality, and violence against women. Stanford Law Review, 43(6), 1241–1299.
16.
CrewB. K. (1991). Sex differences in criminal sentencing: Chivalry or patriarchy?Justice Quarterly, 8(1), 59–83.
DeMicheleM.BaumgartnerP. (2021). Bias testing of the public safety assessment: Error rate balance between Whites and Blacks for new arrests. Crime & Delinquency, 67(12), 2088–2113.
19.
DeMicheleM.BaumgartnerP.WengerM.BarrickK.ComfortM. (2020). Public safety assessment: Predictive utility and differential prediction by race in Kentucky. Criminology & Public Policy, 19(2), 409–431.
20.
EckhouseL.LumK.Conti-CookC.Julie CiccoliniJ. (2019). Layers of bias: A unified approach for understanding problems with risk assessment. Criminal Justice and Behavior, 46(2), 185–209.
21.
FassT. L.HeilbrunK.DeMatteoD.FretzR. (2008). The LSI-R and the COMPAS: Validation data on two risk-needs tools. Criminal Justice & Behavior, 35, 1095–1108.
22.
Florida Department of Juvenile Justice. (n.d.). Comprehensive accountability reports. Comprehensive Accountability Report | Florida Department of Juvenile Justice (state.fl.us)
23.
GrahamS.LoweryB. S. (2004). Priming unconscious racial stereotypes about adolescent offenders. Law and Human Behavior, 28(5), 483–504.
24.
GuevaraL.HerzD.SpohnC. (2006). Gender and juvenile justice decision making: What role does race play?Feminist Criminology, 1(4), 258–282.
25.
HamiltonZ.KowalskiM. A.KigerlA.RouthD. (2019). Optimizing youth risk assessment performance: Development of the modified positive achievement change tool in Washington State. Criminal Justice and Behavior, 46(8), 1106–1127.
26.
HamiltonZ.KowalskiM. A.SchaeferR.KigerlA. (2020). Recrafting youth risk assessment: Developing the modified positive achievement change tool for Iowa. Deviant Behavior, 41(10), 1268–1289.
27.
Hannah-MoffatK. (2009). Gridlock or mutability: Reconsidering gender and risk assessment. Criminology & Public Policy, 8(1), 209–219.
28.
HarcourtB. E. (2015). Risk as a proxy for race: The dangers of risk assessment. Federal Sentencing Reporter, 27(4), 237–243.
29.
HayC.LadwigS.CampionB. (2018). Tracing the rise of evidence-based juvenile justice in Florida. Victims & Offenders, 13(3), 312–335.
30.
HendersonH.TananaM.BourgeoisJ. W.AdamsA. T. (2015). Psychometric racial and ethnic predictive inequities. Journal of Black Studies, 46(5), 462–481.
31.
HiltermanE. D.NichollsT. L.van NieuwenhuizenC. (2014). Predictive validity of risk assessments in Juvenile offenders: Comparing the SAVRY, PCL: YV, and YLS/CMI with unstructured clinical assessments. Assessment, 21(3), 324–339.
32.
HubbardD. J.MatthewsB. (2008). Reconciling the differences between the “gender-responsive” and the “what works” literatures to improve services for girls. Crime & Delinquency, 54(2), 225–258.
33.
JohnsonD. R.CreechJ. C. (1983). Ordinal measures in multiple indicator models: A simulation study of categorization error. American Sociological Review, 48(3), 398–407.
34.
Kempf-LeonardK. (2007). Minority youths and juvenile justice: Disproportionate minority contact after nearly 20 years of reform efforts. Youth Violence and Juvenile Justice, 5(1), 71–87.
35.
KleinbergJ.MullainathanS.RaghavanM. (2016). Inherent trade-offs in the fair determination of risk scores. arXiv,1609, 1–23.
36.
LambieI.RandellI. (2013). The impact of incarceration on juvenile offenders. Clinical Psychology Review, 33(3), 448–459.
37.
LeiberM. J.BrubakerS. J.FoxK. C. (2009). A closer look at the individual and joint effects of gender and race on juvenile justice decision making. Feminist Criminology, 4, 333–358.
38.
LoughranT. A.MulveyE. P.SchubertC. A.FaganJ.PiqueroA. R.LosoyaS. H. (2009). Estimating a dose-response relationship between length of stay and future recidivism in serious juvenile offenders. Criminology, 47(3), 699–740.
39.
MaggardS. R.HigginsJ. L.ChappellA. T. (2013). Pre-dispositional juvenile detention: An analysis of race, gender and intersectionality. Journal of Crime and Justice, 36(1), 67–86.
40.
McCaffertyJ. T. (2018). Unjust disparities? The impact of race on juvenile risk assessment outcomes. Criminal Justice Policy Review, 29(5), 423–442.
41.
MouldsE. F. (1978). Chivalry and paternalism: Disparities of treatment in the criminal justice system. Western Political Quarterly, 31(3), 416–430.
42.
NelsonR. J.VincentG. M. (2018). Matching services to criminogenic needs following comprehensive risk assessment implementation in juvenile probation. Criminal Justice and Behavior, 45(8), 1136–1153.
43.
OnifadeE.DavidsonW.CampbellC. (2009). Risk assessment: The predictive validity of the youth level of service case management inventory with African Americans and girls. Journal of Ethnicity in Criminal Justice, 7(3), 205–221.
44.
PeckJ. H.JenningsW. G. (2016). A critical examination of “being black” in the juvenile justice system. Law and Human Behavior, 40(3), 219–232.
45.
PeckJ. H.LeiberM. J.BrubakerS. J. (2014). Gender, race, and juvenile court outcomes: An examination of status offenders. Youth Violence & Juvenile Justice, 12(3), 250–267.
46.
PerraultR. T.Paiva-SalisburyM.VincentG. M. (2012). Probation officers’ perceptions of youths’ risk of reoffending and use of risk assessment in case management. Behavioral Sciences & the Law, 30(4), 487–505.
47.
PerraultR. T.VincentG. M.GuyL. S. (2017). Are risk assessments racially biased? Field study of the SAVRY and YLS/CMI. Psychological Assessment, 29, 664–678.
48.
PuschN.HoltfreterK. (2018). Gender and risk assessment in juvenile offenders: A meta-analysis. Criminal Justice and Behavior, 45(1), 56–81.
49.
ReddingR. E.ArrigoB. (2005). Multicultural perspectives on delinquency among African American youth: Etiology and intervention. In FrisbyC. L.ReynoldsC. R. (Eds.), Comprehensive handbook of multicultural school of psychology (pp. 710–743). Wiley.
50.
RiceM. E.HarrisG. T. (2005). Comparing effect sizes in follow-up studies: ROC area, Cohen’s d, and r. Law and Human Behavior, 29(5), 615–620.
51.
SchwalbeC. S. (2007). Risk assessment for juvenile justice: A meta-analysis. Law and Human Behavior, 31(5), 449–462.
52.
SchwalbeC. S.FraserM. W.DayS. H.CooleyV. (2006). Classifying juvenile offenders according to risk of recidivism: Predictive validity, race/ethnicity, and gender. Criminal Justice and Behavior, 33(3), 305–324.
53.
SinghJ. P. (2013). Predictive validity performance indicators in violence risk assessment: A methodological primer. Behavioral Sciences & the Law, 31(1), 8–22.
54.
SkeemJ. L.LowenkampC. T. (2016). Risk, race, and recidivism: Predictive bias and disparate impact. Criminology, 54(4), 680–712.
55.
SpinneyE.CohenM.FeyerhermW.StephensonR.YeideM.ShreveT. (2018). Disproportionate minority contact in the U.S. juvenile justice system: A review of the DMC literature, 2001–2014, Part I. Journal of Crime and Justice, 41(5), 573–595.
56.
SpivakA. L.WagnerB. W.WhitmerJ. M.CharishC. L. (2014). Gender and status offending. Feminist Criminology, 9(3), 224–248.
57.
SteffensmeierD.KramerJ.StreifelC. (1993). Gender and imprisonment decisions. Criminology, 31(3), 411–446.
58.
SullivanC. J.ChildsK. K. (2021). Juvenile risk and needs assessment: Theory, research, policy, and practice. Routledge.
VincentG. M.ViljoenJ. L. (2020). Racist algorithms or systemic problems? Risk assessments and racial disparities. Criminal Justice and Behavior, 47(12), 1576–1584.
61.
Winokur-EarlyK.HandG. A.BlankenshipJ. L. (2012). Validity and reliability of the Florida Positive Achievement Change Tool (PACT) risk and needs assessment instrument: A three-phase evaluation. Justice Research Center.
