Mental Health Courts (MHCs) are problem-solving courts that have been implemented throughout the United States. One critical component of MHCs is determining their effectiveness and limitations. However, unique challenges are encountered when evaluating MHCs. One major challenge, and the focus of this paper, is identifying an adequate control group. The ideal approach to determining efficacy is using a controlled group design whereby participants are randomized to treatment or control conditions. However, this approach is not possible when conducting retrospective evaluation of court data. In addition, a specific set of ethical and logistical issues arise. Propensity score matching (PSM) provides an alternative approach for comparing groups when randomization is not possible. PSM works by first identifying the characteristics that make a person likely to be in treatment. We describe our attempts to use PSM in a MHC evaluation. Specific challenges with PSM are discussed and recommendations are made for use of PSM with MHCs.
AllmarkPeterMasonSuzanne. 2006. “Should Desperate Volunteers be Included in Randomised Controlled Trials?” Journal of Medical Ethics32(9):548–53. doi:10.1136/jme.2005.014282
2.
AnestisJoye C.CarbonellJoyce L. 2014. “Stopping the Revolving Door: Effectiveness of Mental Health Court in Reducing Recidivism by Mentally Ill Offenders.” Psychiatric Services65(9):1105–12.
3.
BecksteadJoelHatch DArlin L.LambertMichael J.EggettDennis L.GoatesMelissa K.VermeerschDavid A. 2003. “Clinical Significance of the Outcome Questionnaire (OQ-45.2).” The Behavior Analyst Today4(1):86–97. doi:10.1037/h0100015
4.
BermanGregFeinblattJohn. 2001. “Problem-solving Courts: A Brief Primer.” Law & Policy23(2):125–40.
5.
BermanGregFoxAubrey. 2010. “The Future of Problem-solving Justice: An International Perspective.” University of Maryland Law Journal of Race, Religion, Gender & Class10(1):1–24.
CampbellMary A.CanalesDonald D.WeiRanTottenAngela E.MacaulayAlex C.WershlerJulie L. 2015. “Multidimensional Evaluation of a Mental Health Court: Adherence to the Risk-need-responsivity Model.” Law & Human Behavior39(5):489–502.
8.
CosdenMerithEllensJeffrey K.SchnellJeffrey L.Yamini-DioufYasmeenWolfeM. M. 2003. “Evaluation of a Mental Health Treatment Court with Assertive Community Treatment.” Behavioral Science Law21(4):415–27.
9.
FiducciaChelsea E.RogersRichard. 2012. “Final-stage Diversion.” Criminal Justice and Behavior39(4):571–83.
10.
FisherR. A. 1935. The logic of inductive inference. Journal of the Royal Statistical Society, 98(1):39–82.
11.
GoldkampJohn S.Irons-GuynnCheryl. 2000. Emerging Judicial Strategies for the Mentally Ill in the Criminal Caseload: Mental Health Courts in Fort Lauderdale, Seattle, San Bernardino, and Anchorage. Washington, DC: Bureau of Justice Assistance, U.S. Department of Justice.
12.
GuoShenyangFraserMark W. 2011. Propensity Score Analysis: Statistical Methods and Applications. Los Angeles, CA: Sage Publications.
13.
HidayVirginia A.WalesHeathcote W.RayBradley. 2013. “Effectiveness of a Short-term Mental Health Court: Criminal Recidivism One Year Postexit.” Law and Human Behavior37(6):401–11.
14.
HoneggerLaura N.2015. “Does the Evidence Support the Case for Mental Health Courts? A Review of the Literature.” Law & Human Behavior39(5):478–88.
15.
LauAnna S.ChangDoris F.OkazakiSumie. 2010. “Methodological Challenges in Treatment Outcome Research with Ethnic Minorities.” Cultural Diversity & Ethnic Minority Psychology16(4):573–80. doi:10.1037/a0021371
16.
LeiteWalter L.2016. Practical Propensity Score Methods Using R. Thousand Oaks, CA: Sage Publications.
17.
LimLoraineDayAndrew. 2014. “Mental Health Diversion Courts: A Two Year Recidivism Study of a South Australian Mental Health Court Program.” Behavioral Sciences & the Law32(4):539–51.
18.
LowderEvan M.DesmaraisSarah L.BaucomDaniel J. 2016. “Recidivism Following Mental Health Court Exit: Between and within-group Comparisons.” Law & Human Behavior40(2):118–27.
19.
LuskinMary L.2013. “More of the Same? Treatment in Mental Health Courts.” Law and Human Behavior37(4):255–66.
20.
McGahaAnnetteBoothroydRoger A.PoythressNorman G.PetrilaJohnOrtRhonda G. 2002. “Lessons from the Broward County mental health court evaluation.” Evaluation and Program Planning25(2):125–35.
21.
McNielDale E.BinderRenee L. 2007. “Effectiveness of a Mental Health Court in Reducing Criminal Recidivism and Violence.” American Journal of Psychiatry164(9):1395–1403.
22.
McNielDale E.SadehNaomiDelucchiKevin L.BinderRenee L. 2015. “Prospective Study of Violence Risk Reduction by a Mental Health Court.” Psychiatric Services66(6):598–603.
23.
NeymanJerzy. 1990. “On the Application of Probability Theory to Agricultural Experiments Essay on Principles. Section 9.” Statistical Science5(4):465–80.
24.
R Core Team. 2017. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing.
25.
RosenbaumPaul R.RubinDonald B. 1983. “The Central Role of the Propensity Score in Observational Studies for Causal Effects.” Biometrika70:41–55.
26.
SarteschiChristine M.VaughnMichael G.KimKevin. 2011. “Assessing the Effectiveness of Mental Health Courts: A Quantitative Review.” Journal of Criminal Justice39(1):12–20.
27.
ShadishWilliam R.CookThomas D.CampbellDonlad T. 2002. Experimental and Quasi-experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin.
28.
SteadmanHenry J.2005. A Guide to Collecting Mental Health Court Outcome Data. New York: Council of State Governments.
29.
SteadmanHenry J.CallahanLisaRobbinsPamela C.VesselinovRoumenMcguireT. G.MorrisseyJ. P. 2014. “Criminal Justice and Behavioral Health Care Costs of Mental Health Court Participants: A Six-year Study.” Psychiatric Services65(9):1100–04.
30.
SteadmanHenry J.RedlichAlisonCallahanLisaRobbinsPamela C.VesselinovRoumen. 2011. “Effect of Mental Health Courts on Arrests and Jail Days: A Multisite Study.” Archives of General Psychiatry68(2):167–72.
31.
WolffNancyPogorzelskiWendy. 2005. “Measuring the Effectiveness of Mental Health Courts: Challenges and Recommendations.” Psychology, Public Policy, and Law11(4):539–69.
32.
WorwoodErin B.SarverChristianBorgiaA. D.ButtersRobert P. 2015. Statewide Evaluation of Utah Mental Health Courts: Phase I Report. Salt Lake City: Utah Criminal Justice Center, University of Utah.
