In policing, quality of implementation—not just whether a policy is implemented, but how it is implemented—often means the difference between achieving the desired outcomes or not. Police leaders can respond to tracking evidence that shows poor quality of implementation by either improving officer compliance with policy, improving the policy itself, or both. We report a case study of the tracking of implementation quality in a randomized controlled trial of a police policy for contacting victims, in which the first author was a participant-observer. We show that when the results of tracking were fed back to officers to improve compliance, and to managers, who then redesigned policy and training in repeated iterations, the quality of implementation and victim satisfaction improved substantially. This evidence-based, training-tracking-feedback strategy of implementation can be applied more generally to improve the quality of police services and outcomes.
AgerA.O’MayF. (2001). Issues in the definition and implementation of “best practice” for staff delivery of interventions for challenging behaviour. Journal of Intellectual & Developmental Disability, 26, 243–256.
2.
AndrewsD. A.DowdenC. (2005). Managing correctional treatment for reduced recidivism: A meta analytic review of program integrity. Legal and Criminological Psychology, 10, 173–187.
3.
ArielB.FarrarT.SutherlandA. (2014). The effect of police body-worn cameras on use-of-force and citizens’ complaints against the police: A randomized controlled trial. Journal of Quantitative Criminology. Published online: November 19, 2014.
4.
ArielB.NeyroudP.SlothowerM. (2014). Cambridge randomizer performance in a large scale, long-term experiment: Maintaining quality, reducing research costs. Presented at American Society of Criminology Conference, San Francisco, CA, November.
5.
ArielB.ShermanL.VilaJ. (2012). Random assignment without tears: How to stop worrying and love the Cambridge randomizer. Journal of Experimental Criminology, 8, 193–208.
6.
BarnoskiR. (2002). Washington State’s implementation of Functional Family Therapy for juvenile offenders: Preliminary results (Document No. 02-08-1201). Olympia: Washington State Institute for Public Policy. Retrieved fromhttp://www.wsipp.wa.gov/
7.
BarnoskiR. (2004). Outcome evaluation of Washington State’s research-based programs for juvenile offenders (Document No. 04-01-1201). Olympia: Washington State Institute for Public Policy. Retrieved fromhttp://www.wsipp.wa.gov/
8.
BronittS.StenningP. (2011). Understanding discretion in modern policing. Criminal Law Journal, 35, 319–332.
9.
DavisD. (1995). Changing physician performance: A systematic review of the effect of continuing medical education strategies. Journal of the American Medical Association, 274, 700–705.
10.
DodgeK. A. (2001). The science of youth violence prevention: Progressing from developmental epidemiology to efficacy to effectiveness to public policy. American Journal of Preventive Medicine, 20, 63–70.
11.
FaganA.HansonK.HawkinsJ.ArthurM. (2008). Implementing effective community-based prevention programs in the community youth development study. Youth Violence and Juvenile Justice, 6, 256–278.
12.
FixsenD.NaoonS.BlaseK.FriedmanR.WallaceF. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, the National Implementation Research Network.
13.
GogginC.GendreauP. (2006). The implementation and maintenance of quality services in offender rehabilitation programmes. In HollinC. R.PalmerE. J. (Eds.), Offending behaviour programmes: Development, application, and controversies (pp. 209–246). Chichester, England: Wiley.
14.
GoldsteinH. (1979). Improving policing: A problem oriented approach. Crime and Delinquency, 25, 236–258.
15.
GottfredsonD.GottfredsonG. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research in Crime and Delinquency, 39, 3–35.
16.
GrolR.GrimshawJ. (2003). From best evidence to best practice: Effective implementation of change in patients’ care. Lancet, 362, 1225–1230.
17.
HallforsD.GodetteD. (2002). Will the “principles of effectiveness” improve prevention practice? Early findings from a diffusion study. Health Education Research, 17, 461–470.
18.
HasisiB.WeisburdD. (2011). Going beyond ascribed identities: The importance of procedural justice in airport security screening in Israel. Law and Society Review, 45, 867–892.
19.
HobdayJ. (2014). Targeting reasons for rejecting random assignment in an RCT (M.St. Dissertation). Cambridge, England: Institute of Criminology, University of Cambridge.
20.
JoyceB.ShowersB. (2002). Student achievement through staff development (3rd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.
21.
KarolyL. A.GreenwoodP. W.EveringhamS. S.HoubéJ.KilburnM. R.RydellC. P. (1998). Investing in our children. Santa Monica, CA: RAND.
22.
KawamotoK.HouliahanC.BalasE.LobachD. (2005). Improving clinical practice using clinical decision support systems: A systematic review of trials to identify features critical to success. BMJ, 330, 765. Epub 2005 Mar 14.
23.
KnitzerJ.CooperJ. (2006). Beyond integration: Challenges for children’s mental health. Health Affairs, 25, 670–679.
24.
KoperC. S.Mayo-WilsonE. (2006). Police crackdowns on illegal gun carrying: A systematic review of their impact on gun crime. Journal of Experimental Criminology, 2, 227–261.
25.
LandenbergerN.LipseyM. (2005). The positive effects of cognitive-behavioral programs for offenders: A meta-analysis of factors associated with effective treatment. Journal of Experimental Criminology, 1, 451–476.
26.
LatimerJ. (2001). A meta-analytic examination of youth delinquency, family treatment, and recidivism. Canadian Journal of Criminology, 43, 237–253.
27.
LipseyM. (1999). Can intervention rehabilitate serious delinquents?The Annals of the American Academy of Political and Social Science, 564, 142–166.
28.
LipseyM. (2009). The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview. Victims and Offenders, 4, 124–147.
29.
LipseyM.HowellJ.KellyM.ChapmanG.CarverD. (2010). Improving the effectiveness of juvenile justice programs: A new perspective on evidence-based practice. Washington, DC: Center for Juvenile Justice Reform, Georgetown University.
30.
LipseyM.WilsonD. (1998). Effective intervention for serious juvenile offenders: A synthesis of research. In LoeberR.FarringtonD. P. (Eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (Chap. 13, pp. 313–345). Thousand Oaks, CA: Sage.
31.
LöselF.SchmuckerM. (2005). The effectiveness of treatment for sexual offenders: A comprehensive meta-analysis. Journal of Experimental Criminology, 1, 117–146.
32.
LowenkampL. E.SmithP. (2006). Does correctional program integrity really matter? The impact of adhering to the principles of effective intervention 2006. Criminology and Public Policy, 5, 201–220.
33.
MaloneyD. M.PhillipsE. L.FixsenD. L.WolfM. M. (1975). Training techniques for staff in group homes for juvenile offenders. Journal of Criminal Justice and Behavior, 2, 195–216.
34.
MastrofskiS. (2004). Controlling street-level police discretion. Annals of the American Academy of Political and Social Science, 593, 100–118.
McGuireJ. (2001). What works in correctional intervention? Evidence and practical implications. In BernfeldG.FarringtonD.LeschiedA. (Eds.), Offender rehabilitation in practice: Implementing and evaluating effective programs (pp. 25–43). London, England: Wiley.
MooreM. (2002). Recognizing value in policing: The challenge of measuring police performance. Washington, DC: PERF.
39.
National Research Council. (2004). Fairness and effectiveness in policing: The evidence. Washington, DC: The National Academies Press.
40.
NesovicA. (2003). Psychometric evaluation of the correctional program assessment inventory (PhD Dissertation). Ottawa, Canada: Carlton University, Department of Psychology.
41.
NeyroudP. (2008). Past, present and future performance: Lessons and prospects for the measurement of police performance. Policing, 2, 340–349.
42.
NeyroudP.SlothowerM. (2013). Operation turning point: Second interim report. Interim report to West Midlands Police. Cambridge, England: Institute of Criminology, University of Cambridge.
43.
NeyroudP.SlothowerM. (2012). Operation turning point: Interim report. Interim report to West Midlands Police. Cambridge, England: Institute of Criminology, University of Cambridge.
44.
RealK.PooleM. S. (2005). Innovation implementation: Conceptualization and measurement in organizational research. Research in Organizational Change and Development, 15, 63–134.
SampsonR. J.LaubJ. H. (1993). Crime in the making: Pathways and turning points through life. Cambridge, MA: Harvard University Press.
47.
SchoenwaldS. K. (2008). Toward evidence-based transport of evidence-based treatments: MST as an example. Journal of Child and Adolescent Substance Abuse, 17, 69–91.
48.
ShaplandJ.SorsbyA.RobinsonG. (2011). Restorative justice in practice: Evaluating what works for victims and offenders. New York, NY: Routledge.
49.
ShaplandJ.WillmoreJ.DuffP. (1985). Victims in the criminal justice system. Aldershot, England: Gower.
ShermanL. (2011). Al Capone, the sword of Damocles, and the police–corrections budget ratio. Criminology & Public Policy, 10, 195–206.
52.
ShermanL. (2013). The rise of evidence-based policing: Targeting, testing, and tracking. Crime and Justice, 42, 377–451.
53.
ShermanL.NeyroudP. (2012). Offender desistance policing and the sword of Damocles. London, England: Civitas.
54.
ShermanL.StrangH. (2014). The morality of evidence: The second annual restorative justice lecture. Presented at American Society of Criminology Conference, San Francisco, CA, November.
55.
ShermanL.StrangH.WoodsD. (2003). Captains of restorative justice: Experience, legitimacy, and recidivism by type of offense. In WeitekampElmarKernerHans-Juergen (Eds.), Restorative justice in context: International practice and direction (pp. 229–248). Dorset, England: Willan.
56.
ShermanL. W.RoganD. P. (1995). Effects of gun seizures on gun violence: “Hot spots” patrol in Kansas City. Justice Quarterly, 12, 673–693.
57.
ShermanL. W.WilliamsS.ArielB.StrangL. R.WainN.SlothowerM.NortonA. (2014). An integrated theory of hot spots patrol strategy implementing prevention by scaling up and feeding back. Journal of Contemporary Criminal Justice, 30, 95–122.
58.
SlothowerM. (2014a). Strengthening police professionalism with decision support: Bounded discretion in out-of-court disposals. Policing, 8, 353–367.
59.
SlothowerM. (2014b). Victim perceptions of legitimacy of diversion to a conditional out-of-court disposal: A randomised controlled trial (M. A. Dissertation). Washington, DC: University of Maryland.
60.
SlothowerM.JoyceT. (2014). Police restorative justice conferencing implementation across different management regimes. Manuscript in preparation. College Park: Department of Criminology and Criminal Justice, University of Maryland.
61.
StokesT.BaerD. (1977). An implicit technology of generalization. Journal of Applied Behavior Analysis, 10, 349–367.
62.
St PierreT. L.OsgoodD. W.MincemoyerC. C.KaltreiderD. L.KauhT. J. (2005). Results of an independent evaluation of Project Alert delivered in schools by cooperative extension. Prevention Science, 6, 305–317.
63.
StrangH. (2002). Repair or revenge: Victims and restorative justice. Claredon Studies in Criminology. New York, NY: Oxford University Press.
64.
StrangH.ShermanL. W.Mayo-WilsonE.WoodsD.ArielB. (2013). Restorative justice conferencing: Effects of face-to-face meetings of offenders and victims. A Systematic Review. Campbell Systematic Reviews, 12.
65.
TylerT. (1990). Why people obey the law. Princeton, NJ: Princeton University Press.
66.
TylerT. R. (2006a). Legitimacy and legitimation. Annual Review of Psychology, 57, 375–400.
67.
TylerTom R. (2006b). What Do They Expect? New Findings Confirm the Precepts of Procedural Fairness. California Courts Review (p. 23). San Francisco, CA: Judicial Council of California.
68.
TylerT.HuoY. J. (2002). Trust in the law: Encouraging public cooperation with the police and courts. New York, NY: Russell-Sage.
69.
WeisburdD.EckJ. E.HinkleJ. C.TelepC. W. (2008). Effects of problem-oriented policing on crime and disorder. Campbell Collaboration Library of Systematic Reviews. Retrieved fromhttp://www.campbellcollaboration.org/library.php
70.
WeiszJ.SandlerI.DurlakJ.AntonB. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60, 628–648.
71.
WelshB. C.SullivanC. J.OldsD. L. (2010). When early crime prevention goes to scale: A new look at the evidence. Prevention Science, 11, 115–125.
72.
WoodsD. (2009). Unpacking the impact of restorative justice in the RISE experiments: Facilitators, offenders, and conference non-delivery. Unpublished dissertation, University of Pennsylvania, Philadelphia, PA.
