Experiments are known to be powerful tools in assessing the effectiveness of interventions. Notwithstanding this knowledge, randomized field trials have been little used in criminal justice settings. The researchers discuss their experiences implementing two experiments: one in a courthouse and the other in a police agency. Despite the different settings, common problems surfaced in both randomized field trials. The authors discuss obstacles faced in implementing and running experiments and suggest some strategies for avoiding these problems. It is the researchers' hope that such a candid discussion will help others to design and implement stronger experiments.
Get full access to this article
View all access options for this article.
References
1.
Alpert, G. P.
, & Moore, M. (1993). Measuring police performance in the new paradigm of policing. In Performance measures for the criminal justice system (pp. 109-142). Washington, DC: Department of Justice.
2.
Babbie, E.
(1998). The practice of social research. Belmont, CA: Wadsworth.
3.
Berk, R. A.
(1993). What the scientific evidence shows: On average, we can do no better than arrest. In R. J. Gelles & D. R. Loseke, Current controversies on family violence (pp. 323-336). Newbury Park, CA: Sage.
4.
Berk, R.
, Boruch, R., Chambers, D., Rossi, P., & Witte, A. (1985). Social policy experimentation: A position paper. Evaluation Review, 9(4), 387-429.
5.
Berk, R.
, Smyth, G., & Sherman, L. (1988). When random assignment fails: Some lessons learned from the Minneapolis Spouse Abuse Experiment. Journal of Quantitative Criminology, 4(3), 209-223.
6.
Bickman, L.
(1985). Randomized field experiments in education: Implementation lessons. New Directions for Program Evaluation, 28, 39-53.
7.
Boruch, R.
(1997). Randomized experiments for planning and evaluation. Thousand Oaks, CA: Sage.
8.
Campbell, D.
, & Stanley, J. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
9.
Chen, H-T.
, Bersani, C., Myers, S., & Denton, R. (1989). Evaluating the effectiveness of a court sponsored treatment program. Journal of Family Violence, 4(4), 309-322.
10.
“Conflict of law, science?” (1997, May 10). Miami Herald, p. 26A.
11.
Cornish, D. B.
, & Clarke, R. V. (Eds.). (1986). The reasoning criminal. New York: Springer.
12.
Daly, K.
, & Chesney-Lind, M. (1988). Feminism and criminology. Justice Quarterly, 5, 497-538.
13.
Devine, J.
, Wright, J., & Joyner, L. (1994, Fall). Issues in implementing a randomized experiment in a field setting. New Directions for Program Evaluation, 63, 27-40.
14.
Erez, E.
(1986). Randomized experiments in correctional context: Legal, ethical and practical concerns. Journal of Criminal Justice, 14(5), 389-400.
15.
Farrington, D.
(1983). Randomized experiments on crime and justice. In M. Tonry & N. Morris (Eds.), Crime and justice: An annual review of the research (Vol. 4, pp. 257-308). Chicago: University of Chicago Press.
16.
Feder, L.
(1998). Using random assignment in social science settings. Professional Ethics Report, 11(1), 1, 7.
17.
Friedman, W.
(1994). The community role in community policing. In D. P. Rosenbaum (Ed.), The challenge of community policing (pp. 263-269). Thousand Oaks, CA: Sage.
18.
Garner, J.
, & Visher, C. (1988). Experiments help shape new policies (Report No. 211). Washington, DC: National Institute of Justice Reports.
19.
Grine, R. M.
(1994). Angles in marble: Problems in stimulating community involvement in community policing. Crime & Delinquency, 40, 437-468.
20.
Hamberger, L. K.
, & Hastings, J. (1993). Court-mandated treatment of men who assault their partner. In Z. Hilton (Ed.), Legal responses to wife assault: Current trends and evaluation (pp. 188-229). Newbury Park, CA: Sage.
21.
Healey, K.
, Smith, C., & O'Sullivan, C. (1998). Batterer intervention: Program approaches and criminal justice strategies. Washington, DC: Department of Justice.
22.
Jolin, A.
, & Clavadetscher, M. (1995). Implementation and assessment of a community policing unit to address domestic violence in Portland, Oregon (Research report, Grant No. 92-IJ-CX-K037). Portland, OR: Center for Urban Studies, Portland State University.
23.
Jolin, A.
, Fountain, R., Feyerherm, W., & Friedman, S. (1998). Beyond arrest: The Portland, Oregon domestic violence experiment. (Final report, National Institute of Justice Grant No. 95-IJ-CX-0054). Portland, OR: Portland State University, Criminal Justice Policy and Research Center.
24.
Jolin, A.
, & Moose, C. C. (1997). Evaluating a domestic violence program in a community policing environment: Research implementation issues. Crime & Delinquency, 43, 279-297.
25.
Miller, R. B.
(1985). Social policy experimentation: Some comments and caveats. Evaluation Review, 9(4), 437-440.
26.
Monette, D.
, Sullivan, T., & DeJong, C. (1994). Applied social research: Tool for the human services. San Francisco, CA: Harcourt Brace College Publishers.
27.
Neubauer, D.
(1988). America's courts and the criminal justice system. Pacific Grove, CA: Brooks/Cole.
28.
Orwin, R.
, Sonnefeld, L., Garrison-Mogren, R., & Smith, N. G. (1994). Pitfalls in evaluating the effectiveness of case management programs for homeless persons: Lessons from the NIAAA Community Demonstration Program. Evaluation Research, 18, 153-207.
29.
Petersilia, J.
(1989). Implementing randomized experiments: Lessons learned from BJA's Intensive Supervision Program. Evaluation Review, 13, 435-458.
30.
Petrosino, A.
(1997). What works? revisited again: A meta-analysis of randomized field experiments in rehabilitation, deterrence and prevention. Dissertation Abstracts International, Vol. 58-09-A. Rutgers University, Newark Campus.
31.
Portland Police Bureau
. (1990). Community policing transition plan. Portland, OR: Author.
32.
Sherman, L.
(1992). Policing domestic violence: Experiments and dilemmas. New York: Free Press.
33.
Sherman, L.
, & Cohn, E. (1989). The impact of research on legal policy: The Minneapolis Domestic Violence Experiment. Law & Society Review, 23(1), 117-144.
34.
Weis, J. G.
(1989). Family violence research methodology and design. In L. Ohlin & M. Tonry (Eds.), Family violence (pp. 117-162). Chicago: Chicago University Press.
35.
Weisburd, D.
(1994). Evaluating community policing: Role tensions between practitioners and evaluators. In D. Rosenbaum (Ed.), The challenge of community policing (pp. 274-277). Thousand Oaks, CA: Sage.
