Evidence-based policy has much to recommend it, but it also faces significant challenges. These challenges reside not only in the dilemmas faced by policy makers but also in the quality of the evaluation evidence. Some of these problems are most effectively addressed by rigorous syntheses of the literature known as systematic reviews. Other problems remain, including the range of quality in systematic reviews and their general failure to be updated in light of new evidence or disseminated beyond the research community. Based on the precedent established in health care by the international Cochrane Collaboration, the newly formed Campbell Collaboration will prepare, maintain, and make accessible systematic reviews of research on the effects of social and educational interventions. Through mechanisms such as rigorous quality control, electronic publication, and worldwide coverage of the literature, the Campbell Collaboration seeks to meet challenges posed by evidence-based policy.
Get full access to this article
View all access options for this article.
References
1.
Amann, Ron.2000. Foreword. In What Works? Evidence-Based Policy and Practice in Public Services, ed. Huw T. O. Davies, Sandra Nutley, and Peter C. Smith.Bristol , UK: Policy Press.
2.
Bailey, William C.1966. Correctional Outcome: An Evaluation of 100 Reports . Journal of Criminal Law, Criminology and Police Science57:153-60.
3.
Boruch, Robert F.1997. Randomized Experiments for Planning and Evaluation: A Practical Guide. Thousand Oaks, CA: Sage.
4.
Boruch, Robert F., Anthony Petrosino, and lain Chalmers.1999. The Campbell Collaboration: A Proposal for Multinational, Continuous and Systematic Reviews of Evidence. In Proceedings of the International Meeting on Systematic Reviews of the Effects of Social and Educational Interventions July 15-16, ed. Philip Davies, Anthony Petrosino, and Iain Chalmers. London: University College-London, School of Public Policy.
5.
Campbell, Donald T.1969. Reforms as Experiments. American Psychologist24:409-29.
6.
Chalmers, lain, Larry V. Hedges, and Harris Cooper. In press. A Brief History of Research Synthesis. Evaluation & the Health Professions.
7.
Cochrane, Archie L.1972. Effectiveness and Efficiency. Random Reflections on Health Services. London: Nuffield Provincial Hospitals Trust.
8.
—. 1979. 1931-1971: A Critical Review, with Particular Reference to the Medical Profession. In Medicines for the Year 2000. London: Office of Health Economics.
9.
Cohn, Jason.2001. Drug Education: The Triumph of Bad Science. Rolling Stone869:41-42,96.
10.
Cook, Thomas D., Harris Cooper, David S. Cordray, Heidi Hartmann, Larry V Hedges, Richard J. Light, Thomas A. Louis, and Frederick Mosteller, eds. 1992. Meta-Analysis for Explanation. New York: Russell Sage.
11.
Cooper, Harris C. and Larry V Hedges, eds. 1994. The Handbook of Research Synthesis. New York: Russell Sage .
12.
C2 Steering Group.2001. C2: Concept, Status, Plans. Overarching Grant Proposal. Philadelphia : Campbell Collaboration Secretariat.
13.
Cullen, Francis T. and Paul Gendreau.2000. Assessing Correctional Rehabilitation: Policy, Practice, and Prospects. In Policies, Processes, and Decisions of the Criminal Justice System, Criminal Justice 2000, vol. 3, ed. Julie Horney.Washington, DC: National Institute of Justice .
14.
Davies, Huw T. O., Sandra M. Nutley, and Peter C. Smith, eds. 2000. What Works? Evidence-Based Policy in Public Services. Bristol, UK: Policy Press.
15.
Davies, Phillip.1999. What Is Evidence-Based Education?British Journal of Educational Studies47:108-21.
16.
Davies, Philip, Anthony Petrosino , and lain Chalmers, eds. 1999. Proceedings of the International Meeting on Systematic Reviews of the Effects of Social and Educational Interventions, July 15-16. London: University College- London, School of Public Policy.
17.
Egger, Matthias and George Davey-Smith .1998. Bias in Location and Selection of Studies. British Medical Journal316:61-66.
18.
Farrington, David P. and Anthony Petrosino.2001. The Campbell Collaboration Crime and Justice Group. Anals of the American Academy of Polatical andSocial Science578:35-49.
19.
Fischer, Joel.1978. Does Anything Work?Journal of Social Service Research1:215-43.
20.
Fitz-Gibbon, Carol.1999. Education: The High Potential Not Yet Realized. Public Money &Management19:33-40.
21.
Gawande, Atul.2001. Under Suspicion. The Fugitive Science of Criminal Justice . New Yorker, 8 Jan., 50-53.
22.
Glass, Gene V, Barry McGaw, and Mary L. Smith.1981. Meta-Analysis in Social Research . London: Sage.
23.
Greenberg, David and Mark Shroder.1997. The Digest of Social Experiments. 2d ed. Washington, DC: Urban Institute Press .
24.
Harlen, Wynne.1997. Educational Research and Educational Reform. In The Role of Research in Mature Educational Systems, ed. Seamus Hegarty.Slough, UK: National Foundation for Educational Research.
25.
Hedges, Larry V and Ingram Olkin.1985. Statistical Methods for Meta-Analysis. New York: Academic Press.
26.
Hunt, Morton.1997. The Story of Meta-Analysis. New York : Russell Sage.
27.
Jadad, Alejandor R., Deborah J. Cook, Alison Jones , Terry P. Klassen, Peter Tugwell , Michael Moher, and David Moher.1998. Methodology and Reports of Systematic Reviews and Meta-Analyses: A Comparison of Cochrane Reviews with Articles Published in Paper-Based Journals . Journal of the American Medical Association280:278-80.
28.
Kirby, Bernard C.1954. Measuring Effects of Criminals and Delinquents . Sociology and Social Research38:368-74.
29.
Lipsey, Mark W.1990. Design Sensitivity: Statistical Power forExperimental Research. Newbury Park, CA: Sage . —. 1992. Juvenile Delinquency Treatment: A Meta-Analytic Inquiry into the Variability of Effects. In Meta-Analysis forExplanation, ed. Thomas D. Cook, Harris Cooper, David S. Cordray, Heidi Hartmann , Larry V. Hedges, Richard J. Light, Thomas A. Louis, and Frederick Mosteller.New York: Russell Sage.
30.
Lipsey, Mark W. and David B. Wilson .1993. The Efficacy of Psychological, Educational and Behavioral Treatment: Confirmation from Meta-Analysis. American Psychologist48:1181-209.
31.
Lipton, Douglas S.1992. How to Maximize Utilization of Evaluation Research by Policymakers. Annals of the American Academy of Political and Social Science521:175-88.
32.
Lipton, Douglas S., Robert Martinson, and Judith Wilks.1975. The Effectiveness of Correctional Treatment. New York: Praeger.
33.
Logan, Charles H.1972. Evaluation Research in Crime and Delinquency: A Reappraisal . Journal of Criminal Law, Criminology and Police Science63:378-87.
34.
MacDonald, Geraldine.1999. Evidence-Based Social Care: Wheels Off the Runway? Public Money &Management19:25-32.
35.
MacKenzie, Doris Layton.2000. Evidence-Based Corrections: Identifying What Works . Crime & Delinquency46:457-71.
36.
Martinson, Robert.1974. What Works? Questions and Answers About Prison Reform . Public Interest10:22-54.
37.
National Board of Health and Welfare.2001 . A Programme of National Support for the Advancement of Knowledge in the Social Services. Stockholm: Author.
38.
Nutley, Sandra and Huw T.O. Davies.1999. The Fall and Rise of Evidence in Criminal Justice. Public Money &Management19:47-54.
39.
Nutley, Sandra, Huw T. O. Davies, and Nick Tilley.2000. Letter to the Editor. Public Money & Management20:3-6.
40.
Nuttall, Christopher, Peter Goldblatt, and Chris Lewis, eds. 1998. Reducing Offending: An Assessment of Research Evidence on Ways of Dealing with Offending Behaviour. London: Home Of fice.
41.
Palmer, Ted.1975. Martinson Revisited. Journal of Research in Crime and Delinquency12:133-52.
42.
—. 1994.A Profile of Correctional Effectiveness and New Directions for Research. Albany: State University of New York Press.
43.
Petrosino, Anthony.2000. Crime, Drugs and Alcohol. In Evidence from Systematic Reviews of Research Relevant to Implementing the "Wider Public Health" Agenda, Contributors to the Cochrane Collaboration and the Campbell Collaboration. York, UK: NHS Centre for Reviews and Dissemination .
44.
—. Forthcoming. What Works to Reduce Offending? A Systematic Review of 300 Randomized Field Trials in Crime Reduction. New York : Oxford University Press.
45.
Petrosino, Anthony, Robert F. Boruch, Cath Rounding, Steve McDonald, and lain Chalmers.2000. The Campbell Collaboration Social, Psychological, Educational and Criminological Trials Register (C2-SPECTR) to Facilitate the Preparation and Maintenance of Systematic Reviews of Social and Educational Interventions. Evaluation Research in Education14:293-307.
46.
Quinsey, Vernon L.1983. Prediction of Recidivism and the Evaluation of Treatment Programs for Sexual Of fenders. In Sexual Aggression and the Law, ed. Simon N. Verdun-Jones and A. A. KeltnerBurnaby, Canada: Simon Fraser University Criminology Research Centre.
47.
Sechrest, Lee, Susan O. White , and Elizabeth D. Brown, eds. 1979. The Rehabilitation of Criminal Offenders: Problems and Prospects. Washington, DC: National Academy of Sciences.
48.
Sheldon, Brian and Roy Chilvers.2000. Evidence-Based Social Care: A Study of Prospects and Problems. Dorset, UK: Russell House.
49.
Sherman, Lawrence W.1999. Evidence-Based Policing. In Ideas in American Policing. Washington, DC: Police Foundation.
50.
Sherman, Lawrence W., Denise C. Gottfredson, Doris Layton MacKenzie, John E. Eck, Peter Reuter, and Shawn D. Bushway .1997. Preventing Crime: What Works, What Doesn't, What's Promising. Washington, DC: U.S. Department of Justice, National Institute of Justice.
51.
Smith, Adrian.1996. Mad Cows and Ecstasy: Chance and Choice in an Evidence-Based Society. Journal of the Royal Statistical Society159:367-83.
52.
Tyden, Thomas.1996. The Contribution of Longitudinal Studies for Understanding Science Communication and Research Utilization. Science Communication18:29.
53.
Weisburd, David, Cynthia M. Lum, and Anthony Petrosino.2001. Does Research Design Affect Study Outcomes ? Findings from the Maryland Report Criminal Justice Sample. Annals of the American Academy ofPolitical andSocial Science578:50-70.
54.
Weiss, Carol Hirschon.1978. Improving the Linkage Between Social Research and Public Policy In Knowledge and Policy: The Uncertain Connection , ed. L. E. Lynn.Washington, DC: National Academy of Sciences.
55.
Weiss, Carol Hirschon and Anthony Petrosino.1999. Improving the Use of Research: The Case of D.A.R.E. Unpublished grant proposal to the Robert Wood Johnson Foundation, Substance Abuse Policy Research Program. Cambridge, MA: Harvard Graduate School of Education.
56.
Weiss, Carol Hirschon and Eleanor Singer.1988. The Reporting of Social Science in the National Media . New York: Russell Sage.
57.
Wiles, Paul.2001. Criminology in the 21st Century: Public Good or Private Interest? Paper presented at the meeting of the Australian and New Zealand Society of Criminology, University of Melbourne, Australia, Feb.
58.
Witmer, Helen L. and Edith Tufts.1954. The Effectiveness of Delinquency Prevention Programs . Washington, DC: U.S. Department of Health, Education and Welfare, Social Security Administration , Children's Bureau.
59.
Wolf, Frederic M.2000. Lessons to be Learned from Evidence-Based Medicine: Practice and Promise of Evidence-Based Medicine and Evidence-Based Education . Medical Teacher22:251-59.
