Sage Journals: Discover world-class research

Abstract

There are several contexts in which randomization in research design is not possible. Researchers may be interested in the effects of large-scale events or policy initiatives, or of complex causal processes that cannot be replicated. Threats to external validity in randomized experiments will lead to greater dividends for some research questions in a quasi-experimental design. Quasi-experiments can offer opportunities for testing causal theories, if they are carefully constructed to counter threats to internal validity. Furthermore, randomization is not a simple guarantee against threats to internal validity where few units of observation are used. An appreciation of the intersection of these approaches—between stronger quasi-experiments and weaker randomized experiments—can help guide our choice of experimental method. One can make the same argument about the benefits of pursuing good opportunities with quasi-experiments over scant opportunities with randomized experiments as is made more often in reverse.

Keywords

quasi-experiments randomized experiments field experiments internal validity external validity causation

Get full access to this article

View all access options for this article.

References

Berlin, Gordon , and Robert Solow. 2009. Get the question right, then choose the method. Journal of Policy Analysis and Management 28 (1): 161-181.

Besharov, Douglas J. , and Douglas M. Call . 2009. Head Start falls further behind. New York Times, February 8.

Campbell, Donald T. 1973. Reforms as experiments. In Quasi-experimental approaches, ed. James A. Caparaso and Leslie Roos , 187-225. Evanston, IL: Northwestern University Press.

Campbell, Donald T. , and Julian C. Stanley . 1963. Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.

Cook, Thomas D. , William R. Shadish , and Vivian C. Wong. 2008. Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management 27 (4): 724-50.

Cook, Thomas D. , and Peter M. Steiner . 2009. Some empirically viable alternatives to the randomized experiment. Journal of Policy Analysis and Management 28 (1): 165-66.

Gerber, Alan S. , Donald P. Green , and Edward H. Kaplan . 2004. The illusion of learning from observational research. In Problems and methods in the study of politics, ed. Ian Shapiro , Rogers M. Smith , and Tarek E. Masoud. Cambridge: Cambridge University Press.

Lewis-Beck, Michael S. , and John R. Alford . 1980. Can government regulate safety? The coal mine example. American Political Science Review 74:745-56.

Mannheim, Jarol B. , and Robert B. Albritton . 1984. Changing national images: International public relations and media agenda setting. American Political Science Review 78:641-57.

10.

Ragin, Charles. 1987. The comparative method: Moving beyond quantitative and qualitative strategies. Berkeley: University of California Press.

11.

Shadish, William R. , and Thomas D. Cook. 2009. The renaissance of field experimentation in evaluating interventions. Annual Review of Psychology 60:607-29.

12.

Shadish, William R. , Thomas D. Cook , and Donald T. Campbell . 2002. Experimental and quasi-experimental designs for generalized causal inference. New York: Houghton Mifflin.

13.

Sigelman, Lee , and Alan Rosenblatt . 1996. Methodological considerations in the analysis of presidential persuasion. In Political persuasion and attitude change, ed. Diana C. Mutz , Paul M. Sniderman , and Richard A. Brody. Ann Arbor: University of Michigan Press.

14.

Stoker, Laura , and Kent Jennings. 1995. Life-cycle transitions and political participation: The case of marriage. American Political Science Review 89:421-33.

Points of Intersection between Randomized Experiments and Quasi-Experiments

Abstract

Keywords

Get full access to this article

References