In "Random Measurement Error Does Not Bias the Treatment Estimate in the Regression-
Discontinuity Design : II. When an Interaction Effect Is Present, " Trochim, Cappelleri, and
Reichardt claim to "set the record straight regarding the RD design. " Instead, they defend the
record of regression discontinuity (RD) and blur the statistical tests for treatment effect. Not
withstanding their explicit assertions to the contrary, the Monte Carlo results they report show
how the practical application of RD remains problematic and potentially biased. New testing
strategies and restrictions for the application of RD are proposed.
Get full access to this article
View all access options for this article.
References
1.
Cain, G.G.1975. Regression and selection models improve nonexperimental comparisons. In Evaluation and experiment: Some critical issues in assessing social programs, edited by C. A. Bennet and A. A. Lumdaine.New York: Academic Press.
2.
Campbell, D.T.1969. Reforms as experiments. American Psychologist24:409-29.
3.
Cappelleri, J.C., W.M.K. Trochim, T.D. Stanley, and C.S. Reichardt.1991. Random measurement error does not bias the treatment effect estimate in the regression-discontinuity design. Evaluation Review15:395-419.
4.
Duhem, P. [1906] 1954. The aim and structure of physical theory. Princeton, NJ: Princeton University Press.
5.
Fomby, T.B., R.C. Hill, and S.R. Johnson.1984. Advanced econometrics methods. New York: Springer-Verlag.
6.
Goldberger, A.S.1972a. Selection bias in evaluating treatment effects: Some formal illustrations. University of Wisconsin, Institute for Research on Poverty, Madison.
7.
———— 1972b. Selection bias in evaluating treatment effects: The case of interaction. University of Wisconsin, Institute for Research on Poverty, Madison.
8.
Griliches, Z.1986. Data problems in econometrics. In Handbook of econometrics. Vol. 3., edited by Z. Griliches and M. Intriligator.Amsterdam: North Holland.
9.
Gujarati, D.N.1988. Basic econometrics. 2d ed. New York: McGraw-Hill.
10.
Hausman, J.A.1978. Specification tests in econometrics. Econometrica46:1251-71.
11.
Jaccard, J., R. Turrisi, and C.K. Wan.1990. Interaction effects in multiple regression . Newbury Park, CA: Sage.
12.
Johnston, J.1972. Econometric methods. 2d ed. New York: McGraw-Hill.
13.
Judd, C.M., and D.A. Kenny.1981. Estimating the effects of social interventions . Cambridge: Cambridge University Press.
14.
Lakatos, I.1970. Falsification and the methodology of scientific research programmes. In Criticism and the growth of knowledge, edited by I. Lakatos and A. Musgrave.Cambridge: Cambridge University Press.
15.
Lord, F.M.1960. Large sample covariance analysis when the control variable is fallible. Journal of the American Statistical Association81:381-9.
16.
Lord, F.M., and M.R. Novick.1968. Statistical theories of mental test scores. Reading, MA: Addison-Wesley .
17.
Popper, K.R.1959. The logic of scientific discovery. New York: Basic Books.
18.
Quine, W.V.O. [1953] 1963. From a logical point of view . New York: Harper & Row.
19.
Reichardt, C.S.1979. The statistical analysis of data from nonequivalent group designs. In Quasi-experimentation: Design and analysis issues for field settings, edited by T. D. Cook and D. T. Campbell.Chicago : Rand-McNally.
20.
Robbins, H., and C.-H. Zhang.1988. Estimating a treatment effect under biased sampling. Proceedings of the National Academy of Science, USA 85:3670-72.
21.
————. 1989. Estimating the superiority of a drug to a placebo when all and only those patients at risk are treated with the drug. Proceedings of the National Academy of Science, USA86:3003-05.
22.
—. 1990. Estimating a treatment effect under biased allocation . Working paper. Rutgers University, Institute of Biostatistics and Department of Statistics.
23.
Robinson, A., and T.D. Stanley.1989. Teaching to talent: Evaluating an enriched and accelerated mathematics program. Journal of the Education of the Gifted12:253-67.
24.
Rubin, D.B.1977. Assignment to treatment group on the basis of a covariate . Journal of Educational Statistics2:1-26.
25.
Stanley, T.D.1986. Stein-rule least squares estimation: A heuristic for fallible data. Economics Letters20:147-50.
26.
—. 1988. Forecasting from fallible data: Correcting prediction bias with Stein-rule least squares. Journal of Forecasting7:103-13.
27.
————. 1989. Galton, Stein and empirical Bayes: Artifacts and connections . Statistica49: 499-511.
28.
Stanley, T.D., and A. Robinson.1986. Regression discontinuity: Integrating research and program design in programs for the gifted. Journal for the Education of the Gifted9:181-91.
29.
————. 1990a. "Second best" evaluation designs: Regression-discontinuity or abbreviated time series? Paper presented at the annual conference of the American Evaluation Association, Washington, DC, October.
30.
————. 1990b. Sifting statistical significance from the artifact of regression-discontinuity design. Evaluation Review14:166-81.
31.
Trochim, W.M.K.1984. Research design for program evaluation. Beverly Hills, CA: Sage.
32.
———— 1986. Advances in quasi-experimental design and analysis. San Francisco: Jossey-Bass.
33.
————. 1990. The regression-discontinuity design. In Research methodology: Strengthening causal interpretations of nonexperimental data, edited by L. Sechrest, P. Perrin, and J. Bunker.Washington, DC: U.S. Department of Health and Human Services.
34.
Trochim, W.M.K., J.K. Cappelleri, and C.S. Reichardt.1991. Random measurement error does not bias the treatment effect estimate in the regression-discontinuity design: II. When an interaction effect is present. Evaluation Review15:571-604.
35.
Wonnacott, R.J., and T.H. Wonnacott.1979. Econometrics. 2d ed. New York: Wiley.
