Regression Discontinuity Design in Gifted and Talented Education Research

Abstract

This Methodological Brief introduces the reader to the regression discontinuity design (RDD), which is a method that when used correctly can yield estimates of research treatment effects that are equivalent to those obtained through randomized control trials and can therefore be used to infer causality. However, RDD does not require the random assignment of individuals to treatment and control groups, making it very attractive for applied researchers in educational settings. This Brief introduces the method, discusses applications and limitations, and illustrates an idealized example as well as some potential pitfalls and their relevance to the context of gifted education research.

Keywords

regression discontinuity gifted education causal inference permissive assignment misallocation of treatment

Get full access to this article

View all access options for this article.

References

Bleske-Rechek

Lubinski

Benbow

C. P.

(2004). Meeting the educational needs of special populations: Advanced Placement’s role in developing exceptional human capital. Psychological Science, 15, 217-224.

Bui

S. A.

Craig

S. G.

Imberman

S. A.

(2011, May). Is gifted education a bright idea? Assessing the impact of gifted and talented programs on achievement (Working Paper No. 17089). Cambridge, MA: National Bureau of Economic Research.

Cappelleri

J. C.

Trochim

W. M. K.

Stanley

T. D.

Reichardt

C. S.

(1991). Random measurement error does not bias the treatment effect estimate in the regression-discontinuity design: I. The case of no interaction. Evaluation Review, 15, 395-419.

Cook

T. D.

(2008). Waiting for life to arrive: A history of the regression- discontinuity design in psychology, statistics, and economics. Journal of Econometrics, 142, 636-654. doi:10.1016/j.econom.2007.05.00210.1016/j.econom.2007.05.002

Cook

T. D.

. (2010). Quasi-experimental research and analysis [Document]. Retrieved from http://www.northwestern.edu/ipr/events/workshops/QEPPTs/QE-Day2.pdf

Cook

T. D.

Wong

V. C.

(2008). Empirical tests of the validity of the regression discontinuity design. Annals of Economics and Statistics, 91/92, 127-150.

Davis

Engberg

Epple

D. N.

Sieg

Zimmer

(2010, September). Evaluating the gifted program of an urban school district using a modified regression discontinuity design (Working Paper No. 16414). Cambridge, MA: National Bureau of Economic Research.

Fan

Nowell

D. L.

(2011). Using propensity score matching in educational research. Gifted Child Quarterly, 55, 74-79. doi:10.1177/001698621039063510.1177/0016986210390635

Gentry

Mann

R. L.

(2009). Total school cluster grouping and differentiation. Mansfield Center, CT: Creative Learning Press.

10.

Goldring

E. B.

(1990). Assessing the status of information on classroom organizational frameworks for gifted students. Journal of Educational Research, 83, 313-326.

11.

Karnes

M. B.

Shwedel

A. M.

Lewis

G. F.

(1983). Short-term effects of early programming for the young gifted handicapped child. Exceptional Children, 50, 103-111.

12.

Lee

S.-Y.

Matthews

M. S.

Olszewski-Kubilius

(2008). A national picture of talent search and talent search educational programs. Gifted Child Quarterly, 52, 55-69. doi:10.1177/ 001698620731115210.1177/ 0016986207311152

13.

Lohman

Gambrell

Lakin

(2008). The commonality of extreme discrepancies in the ability profiles of academically gifted students. Psychology Science Quarterly, 50, 269-282.

14.

Lohman

Renzulli

(2007). A simple procedure for combining ability test scores, achievement test scores, and teacher ratings to identify academically talented children. Retrieved from http://faculty.education.uiowa.edu/dlohman/pdf/Lohman_Renzulli_ID_system.pdf

15.

Marsh

H. W.

(1998). Simulation study of nonequivalent group matching and regression-discontinuity designs: Evaluations of gifted and talented programs. Journal of Experimental Education, 66, 163-192. doi:10.1080/0022097980960140210.1080/00220979809601402

16.

Marsh

H. W.

Chessor

Craven

R. G.

Roche

(1995). The effects of gifted and talented programs on academic self-concept: The big fish strikes again. American Educational Research Journal, 32, 285-319.

17.

Matthews

M. S.

(2008). Talent search programs. In Plucker

J. A.

Callahan

C. M.

(Eds.), Critical issues and practices in gifted education: What the research says (pp. 641-653). Waco, TX: Prufrock Press.

18.

Matthews

M. S.

Gentry

McCoach

D. B.

Worrell

F. C.

Matthews

Dixon

(2008). Evaluating the state of a field: Effect size reporting in gifted education. Journal of Experimental Education, 77, 55-68. doi:10.3200/JXE.77.1.55-6810.3200/JXE.77.1.55-68

19.

Matthews

M. S.

Kirsch

Shaunessy

Fahmy

N. R.

(2007). Diversity within diversity: Understanding our linguistically diverse gifted students. Paper presented at the 2007 annual conference of the National Association for Gifted Children, Minneapolis, MN.

20.

McBee

M. T.

(2010). Modeling outcomes with floor or ceiling effects: An introduction to the Tobit model. Gifted Child Quarterly, 54, 314-320. doi:10.1177/00169862103790910.1177/001698621037909

21.

Merton

R. K.

(1968). The Matthew effect in science. Science, 159, 56-63.

22.

Robinson

Bradley

R. H.

Stanley

T. D.

(1990). Opportunity to achieve: Identifying mathematically gifted Black students. Contemporary Educational Psychology, 15(1), 1-12.

23.

Robinson

Stanley

T. D.

(1989). Teaching to talent: Evaluating an enriched and accelerated mathematics program. Journal for the Education of the Gifted, 12, 253-267.

24.

Schochet

P. Z.

(2009). Statistical power for regression discontinuity designs in educational evaluations. Journal of Educational and Behavioral Statistics, 34, 238-266.

25.

Shadish

W. R.

Cook

T. D.

Campbell

D. T.

(2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.

26.

Shadish

W. R.

Galindo

Wong

V. C.

Steiner

P. M.

Cook

T. D.

(2011). A randomized experiment comparing random and cutoff-based assignment. Psychological Methods, 16, 179-191. doi:10.1037/a002334510.1037/a0023345

27.

Stanley

T. D.

Robinson

(1986). Regression discontinuity: Integrating research and program design in programs for the gifted. Journal for the Education of the Gifted, 9, 181-191.

28.

Trochim

W. M. K.

(1984). Research design for program evaluation: The regression discontinuity approach. Beverly Hills, CA: Sage.

29.

Trochim

W. M. K.

Cappelleri

J. C.

Reichardt

C. S.

(1991). Random measurement error does not bias the treatment effect estimate in the regression-discontinuity design: II. When an interaction effect is present. Evaluation Review, 15, 571-604.

30.

West

S. G.

Biesanz

J. C.

Pitts

S. C.

(2000). Causal inference and generalization in field settings: Experimental and quasi-experimental designs. In Reis

H. T.

Judd

C. M.

(Eds.), Handbook of research methods in social and personality psychology (pp. 40-84). New York, NY: Cambridge University Press.

31.

Wong

V. C.

Cook

T. D.

Barnett

W. S.

Jung

(2008). An effectiveness-based evaluation of five state pre-kindergarten programs. Journal of Policy Analysis and Management, 27, 122-154. doi:10.1002/pam.2031010.1002/pam.20310

32.

Wuensch

K. L.

(2010). Using SPSS to analyze data from a regression- discontinuity design. Retrieved from http://core.ecu.edu/psyc/wuenschk/spss/RegDiscont-SPSS.doc