Sage Journals: Discover world-class research

Abstract

We rely a great deal on the schematic descriptions that represent experimental and quasi-experimental design arrangements, as well as the discussions of threats to validity associated with these, provided by Campbell and his associates: Stanley, Cook, and Shadish. Some of these designs include descriptions of treatments removed, removed and then reintroduced, or reversed with use of multiple postobservations. The focus of this article is to consider what happens to the intervention between and among postobservations and how that relates to threats to validity and data modeling and analysis. Evaluation designs must consider such questions as “Has the intervention been removed, or is it still in place? If so, has it changed in intensity, or are there persistence or carryover effects?” This article adds to the evaluation methodology literature by filling a gap regarding the issue of treatment or intervention continuity between and among postobservations.

Keywords

research design validity threats treatment continuity design notation time series

Get full access to this article

View all access options for this article.

References

Allison, D. B. , & Gorman, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single case. Behavior Research and Therapy, 31, 621-631.

Box, G. E. P. , Jenkins, G. M. , & Reinsel, G. C. (1994). Time series analysis: Forecasting and control (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.

Campbell, D. T. , & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research on teaching. In N. L. Gage (Ed.), Handbook of research on teaching (pp. 171-246). Chicago: Rand McNally.

Campbell, D. T. , & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.

Cook, T. D. , & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand McNally.

Mark, M. , Reichardt, C. S. , & Sanna, L. J. (2000). Time series designs and analyses. In H. E. A. Tinsley & S. R. Brown (Eds.), Handbook of applied multivariate statistics and mathematical modeling (pp. 353-389). New York: Academic Press.

McQuaid, J. , Stein, M. , McCahill, M. , Laffaye, C. , & Ramel, W. (2000). Use of brief psychiatric screening measures in a primary care sample. Depression and Anxiety, 12, 21-29.

Mowbray, C. T. , Holter, M. C. , Teague, G. B. , & Bybee, D. (2003). Fidelity criteria: Development, measurement and validation. American Journal of Evaluation, 24, 315-340.

Radloff, L. S. (1977). The CES-D Scale: A self report depression scale for research in the general population. Applied Psychological Measurement, 1, 385-401.

10.

Shadish, W. R. , Cook, T. D. , & Campbell, D. T. (2002). Experimental and quasi-experimental designs. Boston: Houghton-Mifflin.

11.

Tiao, G. C. , & Box, G. E. P. (1981). Modeling multiple time series with applications. Journal of the American Statistical Association, 76, 802-816.

12.

Velicer, W. F. , & Harrop, J. (1983). The reliability and accuracy of time series model identification. Evaluation Review, 7, 551-560.

The Missing Treatment Design Element

Abstract

Keywords

Get full access to this article

References