A time series evaluation design of use in analyzing certain kinds of "case-flow "programs is
described. Because it combines features of both conventional time-series designs and
nonequivalent comparison group quasi-experiments, we refer to it as a "pseudo-time
series" or PTS design. Statistically, PTS designs resemble replicated surveys that
independently sample some population at successive time points. The substantive analogy
is a program that services a rapidly changing clientele the members of which usually enter
and exit the program on only one occasion. This article describes the distinguishing
features of PTS designs, outlines a methodological strategy for analyzing PTS data, and
shows how this strategy can be used to overcome design weaknesses in certain case-flow
evaluation studies.
Get full access to this article
View all access options for this article.
References
1.
Bergner, L., M. Eisenberg, A. Hallstrom, and L. Becker (1981) Evaluation of Paramedic Services for Cardiac Arrest. NCHSR Research Report Series, Publication (PHS) 82-3310Washington, DC: Department of Health and Human Services .
2.
Berk, R.A. et al. (1979) "Estimation procedures for pooled cross-sectional and time series data."Evaluation Q.3: 385-410.
3.
Box, G.E.P. and G.C. Tiao (1975) "Intervention analysis with applications to economic and environmental problems."J. of the Amer. Statistical Assn. 70: 70-79.
4.
Campbell, D.T. and J.C. Stanley (1963) Experimental and Quasi-Experimental Designs for ResearchBoston: Houghton Mifflin .
5.
Cameron, A.C. and P.K. Trivedi (1986) "Econometric models based on count data: Comparisons and applications of some estimators and tests."J. of Applied Econometrics1: 29-53.
6.
Cook, T.D. and D.T. Campbell (1979) Quasi-Experimentation: Design and Analysis Issues for Field SettingsChicago: Rand McNally.
7.
Davis, J.A. (1978) "Studying categorical data over time."Social Sci. Research7: 151-179.
8.
Forthofer, R.N. and R.G. Lehnen (1981) Public Program Analysis: A New Categorical Data ApproachBelmont, CA: Lifetime Learning Publications.
9.
Fox, J. ( 1984) "Detecting changes of level and slope in repeated measures data."Soc. Methods and Research12: 263-277.
10.
Glass, G.V., V.L. Willson, and J.M. Gottman (1975) Design and Analysis of Time-Series ExperimentsBoulder: Colorado Associated University Press.
11.
Goldstone, D.E. (1981) "Foreword," in L. Bergner et al. (eds.) Evaluation of Paramedic Services for Cardiac Arrest. NCHSR Research Report Series Publication (PHS) 82-3310. Washington, DC: Department of Health and Human Services.
12.
Goodman, L. (1975) "The relationship between modified and usual multiple-regression approaches to the analysis of dichotomous variables," pp. 83-110 in D. Heise (ed.) Sociological Methodology 1976.San Francisco: Jossey-Bass.
13.
Grizzle, J.E., C.F. Starmer, and G.G. Koch (1969) "Analysis of categorical data for linear models."Biometrics25: 489-504.
14.
Judd, C.M. and D.A. Kenny (1981) Estimating the Effects of Social InterventionsNew York: Cambridge Univ. Press .
15.
Kenny, D.A. (1979) Correlation and CausalityNew York: John Wiley.
16.
Kritzer, H.M. (1979) "Approaches to the analysis of complex contingency tables."Soc. Methods and Research7: 305-329.
17.
Landis et al. (1976) "A computer program for the generalized chi-square analysis of categorical data using weighted least squares (GENCAT)."Computer Programs in Biomedicine6: 196-231.
18.
Mark, M.M. and T.D. Cook (1984) "Design of randomized experiments and quasi-experiments," pp. 65-120 in L. Rutman (ed.) Evaluation Research Methods.Beverly Hills, CA: Sage.
19.
McCleary, R. and R.A. Hay (1980) Applied Time Series Analysis for the Social SciencesBeverly Hills, CA: Sage.
20.
Newcomer, K.E. and R.J. Hardy (1980) "Analyzing policy impact: selection of a linear trend model."Policy Studies J.8: 928-941.
21.
Reichardt, C.S. (1979) "The statistical analysis of data from nonequivalent group designs, "pp. 147-206 in T. D. Cook and D. T. Campbell(eds.)Quasi-Expenmentation: Design and Analysis Issues for Field Settings.Chicago : Rand McNally.
22.
Reynolds, H.T. (1977) The Analysis of Cross-ClassificationsNew York: Free Press.
23.
SAS Institute (1985) SAS User's Guide: StatisticsCary, NC: Author .
24.
Sawyer, D. (1984) "Apple-GSK: a micro-computer's guide to impact assessment using the Grizzle-Starmer-Koch approach." Unpublished manuscript, Baltimore, MD.
