Missing data, especially when coupled with noncompliance, are a challenge even in the setting of randomized experiments. Although some existing methods can address each complication, it can be difficult to handle both of them simultaneously. This is true in the example of the New York City School Choice Scholarship Program, where both the covariates and the outcomes were sometimes missing, and there was complicated noncompliance. The authors propose a modified general location model to integrate the ideas of missing data techniques and principal stratification and then analyze the same data as in Barnard, Frangakis, Hill, and Rubin (2003), where a pattern-mixture model was used. Their results are presented and compared with those in Barnard et al.
AngristJ. D.ImbensG. W.RubinD. B. (1996).
Identification of causal effects using instrumental variables (with discussion). Journal of the American Statistical Association, 91, 444–472.
2.
BarnardJ.FrangakisC. E.HillJ. L.RubinD. B. (2003).
Principal stratification approach to broken randomized experiments: A case study of School Choice vouchers in New York City. Journal of the American Statistical Association, 98, 288–311.
3.
BishopY. M. M.FienbergS. E.HollandP. W. (1975).
Discrete multivariate analysis: Theory and practice. Cambridge, MA: MIT Press.
4.
CookS. R.GelmanA.RubinD. B. (2006).
Validation of Software for Bayesian Models using posterior quantiles. Journal of Graphical and Computational Statistics, 15, 675–692.
5.
DempsterA. P.LairdN. N.RubinD. B. (1977).
Maximum likelihood from incomplete data via EM algorithm. Journal of the Royal Statistical Society Series B-Methodological, 39, 1–38.
6.
FrangakisC. E.RubinD. B. (1999).
Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment-noncompliance and subsequent missing outcomes. Biometrika, 86, 365–379.
7.
FrangakisC. E.RubinD. B. (2002).
Principal stratification in causal inference. Biometrics, 58, 20–29.
8.
FrangakisC. E.RubinD. B.ZhouX. H. (2002).
Clustered encouragement designs with individual noncompliance: Bayesian inference with randomization, and application to advance directive forms. Biostatistics, 3, 147–164.
9.
GelmanA.CarlinJ. B.SternH. S.RubinD. B. (2004).
Bayesian data analysis.
(2nd ed.). Boca Raton: Chapman & Hall/CRC.
10.
GelmanA.RubinD. B. (1992).
Inference from iterative simulation using multiple sequences (with discussion). Statistical Science, 7, 457–511.
11.
HaavelmoT. (1943).
The statistical implications of a system of simultaneous equations. Econometrica, 11, 1–12.
12.
HillJ. L.RubinD. B.ThomasN. (2002).
The design of the New York school choice scholarship program evaluation. In
BickmanL.(Ed.),
Donald Campbell’s legacy (pp. 155–180). London: Sage Publications.
13.
HiranoK.ImbensG. W.RubinD. B.ZhouX. -H. (2000).
Assessing the effect of an influenza vaccine in an encouragement design. Biostatistics, 1, 69–88.
14.
HollandP. (1986).
Statistics and causal inference. Journal of the American Statistical Association, 81, 945–970.
15.
ImbensG. W.RubinD. B. (1997).
Bayesian inference for causal effects in randomized experiments with noncompliance. Annals of Statistics, 25, 305–327.
16.
JinH.RubinD. B. (2008).
Principal stratification for causal inference with extended partial compliance. Journal of the American Statistical Association, 103, 101–111.
17.
JinH.RubinD. B. (2009).
Public schools versus private schools: Causal inference with partial compliance. Journal of Educational and Behavioral Statistics, 34, 24–45.
18.
KruegerA. B.ZhuP. (2004).
Another look at the New York city school voucher experiment. American Behavioral Scientist, 47, 658–698.
19.
LittleR. J. A.RubinD. B. (2002).
Statistical analysis with missing data.
(2nd ed.). New York: Wiley.
20.
MengX.-L.RubinD. B. (1993).
Maximum likelihood estimation via the ECM algorithm: A general framework. Biometrika, 80, 267–278.
21.
NeymanJ. (1923). On the application of probability to agricultural experiments. Essay on principles. Section 9. Roczniki Nauk RolniczychTom X (Poland). Statistical Science, 5, 465–480(Translated in 1990).
22.
PetersonP. E.MyersD. E.HowellW. G.MayerD. P. (1999).
The effects of school choice in New York City. In
MayerS. E.PetersonP. E. (Eds.),
Earning and learning; how schools matter (pp. 317–337).Washington: Brookings Institution Press.
23.
RosenbaumP. R.RubinD. B. (1983).
The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55.
24.
RubinD. B. (1974).
Characterizing the estimation of parameters in incomplete data problems. Journal of the American Statistical Association, 69, 467–474.
25.
RubinD. B. (1978).
Bayesian inference for causal effects: The role of randomization. The Annals of Statistics, 6, 34–58.
26.
RubinD. B. (1979).
Using multivariate matched sampling and regression adjustment to control bias in observational studies. Journal of the American Statistical Association, 74, 318–328.
27.
RubinD. B. (1980).
Randomization analysis of experimental-data—the Fisher randomization test—comment. Journal of the American Statistical Association, 75, 591–593.
28.
RubinD. B. (1987).
The calculation of posterior distributions by data augmentation—Comment. Journal of the American Statistical Association, 82, 543–546.
29.
RubinD. B. (1990).
Comment: Neyman (1923) and causal inference in experiments and observational studies. Statistical Science, 5, 472–480.
30.
RubinD. B. (2004).
Direct and indirect causal effects via potential outcomes. Scandinavian Journal of Statistics, 31, 161–170.
31.
SchaferJ. L. (1997).
Analysis of incomplete multivariate data. Boca Raton, FL: Chapman & Hall/CRC.
32.
TannerM. A.WongW. H. (1987).
An application of imputation to an estimation problem in grouped lifetime analysis. Technometrics, 29, 23–32.
33.
TinbergenJ. (1930).
Determination and interpretation of supply curves: An example. In
HendryD.MorganM.(Eds.),
The foundations of econometric analysis (pp. 233–248). Cambridge University Press.(Reprinted from Zeitschrift fur Nationalokonomie).
34.
ZhangJ.RubinD. B. (2003).
Estimation of causal effects via principal stratification when some outcomes are truncated by “death.”Journal of Educational and Behavioral Statistics, 28, 353–368.
