Although social scientists devote considerable effort to mitigating measurement error during data collection, they often ignore the issue during data analysis. And although many statistical methods have been proposed for reducing measurement error-induced biases, few have been widely used because of implausible assumptions, high levels of model dependence, difficult computation, or inapplicability with multiple mismeasured variables. We develop an easy-to-use alternative without these problems; it generalizes the popular multiple imputation (MI) framework by treating missing data problems as a limiting special case of extreme measurement error and corrects for both. Like MI, the proposed framework is a simple two-step procedure, so that in the second step researchers can use whatever statistical method they would have if there had been no problem in the first place. We also offer empirical illustrations, open source software that implements all the methods described herein, and a companion article with technical details and extensions.
AnsolabehereStephenRoddenJonathanSnyderJames M.. 2008. “The Strength of Issues: Using Multiple Measures to Gauge Preference Stability, Ideological Constraint, and Issue Voting.” American Political Science Review102:215–32.
BernaardsCoen A.BelinThomas R.SchaferJoseph L.. . 2007. “Robustness of a Multivariate Normal Approximation for Imputation of Incomplete Binary Data.” Statistics in Medicine26:1368–82. Retrieved April 1, 2015. (http://dx.doi.org/10.1002/sim.2619).
4.
BlackDan A.BergerMark C.ScottFrank A.. 2000. “Bounding Parameter Estimates with Nonclassical Measurement Error.” Journal of the American Statistical Association95:739–48. Retrieved April 1, 2015. (http://www.jstor.org/stable/2669454).
5.
BlackwellMatthewHonakerJamesKingGary. 2015a. “Replication Data for: A Unified Approach to Measurement Error and Missing Data: Overview.” UNF:5: n/rveBXUX+nOxE6Z5xsWNg==. Retrieved April 1, 2015. (http://dx.doi.org/10.7910/DVN/29606IQSS Data-verse Network [Distributor]).
6.
BlackwellMatthewHonakerJamesKingGary. 2017. “A Unified Approach to Measurement Error and Missing Data: Details and Extensions.” Sociological Methods and Research46:342–69.
7.
BrownstoneDavidVallettaRobert G.. 1996. “Modeling Earnings Measurement Error: A Multiple Imputation Approach.” Review of Economics and Statistics78:705–17.
8.
CarlinBardley P.LouisThomas A.. 2000. Bayes and Empirical Bayes Methods for Data Analysis. 2nd ed. Boca Raton, FL: CRC Press.
CarrollRaymond J.StefanskiLeonard A.. 1990. “Approximate Quasi-likelihood Estimation in Models with Surrogate Predictors.” Journal of the American Statistical Association85:652–63. Retrieved April 1, 2015. (http://www.jstor.org/stable/2290000).
11.
ColeStephen R.ChuHaitaoGreenlandSander. 2006. “Multiple-imputation for Measurement-error Correction.” International Journal of Epidemiology35:1074–81.
12.
CookJ.StefanskiL.. 1994. “Simulation-extrapolation Estimation in Parametric Measurement Error Models.” Journal of the American Statistical Asociation89:1314–28.
13.
EfronBradley. 2013. Large-scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction. Cambridge, UK: Cambridge University Press.
14.
FreedmanLaurence S.MidthuneDouglasCarrollRaymond J.KipnisVictor. 2008. “A Comparison of Regression Calibration, Moment Reconstruction and Imputation for Adjusting for Covariate Measurement Error in Regression.” Statistics in Medicine27:5195–216.
15.
FullerWayne A.1987. Measurement Error Models. New York: Wiley.
16.
Ghosh-DastidarB.SchaferJ. L.. 2003. “Multiple Edit/Multiple Imputation for Multivariate Continuous Data.” Journal of the American Statistical Association98:807–17.
17.
GrahamJohn W.OlchowskiAllison E.GilreathTamika D.. 2007. “How Many Imputations Are Really Needed? Some Practical Clarifications of Multiple Imputation Theory.” Prevention Science8:206–13.
18.
GuoYingLittleRoderick J.. 2011. “Regression Analysis with Covariates that Have Heteroscedastic Measurement Error.” Statistics in Medicine30:2278–94. Retrieved April 1, 2015. (http://dx.doi.org/10.1002/sim.4261).
19.
GuoYingLittleRoderick J.McConnellDaniel S.. 2012. “On Using Summary Statistics from an External Calibration Sample to Correct for Covariate Measurement Error.” Epidemiology23:165–74.
20.
GuoloAnnamaria. 2008. “Robust Techniques for Measurement Error Correction: A Review.” Statistical Methods in Medical Research17:555–80.
21.
HeYuleiZaslavskyAlan M.. 2009. “Combining Information from Cancer Registry and Medical Records Data to Improve Analyses of Adjuvant Cancer Therapies.” Biometrics65:946–52.
22.
HonakerJamesKingGary. 2010. “What to Do About Missing Values in Time Series Cross-section Data.” American Journal of Political Science54:561–81. Retrieved April 1, 2015. (http://gking.harvard.edu/files/abs/pr-abs.shtml).
23.
HonakerJamesKingGaryBlackwellMatthew. 2010. “Amelia II: A Program for Missing Data.” Retrieved April 1, 2015. (http://gking.harvard.edu/amelia).
24.
HonakerJamesPlutzerEric. 2011. “Small Area Estimation with Multiple Overimputation.” Paper presented at the Midwest Political Science Association, Chicago, IL, March 2011.
25.
HopkinsDanielKingGary. 2010. “Improving Anchoring Vignettes: Designing Surveys to Correct Interpersonal Incomparability.” Public Opinion Quarterly1–22. Retrieved April 1, 2015. (http://gking.harvard.edu/files/abs/implement-abs.shtml).
26.
HuckfeldtRobertPlutzerEricSpragueJohn. 1993. “Alternative Contexts of Political Behavior: Churches, Neighborhoods, and Individuals.” Journal of Politics55:365–81.
27.
ImaiKosukeKingGaryLauOlivia. 2008. “Toward a Common Framework for Statistical Analysis and Development.” Journal of Computational Graphics and Statistics17:1–22. Retrieved April 1, 2015. (http://gking.harvard.edu/files/abs/z-abs.shtml).
28.
ImaiKosukeYamamotoTeppei. 2010. “Causal Inference with Differential Measurement Error: Nonparametric Identification and Sensitivity Analysis.” American Journal of Political Science54:543–60.
29.
KatzJonathan N.KatzGabriel. 2010. “Correcting for Survey Misreports Using Auxiliary Information with an Application to Estimating Turnout.” American Journal of Political Science54:815–35.
30.
KingGaryHonakerJamesJosephAnneScheveKenneth. 2001. “Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation.” American Political Science Review95:49–69. Retrieved April 1, 2015. (http://gking.harvard.edu/files/abs/evil-abs.shtml).
31.
KingGaryTomzMichaelWittenbergJason. 2000. “Making the Most of Statistical Analyses: Improving Interpretation and Presentation.” American Journal of Political Science44:341–55. Retrieved April 1, 2015. (http://gking.harvard.edu/files/abs/making-abs.shtml).
32.
KingGaryZengLangche. 2002. “Estimating Risk and Rate Levels, Ratios, and Differences in Case-control Studies.” Statistics in Medicine21:1409–27. Retrieved April 1, 2015. (http://gking.harvard.edu/files/abs/1s-abs.shtml).
33.
KlepperStevenLeamerEdward E.. 1984. “Consistent Sets of Estimates for Regressions with Errors in All Variables.” Econometrica52:163–84. Retrieved April 1, 2015. (http://www.jstor.org/stable/1911466).
34.
LeamerEdward. 1978. Specification Searches. New York: Wiley.
35.
LeeKatherine J.CarlinJohn B.. 2010. “Multiple Imputation for Missing Data: Fully Conditional Specification Versus Multivariate Normal Imputation.” American Journal of Epidemiology171:624–32. Retrieved April 1, 2015. (http://aje.oxfordjournals.org/content/171/5/624.abstract).
36.
LeeSik-Yum. 2007. Structural Equation Modeling: A Bayesian Approach. Vol. 680. New York: John Wiley.
MengXiao-Li. 1994. “Multiple-imputation Inferences with Uncongenial Sources of Input.” Statistical Science9:538–73.
39.
MesserKarenNatarajanLoki. 2008. “Maximum Likelihood, Multiple Imputation and Regression Calibration for Measurement Error Adjustment.” Statistics in Medicine27:6332–50.
40.
NielsenSøren Feodor. 2007. “Proper and Improper Multiple Imputation.” International Statistical Review71:593–607.
41.
RobbinsHerbert. 1956. “An Empirical Bayes Approach to Statistics.” Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability1:157–63.
42.
RobinsJamesWangNaisyin. 2000. “Inference for Imputation Estimators.” Biometrika87:113–24.
43.
RubinDonald B.1976. “Inference and Missing Data.” Biometrika63:581–92.
44.
RubinDonald B.1978. “Bayesian Inference for Causal Effects: The Role of Randomization.” The Annals of Statistics6:34–58.
45.
RubinDonald B.1987. Multiple Imputation for Nonresponse in Surveys. New York: John Wiley.
46.
RubinDonaldSchenkerNathaniel. 1986. “Multiple Imputation for Interval Estimation for Simple Random Samples with Ignorable Nonresponse.” Journal of the American Statistical Association81:366–74.
SchaferJoseph L.Ezzati-RiceTrena M.JohnsonW.KhareMeenaLittleRoderick J. A.RubinDonald B.. 1996. “The NHANES III Multiple Imputation Project.” In Proceedings of the Survey Research Methods Section. Vol. 60, 28–37. Alexandria, VA: The American Statistical Association. Retrieved April 1, 2015. https://www.amstat.org/sections/SRMS/Proceedings/papers/1996_004.pdf.
49.
StefanskiL. A.2000. “Measurement Error Models.” Journal of the American Statistical Association95:1353–58.
50.
WangNaisyinRobinsJames. 1998. “Large-sample Theory for Parametric Multiple Imputation Procedures.” Biometrika85:935–48.
51.
WhiteIan R. 2006. “Commentary: Dealing with Measurement Error: Multiple Imputation or Regression Calibration?” International Journal of Epidemiology35:1081–82. Retrieved April 1, 2015. (http://ije.oxfordjournals.org/content/35/4/1081.short).
