Abstract
The National Ambulatory Medical Care Survey collects data on office-based physician care from a nationally representative, multistage sampling scheme where the ultimate unit of analysis is a patient-doctor encounter. Patient race, a commonly analyzed demographic, has been subject to a steadily increasing item nonresponse rate. In 1999, race was missing for 17 percent of cases; by 2008, that figure had risen to 33 percent. Over this entire period, single imputation has been the compensation method employed. Recent research at the National Center for Health Statistics evaluated multiply imputing race to better represent the missing-data uncertainty. Given item nonresponse rates of 30 percent or greater, we were surprised to find many estimates’ ratios of multiple-imputation to single-imputation estimated standard errors close to 1. A likely explanation is that the design effects attributable to the complex sample design largely outweigh any increase in variance attributable to missing-data uncertainty.
References
1.
Andridge, R. and Little, R. (2010). A Review of Hot Deck Imputation for Survey Non-Response. International Statistical Review, 78, 40-64, DOI: http://www.dx.doi. org/ 10.1111/j.1751-5823.2010.00103.x.
2.
Cleveland, W. (1979). Robust Locally Weighted Regression and Smoothing Scatterplots. Journal of the American Statistical Association, 74, 829-836, DOI: http://www.dx.doi. org/10.1080/01621459.1979.10481038.
3.
Efron, B. (1994). Missing Data, Imputation, and the Bootstrap. Journal of the American Statistical Association, 89, 463-475, DOI: http://www.dx.doi.org/10.1080/01621459.1994.10476768.
4.
Groves, R., Dillman, D., Eltinge, J., and Little, R., (Eds.) (2002). Survey Nonresponse. New York, NY: Wiley.
5.
Kalton, G. and Kasprzyk, D. (1986). The Treatment of Missing Survey Data. Survey Methodology, 12, 1-16.
6.
Kish, L. (1965). Survey Sampling. New York, NY: Wiley.
7.
Kozak, J. (1995). Underreporting of Race in the National Hospital Discharge Survey. Advance Data from Vital and Health Statistics, No. 265. Hyattsville, MD: National Center for Health Statistics.
8.
Li, Y., Lynch, C., Shimizu, I., and Kaufman, S. (2004). Imputation Variance Estimation by Bootstrap Method for the National Ambulatory Medical Care Survey, Proceedings of the Survey Research Methods Section of the American Statistical Association.
9.
Lohr, S. (1999). Sampling: Design and Analysis. Pacific Grove, CA: Brooks/Cole.
10.
McCarthy, P. and Snowden, C. (1985). The Bootstrap and Finite Population Sampling. Vital Health Statistics, 2(95). Hyattsville, MD: National Center for Health Statistics.
11.
National Center for Health Statistics (2009). 2008 NAMCS Micro-Data File Documentation. Division of Health Care Surveys, National Center for Health Statistics, Centers for Disease Control and Prevention, U.S. Department of Health and Human Services, Hyattsville, MD, Available online at: ftp://ftp.cdc.gov/pub/Health_Statistics/ NCHS/Dataset_Documentation/NAMCS/doc08.pdf (accessed January 2014).
12.
Office of Management and Budget (1997). Revisions to the Standards for the Classification of Federal Data on Race and Ethnicity, Federal Register 62FR58781-58790. Available at: http://www.gpo.gov/fdsys/pkg/FR-1997-10-30/pdf/97-28653.pdf (accessed January 2014).
13.
Raghunathan, T., Lepkowski, J., Van Hoewyk, J., and Solenberger, P. (2001). A Multivariate Technique for Multiply Imputing Missing Values Using a Sequence of Regression Models. Survey Methodology, 27, 85-95.
14.
Reiter, J., Raghunathan, T., and Kinney, S. (2006). The Importance of Modeling the Sampling Design in Multiple Imputation for Missing Data. Survey Methodology, 32, 143-150.
15.
Rubin, D. (1987). Multiple Imputation for Nonresponse in Surveys. New York, NY: Wiley.
16.
Rubin, D. (1996). Multiple Imputation After 18 þ Years (with discussion). Journal of the American Statistical Association, 91, 473-489.
17.
Rubin, D. and Schenker, N. (1986). Multiple Imputation for Interval Estimation from Simple Random Samples with Ignorable Nonresponse. Journal of the American Statistical Association, 81, 366-374, DOI: http://www.dx.doi.org/10.1080/01621459.1986.10478280.
18.
Schenker, N., Borrud, L., Burt, V., Curtin, L., Flegal, K., Hughes, J., Johnson, C., Looker, A., and Mirel, L. (2011). Multiple Imputation of Missing Dual-Energy X-Ray Absorptiometry Data in the National Health and Nutrition Examination Survey. Statistics in Medicine, 30, 260-276, DOI: http://www.dx.doi.org/10.1002/sim.4080.
19.
Shao, J. and Sitter, R. (1996). Bootstrap for Imputed Survey Data. Journal of the American Statistical Association, 91, 1278-1288, DOI: http://www.dx.doi.org/10.1080/01621459.1996.10476997.
20.
Valverde, R. and Marsteller, J. (2007). A Revised Matching Routine for Imputing Missing Race and Ethnicity in the National Ambulatory Medical Care Survey, Unpublished internal manuscript of the National Center for Health Statistics.
21.
Wagner, J. (2010). The Fraction of Missing Information as a Tool for Monitoring the Quality of Survey Data. Public Opinion Quarterly, 74, 233-243, DOI: http://www.dx.doi.org/10.1093/poq/nfq007.