A Distance Metric for Modeling the Quality of Administrative Records for Use in the 2020 U.S. Census

Abstract

The U.S. Census Bureau is conducting research on using administrative records to reduce the cost while maintaining the quality of the 2020 Census Nonresponse Followup (NRFU). Previous census tests have implemented approaches that use predictive models and optimization procedures to identify vacant and occupied housing units using administrative records. This article details a modification to previous approaches, introducing a simple distance metric to define a quality ranking of housing units to enumerate using administrative records. The distance approach is illustrated, assessed, and compared to a previous approach via a retrospective study of the 2010 U.S. Census.

Keywords

2020 Census administrative records nonresponse followup

References

Alvey, W. and F. Scheuren. 1982. “Background for an Administrative Record Census.” in JSM Proceedings, Social Statistics Section, American Statistical Association, Cincinnati, OH, August 16–19, 1982. Washington, DC: American Statistical Association. 137–152.

Bakker, B.F.M., P.G.M. van Heijden, and S. Scholtus. 2015. “ “Preface” to a Special Issue on Coverage Problems in Administrative Sources.” Journal of Official Statistics 31(3): 349–355. Doi: http://dx.doi.org/10.1515/jos-2015-0021.

Brackstone, G.J. 1987. “Issues in the Use of Administrative Records for Statistical Purposes.” Survey Methodology 13(1): 29–43. Available at: http://www.statcan.gc.ca/pub/12-001-x/1987001/article/14467-eng.pdf (accessed November 2017).

Chapin, M. and A. Keller. 2017. “Administrative Records Research and Planning, 2018 End-to-End Census Test: Nonresponse Followup.” from 2020 Census Program Management Review–April 21, 2017. Available at: https://www2.census.gov/programs-surveys/decennial/2020/program-management/pmr-materials/04-21-2017/pmr-update-testing-2017-04-21.pdf (accessed November 2017).

Chesnut, J. 2013. “Model-Based Mode Switching from Internet to Mail in the American Community Survey.” DSSD 2013 American Community Survey Memorandum Series #ACS13-MP-01. Available at: https://census.gov/content/dam/Census/library/working-papers/2013/acs/2013_Chesnut_01.pdf (accessed November 2017).

Chow, M.C., H.P. Janicki, M.J. Kutzbach, L.F. Warren, and M. Yi. 2017. “A Comparison of Training Modules for Administrative Records Use in Nonresponse Followup Operations: The 2010 Census and the American Community Survey.” Center for Economic Studies Working Paper #CES 17-47. Washington, DC: U.S. Census Bureau. Available at: https://www2.census.gov/ces/wp/2017/CES-WP-17-47.pdf (accessed November 2017).

Cresce, A. 2012. “Evaluation of Gross Vacancy Rates From the 2010 Census Versus Current Surveys: Early Findings from Comparisons with the 2010 Census and the 2010 ACS 1-Year Estimates.” Federal Committee on Statistical Methodology 2012 Research Conference, Washington, DC, January 10–12, 2012. Available at: https://www.census.gov/housing/files/FCSM%20paper.pdf (accessed November 2017).

Ennis, S.R., S.R. Porter, J.M. Noon, and E. Zapata. 2015. “When Race and Hispanic Origin Reporting are Discrepant Across Administrative Records and Third Party Sources: Exploring Methods to Assign Responses.” Center for Administrative Records Research and Applications Working Paper #2015-08. Washington, DC: U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/library/working-papers/2015/adrm/carra-wp-2015-08.pdf (accessed November 2017).

Federal Committee of Statistical Methodology. 1980. “Report on Statistical Uses of Administrative Records.” Working Paper 6, Washington, DC. Available at: https://s3.amazonaws.com/sitesusa/wp-content/uploads/sites/242/2014/05/spwp6.pdf (accessed November 2017).

10.

Fienberg, S.E. 2015. “Discussion” of a Special Issue on Coverage Problems in Administrative Sources. Journal of Official Statistics 31(3): 527–535. Doi: http://dx.doi.org/10.1515/jos-2015-0032.

11.

Groves, R.M. and B.A. Harris-Kojetin (editors), National Academies of Sciences, Engineering, and Medicine (2017). Innovations in Federal Statistics: Combining Data Sources While Protecting Privacy. Washington DC: The National Academies Press.

12.

Japec, L., F. Kreuter, M. Berg, P. Biemer, P., Decker, C. Lampe, J. Lane, C. O’Neil, and A. Usher. 2015. “AAPOR Report on Big Data: Report of the AAPOR Big Data Task Force.” Available at: http://www.aapor.org/AAPOR_Main/media/Task-Force-Reports/BigDataTaskForceReport_FINAL_2_12_15_b.pdf (accessed November 2017).

13.

Keller, A. 2016. “Imputation Research for the 2020 Census.” Statistical Journal of the International Association of Official Statistics 32: 189–198. Doi: http://dx.doi.org/10.3233/SJI-161009.

14.

Keller, A., T. Fox, and V.T. Mule. 2016. “2014 Census Test – Analysis of Administrative Record Usage.” U.S. Census Bureau. Available at: https://www2.census.gov/programs-surveys/decennial/2020/program-management/final-analysis-reports/2020-analysis-2014-census-test-ad-rec.pdf (accessed November 2017).

15.

Keller, A. and S. Konicki. 2016. “Using 2010 Census Coverage Measurement Results to Better Understand Possible Administrative Records Incorporation in the Decennial Census.” in JSM Proceedings, Survey Research Methods Section, American Statistical Association, Chicago, IL, July 30–August 4, 2016. Alexandria, VA: American Statistical Association. 701–710. Available at: https://ww2.amstat.org/sections/srms/Proceedings/y2016/files/389544.pdf (accessed November 2017).

16.

Kingkade, W. 2013. “Self-assessed Housing Values in the American Community Survey: An Exploratory Evaluation Using Linked Real Estate Records.” in JSM Proceedings, Government Statistics Section, American Statistical Association, Montreal, Quebec, Canada, August 3-8, 2013. Alexandria, VA: American Statistical Association. 990–1004. Available at: https://ww2.amstat.org/MembersOnly/proceedings/2013/data/assets/handouts/308063_80215.pdf (accessed November 2017).

17.

Layne, M., D. Wagner, and C. Rothhaas. 2014. “Estimating Record Linkage False Match Rate for the Person Identification Validation System.” Center for Administrative Records Research and Applications Working Paper #2014-02. Washington, DC: U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/library/working-papers/2014/adrm/carra-wp-2014-02.pdf (accessed November 2017).

18.

Maris, M., E.S. Nordholt, and J. van Zeijl. 2012. “Comparing Approaches of Different (Partly) Register-based Countries.” from the United Nations Economic Commission for Europe Conference of European Statisticians: UNECE-Eurostat Expert Group Meeting on Censuses Using Registers. Available at: www.unece.org/fileadmin/DAM/stats/documents/ece/ces/ge.41/2012/use_of_register/WP_3_Netherlands.pdf (accessed November 2017).

19.

Moore, B. 2015. “Preliminary Research for Replacing or Supplementing the Year Built Question on the American Community Survey with Administrative Records.” U.S. Census Bureau Working Paper. Available at: www.census.gov/library/working-papers/2015/acs/2015_Moore_02.html (accessed November 2017).

20.

Morris, D.S. 2014. “A Comparison of Methodologies for Classification of Administrative Records Quality for Census numeration.” in JSM Proceedings, Survey Research Methods Section, American Statistical Association, Boston, MA, August 2–7, 2014. Alexandria, VA: American Statistical Association. 1729–1743. Available at: https://ww2.amstat.org/sections/srms/Proceedings/y2014/files/311864_88281.pdf (accessed November 2017).

21.

Morris, D.S. 2017. “A Modeling Approach for Administrative Records Enumeration in the Decennial Census.” Public Opinion Quarterly: Special Issue on Survey Research, Today and Tomorrow 81(S1): 357–384. Doi: http://dx.doi.org/10.1093/poq/nfw059.

22.

Morris, D.S., A. Keller, and B. Clark. 2016. “An Approach for Using Administrative Records to Reduce Contacts in the 2020 Census.” Statistical Journal of the International Association of Official Statistics 32: 177–188. Doi: http://dx.doi.org/10.3233/SJI-161002.

23.

Mule, V.T. and A. Keller. 2014. “Using Administrative Records to Reduce Nonresponse Followup Operations.” in JSM Proceedings, Survey Research Methods Section, American Statistical Association, Boston, MA, August 2–7, 2014. Alexandria, VA: American Statistical Association. 3601–3608. Available at: https://ww2.amstat.org/sections/srms/Proceedings/y2014/files/313148_90659.pdf (accessed November 2017).

24.

Mule, T. and S. Konicki. 2012. “2010 Census Coverage Measurement Estimation Report: Summary of Estimates of Coverage for Housing Units.” DSSD 2010 Census Coverage Measurement Memorandum Series #2010-G-02. https://www.census.gov/coverage_measurement/pdfs/g02.pdf (accessed November 2017).

25.

Mulry, M.H. 2014. “Measuring Undercounts for Hard-to-Survey Groups.” In Hard-to-Survey Populations (Chapter 3), edited by R. Tourangeau, N. Bates, B. Edwards, T. Johnson, and K. Wolter. Cambridge, England: Cambridge University Press. 37–57.

26.

O’Hara, A., A. Bee, and J. Mitchell. 2016. “Preliminary Research for Replacing or Supplementing the Income Question on the American Community Survey with Administrative Records.” U.S. Census Bureau Working Paper. Available at: www.census.gov/content/dam/Census/library/working-papers/2016/acs/2016_Ohara_01.pdf (accessed November 2017).

27.

Rastogi, S. and A. O’Hara. 2012. “2010 Census Match Study Report.” 2010 Census Planning Memorandum Series. Available at: https://www.census.gov/2010census/pdf/2010_Census_Match_Study_Report.pdf (accessed November 2017).

28.

Ruggles, P. 2015. “Review of Administrative Record Sources Relevant to the American Community Survey.” U.S. Census Bureau Working Paper. Available at: www.census.gov/library/working-papers/2015/acs/2015_Ruggles_01.html (accessed November 2017).

29.

Scheuren, F. 1999. “Administrative Records and Census Taking.” Survey Methodology 25(2): 151–160. Available at: http://www.statcan.gc.ca/pub/12-001-x/1999002/article/4878-eng.pdf?contentType=application%2Fpdf (accessed November 2017).

30.

Steffey, D.L. and N.M. Bradburn (editors), National Research Council. 1994. Counting People in the Information Age. Washington DC: The National Academies Press.

31.

Stempowski, D. 2015. “Agility in Action: A Snapshot of Enhancements to the American Community Survey.” ACS Information Series Memorandum Number 2015-05. Available at: https://www.census.gov/content/dam/Census/programs-surveys/acs/operations-and-administration/2015-16-survey-enhancements/Agility%20in%20Action%20v2.0.pdf (accessed November 2017).

32.

Thygesen, L. 2015. “The Use of Administrative Sources for Censuses: Merits and Challenges.” Statistical Journal of the IAOS 31(3): 381–389. Doi: http://dx.doi.org/10.3233/SJI-150909.

33.

United Nations Economic Commission for Europe (UNECE). 2011. Using Administrative and Secondary Sources for Official Statistics: A Handbook of Principles and Practices. United Nations Publication. www.unece.org/fileadmin/DAM/stats/publications/Using_Administrative_Sources_Final_for_web.pdf (accessed November 2017).

34.

United States Census Bureau. 2017a. 2020 Census Operational Plan: Version 3.0. Washington DC: Census Bureau. Available at: http://www2.census.gov/programs-surveys/decennial/2020/program-management/planning-docs/2020-oper-plan3.pdf (accessed November 2017).

35.

United States Census Bureau. 2017b. “Administrative Records Modeling Update for the Census Scientific Advisory Committee.” Presented at the Census Scientific Advisory Committee Meeting–March, 30, 2017. Available at: https://www2.census.gov/cac/sac/meetings/2017-03/admin-records-modeling.pdf (accessed November 2017).

36.

United States Office of Management and Budget. 2014. M-14-06: Guidance for Providing and Using Administrative Data for Statistical Purposes. Available at: https://obama-whitehouse.archives.gov/sites/default/files/omb/memoranda/2014/m-14-06.pdf (accessed November 2017).

37.

van Zeijl, J. 2014. “From Traditional to Register-Based Censuses in the Netherlands.” from the National Academies of Science: International Conference on Census Methods. Available at: https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_088800.pdf (accessed November 2017).

38.

Wagner, D. and M. Layne. 2014. “The Person Identification Validation System (PVS): Applying the Center for Administrative Records Research and Applications’ (CARRA) Record Linkage Software.” Center for Administrative Records Research and Applications Working Paper #2014-01. Washington, DC: U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/library/working-papers/2014/adrm/carra-wp-2014-01.pdf (accessed November 2017).

39.

Walejko, G., A. Keller, G. Dusch, and P.V. Miller. 2014. “2020 Research and Testing: 2013 Census Test Assessment.” U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/programs-surveys/decennial/2020-census/2013_Census_Test_Assessment_Final.pdf (accessed November 2017).

40.

Walker, S., S. Winder, G. Jackson, and S. Heimel. 2012. “2010 Census Nonresponse Followup Operations Assessment.” 2010 Census Planning Memoranda Series, No. 190, April 30, 2012. Available at: https://www.census.gov/2010census/pdf/2010_Census_NRFU_Operations_Assessment.pdf (accessed November 2017).

41.

Wallgren, A. and B. Wallgren. 2007. Register-based Statistics: Administrative Data for Statistical Purposes. New York: John Wiley and Sons.