Abstract
For operations such as a decennial census, the U.S. Census Bureau sends mail to potential respondents inviting a self-response. It is suspected that the mailing strategy affects the distribution of call volumes to the U.S. Census Bureau's telephone helplines. For staffing purposes, more uniform call volumes throughout the week are desirable. In this work, we formulate tests and confidence intervals to compare uniformity of call volumes resulting from competing mailing strategies. Regarding the data as multinomial observations, we compare pairs of call volume observations to determine whether one mailing strategy has multinomial cell probabilities closer to the uniform probability vector compared to another strategy. A motivating illustration is provided by call volume data recorded in three studies which were carried out in advance of the 2020 Decennial Census.
References
1.
Agresti, A. 2013. Categorical Data Analysis . Hoboken, NJ: Wiley, 3rd edition.
2.
Blei, D.M., A. Kucukelbir, and J.D. McAuliffe 2017. “Variational Inference: A Review for Statisticians”. Journal of the American Statistical Association 112: 859–877. DOI: https://dx.doi.org/10.1080/01621459.2017.1285773.
3.
Chesnut, J. 2003. “Telephone Questionnaire Assistance”. Census 2000 Evaluation A.1.a, U.S. Census Bureau. Available at: https://www.census.gov/pred/www/rpts/A.1.a.pdf (accessed June 2022).
4.
Cohen, A., J. Kolassa, and H. Sackrowitz. 2006. “A Test for Equality of Multinomial Distributions vs Increasing Convex Order”. In Recent Developments in Nonparametric Inference and Probability, edited by J. Sun, A. DasGupta, V. Melfi, and C. Page. Lecture Notes–Monograph Series, Volume 50: 156–163. Institute of Mathematical Statistics, Beachwood, OH. DOI: https://dx.doi.org/10.1214/074921706000000662.
5.
Coombs, J. 2017. Analysis Report for the Small-Scale Mailout Testing Program June 2016 Test on the Placement and Length of the User ID for an Online Census Bureau Survey . Census Program Internal Memorandum Series 2017.2.i, U.S. Census Bureau.
6.
Cover, T.M., and J.A. Thomas. 2006. Elements of Information Theory . Hoboken, NJ: Wiley, 2nd edition.
7.
Cressie, N., and T.R. Read. 1984. “Multinomial Goodness-of-Fit Tests”. Journal of the Royal Statistical Society: Series B 46: 440–464. DOI: https://dx.doi.org/10.1111/j.2517-6161.1984.tb01318.x.
8.
Croissant, Y. 2020. “Estimation of Random Utility Models in R: The mlogit Package”. Journal of Statistical Software 95: 1–41. DOI: https://dx.doi.org/10.18637/jss.v095.i11.
9.
Dorfinger, P., G. Panholzer, and W. John. 2011. “Entropy Estimation for Real-Time Encrypted Traffic Identification (Short Paper)”. In Traffic Monitoring and Analysis , edited by J. Domingo-Pascual, Y. Shavitt, and S. Uhlig: 164–171. Berlin, Heidelberg. Springer. DOI: https://dx.doi.org/10.1007/978-3-642-20305-3_14.
10.
Eggleston, C., and J. Coombs. 2018. Effect of Data Use Statements and Postcard Format on Login Rates for a Mandatory Online Census Bureau Survey . U.S. Census Program Internal Memorandum Series 2018.11.i, U.S. Census Bureau.
11.
Girardin, V., and J. Lequesne. 2019. “Entropy-Based Goodness-of-Fit Tests–A Unifying Framework: Application to DNA Replication”. Communications in Statistics–Theory and Methods 48: 62–74. DOI: https://dx.doi.org/10.1080/03610926.2017.1401084.
12.
Konishi, S., and G. Kitagawa. 2008. Information Criteria and Statistical Modeling . New York, NY: Springer.
13.
Lehmann, E.L. 2004. Elements of Large-Sample Theory . New York, NY: Springer.
14.
Li, Y., R.S. Singh, and Y. Sun. 2005. “Goodness-of-Fit Tests of a Parametric Density Functions: Monte Carlo Simulation Studies”. Journal of Statistical Research 39: 103–125. Available at: http://jsr.isrt.ac.bd/article/goodness-fit-tests-parametric-density-functions-monte-carlo-simulation-studies/.
15.
Liu, X., and J. Wang. 2004. “Testing the Equality of Multinomial Populations Ordered by Increasing Convexity Under the Alternative”. Canadian Journal of Statistics 32: 159–168. DOI: https://dx.doi.org/10.2307/3315939.
16.
Marasteanu, I. 2019. “The Research and Methodology on Staggering the 2020 Census Mailings”. In JSM Proceedings, Government Statistics Section: 2457 – 2467. Alexandria, VA: American Statistical Association.
17.
Nichols, E., S. Konya, R. Horwitz, and A. Raim. 2019. 2020 Census Research and Testing Report: The Effect of the Mail Delivery Date on Survey Login Rates and Helpline Call Rates . U.S. Census Bureau, Research and Methodology Directorate, Center for Behavioral Science Methods Research Report Series (Survey Methodology): 2019–01, U.S. Census Bureau. Available at: https://www.census.gov/content/dam/Census/library/working-papers/2019/adrm/rsm2019-01.pdf (accessed June 2022).
18.
Ormerod, J.T., and M.P. Wand. 2010. “Explaining Variational Approximations”. The American Statistician 64: 140–153. DOI: https://dx.doi.org/10.1198/tast.2010.09058.
19.
Paninski, L. 2008. “A Coincidence-Based Test for Uniformity Given Very Sparsely Sampled Discrete Data”. IEEE Transactions on Information Theory 54: 4750–4755. DOI: https://dx.doi.org/10.1109/TIT.2008.928987.
20.
Pardo, L. 2006. Statistical Inference Based on Divergence Measures . Boca Raton, FL: Chapman and Hall/CRC.
21.
R Core Team. 2022. R: A Language and Environment for Statistical Computing . R Foundation for Statistical Computing, Vienna, Austria. Available at: https://www.R-project.org/.
22.
Song, K.S. 2002. “Goodness-of-Fit Tests Based on Kullback-Leibler Discrimination Information”. IEEE Transactions on Information Theory 48: 1103–1117. DOI: https://dx.doi.org/10.1109/18.995548.
23.
U.S. Census Bureau. 2017. 2020 Census Operational Plan . Available at: https://www.census.gov/programs-surveys/decennial-census/2020-census/planning-management/planning-docs/operational-plan.html. Version 3.0. (accessed June 2022).
24.
Vuong, Q.H. 1989. “Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses”. Econometrica 57: 307–333. DOI: https://dx.doi.org/10.2307/1912557.
25.
Westfall, P.H., R.D. Tobias, and R.D. Wolfinger. 2011. Multiple Comparisons and Multiple Tests Using SAS . Cary, NC: SAS Institute, Inc., 2nd edition.
26.
Zajac, K. 2012. 2010 Census Telephone Questionnaire Assistance Assessment Report . 2010 Census Planning Memoranda Series No. 231, U.S. Census Bureau. Available at: https://www.census.gov/2010census/pdf/2010_Census_TQA_Assessment.pdf (accessed June 2022).