Abstract
A computational approach to optimal multivariate designs with respect to stratification and allocation is investigated under the assumptions of fixed total allocation, known number of strata, and the availability of administrative data correlated with thevariables of interest under coefficient-of-variation constraints. This approach uses a penalized objective function that is optimized by simulated annealing through exchanging sampling units and sample allocations among strata. Computational speed is improved through the use of a computationally efficient machine learning method such as K-means to create an initial stratification close to the optimal stratification. The numeric stability of the algorithm has been investigated and parallel processing has been employed where appropriate. Results are presented for both simulated data and USDA’s June Agricultural Survey. An R package has also been made available for evaluation.
References
1.
Baillargeon, S. and L.-P. Rivest. 2009. “A General Algorithm for Univariate Stratification.” International Statistical Review 77(3): 331-344. Doi: http://dx.doi.org/10.1111/j.1751-5823.2009.00093.x.
2.
Baillargeon, S. and L.-P. Rivest. 2011. “The Construction of Stratified Designs in R with the Package Stratification.” Survey Methodology 37(1): 53-65.
3.
Baillargeon, S. and L.-P. Rivest. 2014. “Stratification: Univariate Stratification of Survey Populations.” Available at: https://CRAN.R-project.org/package¼stratification, r package version 2.2-5 (accessed January 18, 2017).
4.
Ballin, M. and G. Barcaroli. 2013. “Joint Determination of Optimal Stratification and Sample Allocation Using Genetic Algorithm.” Survey Methodology 39(2): 369-393.
5.
Barcaroli, G. 2014. “Sampling Strata: An R Package for the Optimization of Stratified Sampling.” Journal of Statistical Software 61(4): 1-24. Available at: https://www.jstatsoft.org/article/view/v061i04/v61i04.pdf (accessed January 20, 2018).
6.
Benedetti, R., M. Bee, and G. Espa. 2010. “A Framework for Cut-Off Sampling in Business Survey Design.” Journal of Official Statistics 26(4): 651-671.
7.
Benedetti, R., G. Espa, and G. Lafratta. 2008. “A Tree-Based Approach to Forming Strata in Multipurpose Business Surveys.” Survey Methodology (34): 195-203.
8.
Benedetti, R. and F. Piersimoni. 2012. “Multivariate Boundaries of a Self Representing Stratum of Large Units in Agricultural Survey Design.” Survey Research Methods 6: 125-135. Doi: http://dx.doi.org/10.18148/srm/2012.v6i3.5127.
9.
Bethel, J.W. 1986. An Optimum Allocation Algorithm for Multivariate Surveys. Technical report, United States Department of Agriculture, Statistical Reporting Service. Available at: https://naldc.nal.usda.gov/naldc/download.xhtml?id=43260&content=PDF (accessed January 20, 2017).
10.
Boryan, C., Z. Yang, R. Mueller, and M. Craig. 2011. “Monitoring US Agriculture: the US Department of Agriculture, National Agricultural Statistics Service, Cropland Data Layer Program.” Geocarto International 26: 341-358. Doi: http://dx.doi.org/10.1080/10106049.2011.562309.
11.
Brewer, K.R.W. 1963. “Ratio Estimation and Finite Populations: Some Results Deducible from the Assumption of an Underlying Stochastic Process.” Australian Journal of Statistics 5(3): 93-105. Doi: http://dx.doi.org/10.1111/j.1467-842X.1963.tb00288.x.
12.
Dalenius, T. and J.L.J. Hodges. 1959. “Minimum Variance Stratification.” Journal of the American Statistical Association 54: 88-101.
13.
Davies, C. 2009. Area Frame Design for Agricultural Surveys. Technical report, United States Department of Agriculture, National Agricultural Statistics Service. Available at: https://www.nass.usda.gov/Publications/Methodology_and_Data_Quality/Advanced_Topics/AREA%20FRAME%20DESIGN.pdf (accessed January 20, 2018).
14.
Day, C.D. 2009. “Evolutionary Algorithms for Optimal Sample Design.” A paper presented at the 2009 Federal Committee on Statistical Methodology Conference, November 4, 2009. Washington DC: Federal Committee on Statistical Methodology. Available at: https://fcsm.sites.usa.gov/files/2014/05/2009FCSM_Day_XI-A.pdf (accessed January 20, 2018).
15.
Freuder, E.C. and R.J. Wallace. 1992. “Partial Constraint Satisfaction.” Artificial Intelligence 58: 21-70. Doi: https://doi.org/10.1016/0004-3702(92)90004-H.
16.
Gentle, J. and C. Perry. 2000. “Optimal Stratification of Area Frames.” In Proceedings of the second international conference on establishment surveys - II, June 17-21, 2000. 1354-1382. Buffalo, NY: American Statistical Association. Available at: https://ww2.amstat.org/meetings/ices/2000/proceedings/S04.pdf (accessed January 20, 2018).
17.
Gonzalez, J.M. and J.L. Eltinge. 2010. “Optimal Survey Design: A Review.” In Proceedings of the Survey Research Methods Section of the American Statistical Association. Joint Statistical Meeting, October 4, 2010. 4970-83. Vancouver, BC: American Statistical Association. Available at: https://www.bls.gov/osmr/pdf/st100270.pdf (accessed January 20, 2018).
18.
Grafström, A. and J. Lisic. 2016. Balanced Sampling: Balanced and Spatially Balanced Sampling. Available at: https://CRAN.R-project.org/package=BalancedSampling, r package version 1.5.1. (accessed March 8, 2016).
19.
Grafström, A., N.L. Lundstro¨m, and L. Schelin. 2012. “Spatially Balanced Sampling through the Pivotal Method.” Biometrics 68: 514-520. Doi: http://dx.doi.org/10.1111/j.1541-0420.2011.01699.x.
20.
Gunning, P., J. Horgan, and W. Yancey. 2004. “Geometric Stratification of Accounting Data.” Contadurı´a y Administracio´n. Available at: http://www.ejournal.unam.mx/rca/214/RCA21401.pdf (accessed January 20, 2018).
21.
Hajek, B. 1988. “Cooling Schedules for Optimal Annealing.” Mathematics of Operations Research 13(2): 311-329. Doi: https://doi.org/10.1287/moor.13.2.311.
22.
Henderson, D., S.H. Jacobson, and A.W. Johnson. 2003. “The Theory and Practice of Simulated Annealing.” In Handbook of Metaheuristics, edited by F. Glover and G.A. Kochenberger, 287-319. Boston, MA: Springer.
23.
Horgan, J.M. 2006. “Stratification of Skewed Populations: A Review.” International Statistical Review 74: 67-76. Doi: http://dx.doi.org/10.1111/j.1751-5823.2006.tb00161.x.
24.
Ioannidis, E., T. Merkouris, L.-C. Zhang, M. Karlberg, M. Petrakos, F. Reis, and P. Stavropoulos. 2016. “On a Modular Approach to the Design of Integrated Social Surveys.” Journal of Official Statistics 32(2): 259-286. Doi: https://doi.org/10.1515/jos-2016-0013.
25.
Isaki, C.T. and W.A. Fuller. 1982. “Survey Design under the Regression Superpopulation Model.” Journal of the American Statistical Association 77(377): 89-96. Doi: http://dx.doi.org/10.2307/2287773.
26.
Knuth, D.E. 1997. The Art of Computer Programming: Seminumerical Algorithms, volume 2. Addison-Wesley, 3 edition.
27.
Kott, P.S. and J.T. Bailey. 2000. “The Theory and Practice of Maximal Brewer Selection with Poisson PRN Sampling.” In Proceedings of the second international conference on establishment surveys - II, June 17-21, 2000. 269-304. Buffalo, NY: American Statistical Association. Available at: https://ww2.amstat.org/meetings/ices/2000/proceedings/S04.pdf (accessed January 20, 2018).
28.
Kozak, M. 2004. “Optimal Stratification Using Random Search Method in Agricultural Surveys.” Statistics in Transition 6(5): 797-806. Available at: http://omega.sggw.waw.pl/~m.kozak/SIT2004_6_5.pdf (accessed November 16, 2017).
29.
Kozak, M. 2006a. “Multivariate Sample Allocation: Application of Random Search Method.” Statistics in Transition 7(4): 889-900. Available at: https://www.researchgate.net/profile/Marcin_Kozak/publication/242329930_MULTIVARIATE_SAMPLE_ALLOCATION_APPLICATION_OF_RANDOM_SEARCH_METHOD/links/02e7e51cc8ede254cc000000.pdf (accessed November 16, 2017).
30.
Kozak, M. 2006b. “On Sample Allocation in Multivariate Surveys.” Communications in Statistics-Simulation and Computation 35: 901-910. Doi: http://dx.doi.org/10.1080/03610910600880286.
31.
Lavalleé, P. and M. Hidiroglou. 1988. “On the Stratification of Skewed Populations.” Survey Methodology 14: 33-43.
32.
Lisic, J.J. 2016. “saAlloc: Stratification and Allocation of Sampling Units Using Simulated Annealing.” Available at: https://github.com/jlisic/saAlloc, r package version 2.0 (accessed January 20, 2018).
33.
Lisic, J.J., H. Sang, Z. Zhu, and S. Zimmer. 2015. “Optimal Stratification and Allocation for the June Area Survey.” A paper presented at the 2015 Federal Committee on Statistical Methodology Conference, December 2, 2015. Washington, DC: Federal Committee on Statistical Methodology. Available at: https://fcsm.sites.usa.gov/files/2016/03/E2_Lisic_2015FCSM.pdf (accessed January 20, 2018).
34.
Metropolis, N., A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller, and E. Teller. 1953. “Equation of State Calculations by Fast Computing Machines.” The Journal of Chemical Physics 21: 1087-1092. Doi: https://doi.org/10.1063/1.1699114.
35.
R Core Team. 2015. “R: A Language and Environment for Statistical Computing.” R Foundation for Statistical Computing, Vienna, Austria, Available at: https://www.Rproject.org/ (accessed July 1, 2017).
36.
Romeo, F. and A. Sangiovanni-Vincentelli. 1991. “A Theoretical Framework for Simulated Annealing.” Algorithmica 6(1): 302-345. Doi: https://doi.org/10.1007/BF01759049.
37.
Särndal, C.-E., B. Swensson, and J. Wretman. 1991. Model Assisted Survey Sampling. New York: Springer.
38.
Sen, A.R. 1953. “On the Estimate of the Variance in Sampling with Varying Probabilities.” Journal of the Indian Society of Agricultural Statistics 5(1194): 127.
39.
Strenski, P.N. and S. Kirkpatrick. 1991. “Analysis of Finite Length Annealing Schedules.” Algorithmica 6(1): 346-366. Doi: https://doi.org/10.1007/BF01759050.
40.
Valliant, R., F. Hubbard, S. Lee, and C. Chang. 2014. “Efficient Use of Commercial Lists in US Household Sampling.” Journal of Survey Statistics and Methodology 2(2): 182-209. Doi: http://dx.doi.org/10.1093/jssam/smu006.
41.
Zimmer, S., J.-K. Kim, and S. Nusser. 2013. “Automatic Stratification for an Agricultural Area Frame Using Remote Sensing Data.” In Proceedings of the 59th ISI World Statistics Congress, 25-30 August 2013, Hong Kong, 1952-1957 Available at: www.statistics.gov.hk/wsc/STS043-P5-S.pdf (accessed June 12, 2014).