Investigating the Effects of the Household Budget Survey Redesign on Consumption and Inequality Estimates: the Italian Experience

Abstract

In 2014, many innovations were introduced in the Italian Household Budget Survey (HBS) in response to changes in European recommendations and purchasing behaviours and to an increased demand for information in the context of social and economic research. New instruments and techniques have been introduced, together with more accurate methodologies, with the aim of improving the survey, by both reducing the bias and variance of survey estimates and supplying estimation for additional subpopulations and variables. Given the parallel conduction of the former and new HBS in 2013, it has been possible to evaluate the effects of the abovementioned changes on consumption expenditure and inequality estimates and to compare the sample representativeness of selected subpopulations in both surveys.

Keywords

Survey design data quality zero expenditures post-stratification

References

Andreski, P., G. Li, M.Z. Samancioglu, and R. Schoeni. 2014. “Estimates of Annual Consumption Expenditures and Its Major Components in the PSID in Comparison to the CE.” American Economic Review 104(5): 132–135. DOI: https://doi.org/10.1257/aer.104.5.132.

Angrisani, M., A. Kapteyn, and S. Schuh. 2015. “Measuring Household Spending and Payment Habits: The Role of “Typical” and “Specific” Time Frames in Survey Questions.” In Improving the Measurement of Consumer Expenditures, edited by C.D. Carroll, T.F. Crossley, and J. Sabelhaus. NBER Book Series Studies in Income and Wealth, 74: 414–440. Chicago: University Press. DOI: https://doi.org/10.7208/chicago/9780226194714.003.0016.

Bank of Italy. 2018. Annual report for 2017, 124th Financial Year, Rome. Available at: https://www.bancaditalia.it/pubblicazioni/relazione-annuale/2017/en_rel_2017.pdf?language_id=1 (accessed March 2019).

Barrett, G., P. Levell, and K. Milligan. 2015. “A comparison of micro and macro expenditure measures across countries using differing survey methods.” In Improving the Measurement of Consumer Expenditures, edited by C.D. Carroll, T.F. Crossley, and J. Sabelhaus. NBER Book Series Studies in Income and Wealth, 74: 263–286. Chicago: University of Chicago Press. DOI: https://doi.org/10.7208/chicago/9780226194714.003.0010.

Bee, A., B.D. Meyer, and J.X. Sullivan. 2015. “The validity of consumption data: Are the consumer expenditure interview and diary surveys informative?”. In Improving the Measurement of Consumer Expenditures, edited by C.D. Carroll, T.F. Crossley, and J. Sabelhaus. NBER Book Series Studies in Income and Wealth, 74: 204–240. Chicago: University Press. DOI: https://doi.org/10.7208/chicago/9780226194714.003.0008.

Censis. 2012. Crisi: Vivere insieme, vivere meglio. Ricerca Censis-Coldiretti. Centro Studi Investimenti Sociali. Available at: https://www.coldiretti.it/archivio/il-rapporto-coldiretticensis-crisi-vivere-insieme-vivere-meglio (accessed April 2018).

Cifaldi, G. and A. Neri. 2013. “Asking income and consumption questions in the same survey: what are the risks?”. Bank of Italy Economic Working Papers: 908. Available at: https://www.bancaditalia.it/pubblicazioni/temidiscussione/2013/2013-0908/en_tema_908.pdf (accessed March 2018).

Commissione di indagine sulla povertà e sull’emarginazione. 1996. “Le misure della povertà in Italia: scale di equivalenza e aspetti demografici.” Presidenza del Consiglio dei Ministri. Roma. Available at: http://sitiarcheologici.lavoro.gov.it/Documents/Resources/Lavoro/CIES/Scale_equivalenza_1996.pdf (accessed October 2018).

Crossley, T.F. and J.K. Winter. 2015. “Asking Households About Expenditures: What Have We Learned?”. In Improving the Measurement of Consumer Expenditures, edited by C.D. Carroll, T.F. Crossley, and J. Sabelhaus. NBER Book Series Studies in Income and Wealth, 74: 23–50. Chicago: University Press. DOI: https://doi.org/10.7208/chicago/9780226194714.003.0002.

10.

Eurostat. 2003. Household Budget Surveys in the EU. Methodology and Recommendations for Harmonisation–2003. Methods and Nomenclatures. Luxembourg: Eurostat. Available at: http://ec.europa.eu/eurostat/ramon/statmanuals/files/KS-BF-03-003-__-N-EN.pdf (accessed February 2018).

11.

Eurostat. 2013. COICOP Five-Digit – Structure and Explanatory Notes, Unit B5. Luxembourg. Available at: https://www.dst.dk/ext/4197663288/0/pris/COICOP–pdf (accessed February 2018).

12.

Eurostat. 2015. Household Budget Survey, 2010 Wave. EU Quality report. Luxembourg. Available at: http://ec.europa.eu/eurostat/documents/54431/1966394/2015-04-01_QualityReport2010.pdf/418a037a-bfbc-486e-9ff7-4b140b543f39 (accessed February 2018).

13.

Eurostat. 2017. “Transmission, processing and publication of HBS 2015 data.” Paper presented at the Working group on Income and Living Conditions, Household Budget Survey, 28 September 2017. Luxembourg. Available at: https://slideplayer.com/slide/15095624/#.Xp3JyPTpZQ0.gmail (accessed February 2018).

14.

Freguja, C. and C. Romano, eds. 2014. “La modernizzazione delle tecniche di rilevazione nelle indagini socio-economiche sulle famiglie”. Metodi-Letture statistiche Istat Series. ISBN 978-88-458-1806-6. Available at: https://www.istat.it/it/archivio/145721 (accessed March 2018).

15.

Gazzelloni, S., ed. 2006. “La rilevazione sulle forze di lavoro: contenuti, metodologie, organizzazione”. Metodi e Norme Istat Series 32. ISBN 88-458-1357-6. Available at: https://www.istat.it/it/files/2014/06/met_norme_06_32_-rilevazione_forze_lavoro.pdf (accessed February 2018).

16.

Gonzalez, M.J. and J.L. Eltinge. 2010. Sensitivity of Inference under Imputation: An Empirical Study. Available at: https://www.researchgate.net/publication/265893889_Sensitivity_of_Inference_under_Imputation_An_Empirical_Study (accessed April 2018).

17.

Grassi, D. and N. Pannuzi, eds. 2015. “La nuova indagine sulle spese per consumi in Italia”. Metodi-Letture statistiche Istat Series. ISBN 978-88-458-1856-1. Available at: https://www.istat.it/it/archivio/182165 (accessed February 2018).

18.

Istat. 2015. La spesa per consumi delle famiglie. Anno 2014. 8 July 2015. Available at: https://www.istat.it/it/archivio/164313 (accessed February 2018).

19.

Lavallée, P. and J.-F. Beaumont. 2015. “Why We Should Put Some Weight on Weights”. Survey Insights: Methods from the Field, Weighting: Practical Issues and ‘How to’ Approach, Invited article. Available at: https://surveyinsights.org/?p=6255 (accessed March 2019).

20.

Lemmi, A., D. Grassi, A. Masi, N. Pannuzi, and A. Regoli. 2019. “Methodological Choices and Data Quality Issues for Official Poverty Measures: Evidences from Italy”. Social Indicators Research 141(1): 299–330. DOI: https://doi.org/10.1007/s11205-018-1841-3.

21.

Mathiowetz, N.A., C. Brown, and J. Bound. 2002. “Measurement Error in Surveys of the Low-Income Population”. In Studies of Welfare Populations: Data Collection and Research Issues, edited by M. Ver Ploeg, R.A. Moffit, and C.F. Citro: 157–194. DC: National Research Council. DOI: https://doi.org/10.17226/10206.

22.

Mulry, M.H, E.M. Nichols, and J.H. Childs. 2016. “A Case Study of Error in Survey Reports of Move Month Using the U.S. Postal Service Change of Address Records”. Survey Methods: Insights from the Field. DOI: https://doi.org/10.13094/SMIF-2016-00004.

23.

Neter, J. and J. Waksberg. 1964. “A Study of Response Errors in Expenditures Data from Household Interviews”. Journal of the American Statistical Association 59(305): 18–55. DOI: https://doi.org/10.1080/01621459.1964.10480699.

24.

Ngandu, N.K., S. Manda, D. Besada, S. Rohde, N.P. Oliphant, and T. Doherty. 2016. “Does adjusting for recall in trend analysis affect coverage estimates for maternal and child health indicators? An analysis of DHS and MICS survey data”. Glob Health Action 9. DOI: https://doi.org/10.3402/gha.v9.32408.

25.

OECD. 2013. OECD Framework for Statistics on the Distribution of Household Income, Consumption and Wealth. OECD Publishing. Paris. DOI: https://doi.org/10.1787/9789264194830-en.

26.

Osier, G. 2009. “Variance estimation for complex indicators of poverty and inequality using linearization techniques”. Survey Research Methods 3(3): 167–195. DOI: https://doi.org/10.18148/srm/2009.v3i3.369.

27.

Polivka, A.E. and S.M. Miller. 1998. “The CPS after the Redesign: Refocusing the Economic Lens Chapter”. In Labor Statistics Measurement Issues, edited by John Haltiwanger, Marilyn E. Manser, and Robert Topel, 249–289. Chicago: University of Chicago Press.

28.

Raghunathan, T.E., J.M. Lepkowski, J. van Hoewyk, and P. Solenberger. 2001. “A Multivariate Technique for Multiply Imputing Missing Values Using a Sequence of Regression Models”. Survey Methodology 27(1): 85–95. Available at: https://www150.statcan.gc.ca/n1/en/pub/12-001-x/2001001/article/5857-eng.pdf?st=HUdPxONq (accessed June 2019).

29.

Smith, L.C., O. Dupriez, and N. Troubat. 2014. “Assessment of the Reliability and Relevance of the Food Data Collected in National Household Consumption and Expenditure Surveys”. International Household Survey Network Working Paper No. 008. Available at: http://www.ihsn.org/sites/default/files/resources/IHSN_WP008_EN.pdf (accessed April 2018).

30.

UN Statistical Commission. 2018. “Revised Classification of Individual Consumption According to Purpose (COICOP 2018) – Introductory guidelines.” Prepared by the Technical Subgroup for the Revision of COICOP (TSG-COICOP), Statistical Commission Background document, Forty-ninth session 6–9 March 2018. Available at: https://unstats.un.org/unsd/statcom/49th-session/documents/BG-Item3l-Classification-E.pdf (accessed February 2018).

31.

Van den Brakel, J., X-M. Zhang, and S.M. Tam. 2017. “Measuring discontinuities due to survey process redesigns”. CBS discussion paper 2017/13. Statistics Netherlands. Available at: https://www.cbs.nl/en-gb/background/2017/30/measuring-discontinuities-due-to-survey-process-redesigns (accessed February 2018).

32.

Zbikowski, A. and A. Lubich, eds. 2006. “Design and Methodology Current Population Survey U.S. Census Bureau”. Current population Survey Design and Methodology Technical Paper 66. Available at: https://www.census.gov/prod/2006pubs/tp-66.pdf (accessed February 2018).

33.

Zezza, A., C. Carletto, J.L. Fiedler, P. Gennari, and D. Jolliffe. 2017. Food counts. Measuring food consumption and expenditures in household consumption and expenditure surveys (HCES). Introduction to the special issue. Food Policy 72: 1–6. DOI: https://doi.org/10.1016/j.foodpol.2017.08.007.