Are All Quality Dimensions of Equal Importance when Measuring the Perceived Quality of Official Statistics? Evidence from Spain

Abstract

Quality has become the key concept in official statistics. There is a general consensus that we have to consider several components when assessing the quality of statistical information. Relevance, accuracy, timeliness, punctuality, comparability, coherence, accessibility and clarity are the dimensions most frequently mentioned. In this article we use regression analysis to evaluate the contribution of these different dimensions when assessing the overall quality of statistical products. We do this using the information collected in the structured consultation with users and experts from both inside and outside the Spanish Central Administration carried out by the Working Group of the Spanish High Council on Statistics, responsible for the preliminary draft of the proposals and recommendations of this council for the Spanish Multiannual Statistical Programme 2013-2016. We find that the abovementioned dimensions have different weights in the overall assessment of perceived quality (with accuracy and reliability having the highest weight, and relevance having the lowest) and that the structure differs between both types of users.

Keywords

Quality dimensions consultation weight regression

References

Brackstone, G. 1999. “Managing Data Quality in a Statistical Agency.” Survey Methodology 25:139-149.

Brackstone, G. 2001. “How Important is Accuracy?” In Proceedings of Statistics Canada Symposium 2001, “Achieving Data Quality in a Statistical Agency: A Methodological Perspective”. Available at: http://www.statcan.gc.ca/pub/11-522-x/2001001/session24/ 6311-eng.pdf (accessed February 4, 2013).

Castles, I. 1991. “Responding to Users’ Needs.” Journal of the Royal Statistical Society (Series A) 154:6-10.

Ehling, M. and T. Ko¨rner. 2007. Handbook on Data Quality Assessment Methods and Tools. European Commission, Eurostat.

European Statistical System 2001. “Quality Declaration of the European Statistical System.” Statistical Programme Committee, September 20, 2001. Available at: http://epp.eurostat.ec.europa.eu/portal/page/portal/quality/documents/DECLARATIONS.pdf (accessed May 20, 2014).

European Statistical System 2011. “European Statistics Code of Practice.” European Statistical System Committee, September 28, 2011. Available at: http://epp.eurostat.ec.europa.eu/portal/page/portal/product_details/publication?p_product_code=KS-32-11-955 (accessed May 20, 2014).

Eurostat 2002. “Quality in the European Statistical System. The Way Forward”. Luxembourg: Office for Official Publications of the European Communities.

Eurostat 2003. “Methodological Documents - Definition of Quality in Statistics.” Sixth meeting of the Working Group “Assessment of Quality in Statistics”, Luxembourg, Available at: http://epp.eurostat.ec.europa.eu/portal/page/portal/quality/documents/ess%20quality%20definition.pdf (accessed May 20, 2014).

Fellegi, I.P. 1991. “Maintaining Public Confidence in Official Statistics.” Journal of the Royal Statistical Society (Series A) 154:1-6.

10.

Giovannini, E., J. Oliveira Martins, and M. Gamba. 2009. “Statistics, Knowledge and Governance.” Statistika 6:471-490.

11.

Kruskal, J.B. and M. Wish. 1978. “Multidimensional Scaling.” Sage University Paper series on Quantitative Applications in the Social Sciences 07-011. Beverly Hills and London: Sage Publications.

12.

Nikolaidis, I. 2012. “Users’ Perceptions of Statistics for Improvement Actions.” Paper presented at the European Conference on Quality in Official Statistics, Athens, May 2012.

13.

Statistics Canada 2009. Corporate Business Plan. 2009/10 to 2011/12. Statistics Canada.

14.

Swami, P.A.V.B. and G.S. Tavlas. 1995. “Random Coefficient Models: Theory and Applications.” Journal of Economic Surveys 9:165-196.

15.

United Nations Economic Commission for Europe 1992. Fundamental Principles of Official Statistics. Available at: http://www.unece.org/stats/archive/docs.fp.e.html (accessed May 20, 2014).

16.

United Nations Statistical Commission 2006. Report of the Secretary-General on Principles Governing International Statistical Activities. Report on the Thirty-Seventh Session (March 6-10, 2006). Available at: http://unstats.un.org/unsd/statcom/doc06/2006-13e-Principles.pdf (accessed May 20, 2014).

17.

Vale, S. 2010. “Statistical Data Quality in the UNECE. 2010 Version.” Available at: http://unstats.un.org/unsd/dnss/docs-nqaf/UNECE-Quality%20Improvement%Programme%202010.pdf (accessed May 20, 2014).

18.

Working Party of the Royal Statistical Society 1991. “Official Statistics: Counting with Confidence.” Journal of the Royal Statistical Society (Series A) 154:23-44.

19.

Zilhao, M.J. and M. Ribeiro. 2012. “Measuring Client’s Satisfaction - the Integrated Management System of the Post-Service Satisfaction Survey at Statistics Portugal.” Paper presented at the European Conference on Quality in Official Statistics, Athens, May 2012.