At National Statistical Institutes, increased re-use of data and increased use of different data sources within statistical production lines leads to increased complexity. Moreover, different production lines become interconnected resulting in networks or chains. With increasing complexity, process management can be used to support tactical and operational decisions by production staff on the primary production process. Use of quality indicators is one of the well-known instruments within process management. It gives production staff insight into whether the primary production process meets the output quality requirements of users and the process quality requirements of the NSI. The present paper describes guidance rules in the form of a stepwise approach to determine which indicators will be helpful within the production process, and at which location, including the corresponding actions, given the requirements of users and the environment (NSI). In addition, a first set of standard indicator types for process management is given. At the end of the paper, the guidance rules are applied to (a chain of) production lines at two statistical institutes.
AitkenA., HörngrenJ., JonesN., LewisD. and ZilhãoM.J., Handbook on improving quality by analysis of process variables, European Commission, 7 July 2004.
2.
BakkerB.F.M., LinderF.S. and Van RoonD.B., Could that be true? Methodological issues when deriving educational attainment from different administrative data sources and surveys, Paper presented at the IAOS conference on reshaping official Statistics, Shanghai, 12-14 October 2008.
3.
BanningR. and VinkG., Methoden en indicatoren voor het evalueren en beschrijven van controle- en correctieprocessen (in Dutch), Internal report Statistics Netherlands, 2010.
4.
BerkaC., HumerS., MoserM., LenkM., RechtaH. and SchwererE., Combination of evidence from multiple administrative data sources: quality assessment of the Australian register-based census, Statistica Neerlandica66 (2011), 18-33.
5.
BiemerP.P. and LybergL.E., Introduction to Survey Quality, New Jersey: John Wiley & Sons, 2003.
6.
BusheryJ.M. and McGovernP.D., Measuring process quality and performance at Statistical Organisations, Paper presented at the European Conference on Quality in Statistics, 2010.
7.
CamstraA. and RenssenR.H., Standard Process Steps Based on Standard Methods as Part of the Business Architecture, Paper presented at the ISI Conference, Dublin, 2011.
8.
DaasP.J.H. and OssenS.J.L., eds, Report on methods preferred for the quality indicators of administrative data sources, Deliverable 4.2 of the project BLUE Enterprise and Trade Statistics, 2011.
9.
EhlingM. and KörnerT., Handbook on data quality assessment methods and tools, European Commission, 2007.
10.
Eurostat, ESS Handbook for Quality Reports, Methodologies and Working papers, Eurostat, Luxembourg, ISSN 1977-0375, 2009 edition.
11.
Eurostat, European Statistical Code of Practice, For the national and community statistical authorities, Adopted by the European Statistical System Committee, 28 September 2011.
12.
FoleyP., Improving the Production Process of the Irish Retail Sales Index, Paper presented at the European Conference on Quality in Statistics, Athens, 2012.
13.
GriffioenA.R., Van DeldenA. and De WolfP.P., Overview of quality frameworks for possible use in NSIs, Deliverable 7.3 of BLUE Enterprise and Trade Statistics, Part 1, 2012.
14.
GroenJ.A., Sources of error in survey and administrative data: the importance of reporting procedures, Journal of Official Statistics28 (2012), 173-198.
15.
HLG_BAS, Fostering interoperability in official statistics, Common statistical production architecture, Version 0.1, April 2013.
16.
KarrA.F., SanilA.P. and BanksD.L., Data quality: A statistical perspective, Statistical Methodology3 (2006), 137-173.
17.
LaitilaT., WallgrenA. and WallgrenB., Quality assessment of administrative data, Research and Development - methodology Report from Statistics Sweden, 2011:2.
18.
MayoR., Integrating data quality indicators into the FAO statistical system, Seventh meeting, Luxembourg, 23-24 May, 2005.
19.
MontgomeryD.C., Statistical Quality Control: a modern introduction, Sixth edition, New Jersey: John Wiley & Sons, (2009).
20.
MorgansteinD. and MarkerD.A., Continuous Quality Improvement in Statistical Agencies, in: Survey Measurement and Process Quality, L. Lyberg, P. Biemer, M. Collins, E. De Leeuw, C. Dippo, N. Schwarz and D. Trewin, eds, Wiley, New York, 1997, pp. 475-500.
21.
PinkB., Quality management of statistical processes using quality gates, Australian Bureau of Statistics, 2010.
22.
SchoutenB., ShlomoN. and SkinnerC., Indicators for monitoring and improving representativeness of response, Journal of Official statistics27 (2011), 231-253.
23.
SharpG., Lean Six Sigma techniques and their relevance to the work of NSIs, Paper presented at the European Conference on Quality in Statistics, Athens, 2012.
24.
StruisP., CamstraA., RenssenR.H. and BraaksmaB., Redesign of Statistics Production within an Architectural Framework: The Dutch Experience, Journal of Official Statistics29 (2013), 49-71.
25.
United Nations, Institutional Arrangements to achieve integration, chapter 2 in: UN Draft Guidance rules on Integrated Economic Statistics, 2011.
26.
ValeS., ed., Generic Statistical Business Process Model Version 4.0, Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS), Eurostat, Luxembourg, 2009.
27.
Van DeldenA., De WolfP.P., ZhangL.-C. and FosenJ., Approach to derive indicators for chains of statistical production processes, Paper presented at the European Conference on Quality in Official Statistics (Q2012), 30 May-1 June 2012, Athens.
28.
Van NederpeltP.W.M., Object-oriented Quality and Risk Management (OQRM), A practical, scalable and generic method to manage quality and risk, Alphen aan den Rijn/New York, MicroData/LuLu Press, (2012).
29.
ZhangL.-C., Topics for statistical theory for register-based statistics and data integration, Statistica Neerlandica66 (2012), 41-63.
