Faced with increasing demands from users of official statistics, declining budgets, increasing data collection costs and coupled with the increasing supply of new data sources, national statistical offices (NSOs) are attracted to using these newer sources for the production of official statistics. However, given the under or over-coverage biases and measurement errors inherent in these sources and the high standard of accuracy required for official statistics, what are the rules of engagement that NSOs would need to take into account before deciding to use these sources? In this paper, against the background of the 5 V’s and 7 virtues of big data that are discussed in the literature, we suggest ten rules of engagement, seven of which are considered as non-negotiables and three as essential for official statistics. We also provide three use cases to illustrate the ten rules.
UNECE. Using administrative data and secondary sources for official statistics. A Handbook of Principle and Practices. 2011.
2.
CarsonC. Fostering the fundamental principles of official statistics. Statistical Journal of the United Nations Economic Commission for Europe. 1998; 15: 213-220.
3.
AshtonK. The Internet of Things. RFID Journal. Available at https//scholar.google.com.au/scholar_url?url=http://www.itrco.jp/libraries/RFIDjournal-That%2520Internet%2520of%2520Things%2520Thing.pdf&hl=en&sa=X&scisig=AAGBfm0M7K7404EKTaaAwBLTjpomthgdKA&nossl=1&oi=scholarr. Accessed 26 September 2019, 2009.
4.
Wiki. Internet of Things. Available at https://en.wikipedia.org/wiki/Internet_of_things. Accessed 26 September 2019.
5.
Verbal communication from Ric Clarke.
6.
DevillePLinardCMartinSGilbertMStevensFGaughanABlondelVTatemA. Dynamic population mapping using mobile phone data. Proceedings of the National Academy of Sciences of the United States of America. 2014; 45: 15888-1893.
7.
RausserGStrielkowskiW. Streimikiene D. Smart meters and household electricity consumption: A case study in Ireland. Energy and Environment. 2017; 29: 132-146.
8.
IvancicLDiewertWFoxJ. Scanner data, time aggregation and the construction of price indexes. Journal of Econometrics. 2011; 161: 24-35.
9.
HusekN. Telematics data for official statistics: An experience with big data. Statistical Journal of the International Association for Official Statistics. 2018; 34: 499-504.
10.
CarfagnaEGallegoF. Using remote sensing for agricultural statistics. International Statistical Review. 2006; 73: 389-404.
11.
TamS-M. A statistical framework for analyzing Big Data. The Survey Statistician. 2015; 72: 36-51.
12.
DaasPPutsM. Social media sentiment and consumer confidence. European Central Bank Statistical Paper Series. 2014; 5: 1-29.
13.
DaasPPutsMBuelensBvan den HurkP. Big data as a source for official statistics. Journal of Official Statistics. 2015; 31: 249-262.
14.
TamS-MClarkeF. Big data, official statistics and some initiatives by the Australian Bureau of Statistics. International Statistical Review. 2015; 3: 436-448.
15.
MacfeelyS. Big data and official statistics. In Big Data Governance and Perspectives in Knowledge Management. IGI Global, 2018.
16.
CouperM. Is the sky falling? Net technology, changing media and the future of surveys. Survey Research Methods. 2013; 7: 145-156.
17.
CrawfordK. The hidden biases in Big Data. Harvard Business Blog, 2013.
18.
KimJTamS-M. Data integration by combining big data and survey sample data for finite population inference. Submitted, 2019.
19.
TamS-MKimJAngLPhamH. Mining the new oil for official statistics in Big Data Meets Survey Practice: A Collection of Innovative Methods, John Wiley and Sons, Hoboken, 2019, in press.
20.
TamS-MKimJ. Data ethnics and selection bias: an official statistician’s perspective. Statistical Journal of the International Association of Official Statistics. 2018; 34: 577-588.
21.
De VeauxRCollegeW. Seven deadly sins of big data. http//www.falltechnicalconference.org/wp-content/uploads/2017_Presentations/2A-1-De-Veaux-Seven-Deadly-Sins.pdf. Accessed 3 September 2019, 2017.
22.
ChenYLiPWuC. Doubly robust inference with non-probability survey samples. Submitted, 2018.
23.
KimJWangZZhuZCruzeN. Combining survey and non-survey big data for improved sub-area prediction using a multi-level model. Journal of Agricultural, Biological, and Environmental Statistics. 2018; 23: 175-189.
24.
YangSKimJ. Integration of survey data and big observational data for finite population inference using mass imputation. Submitted, 2018.
25.
FullerW. Sampling Statistics. Hoboken, New Jersey: John Wiley & Sons, Inc, 2009.
26.
KimJKRaoJNK. Combining data from two independent surveys: a model-assisted approach. Biometrika. 2012; 99: 85-100.
27.
MengX. Statistical paradises and paradoxes in big data (i): Law of large populations, big data paradox, and 2016 US presidential election. Annals of Applied Statistics. 2018; 12: 685-726.
28.
BuelensBBurgerJvan den BrakelJ. Comparing inference methods for non-probability samples. International Statistical Review.2018; 86: 322-343.
29.
SchonlauMvan SoestAKapteynA. Selection bias in web surveys and the use of propensity scores. Sociological Methods and Research. 2009; 37: 291-318.
30.
TamS-MHolmbergA. New data sources for official statistics – a game changer for official statisticians? The Survey Statistician.2020; 81: 21-35.
31.
Australian Bureau of Statistics. ABS data quality framework. 1520.0 – ABS Data Quality Framework, May 2009.
32.
BrackstoneG. Managing data quality in a statistical agency. Survey Methodology. 1999; 25: 139-149.
33.
Australian Bureau of Statistics. Information paper: Making Greater Use of Transactions Data to compile the Consumer Price Index, Australia. Catalogue Number 6401.0.60.003. ABS, Canberra, 2016.
34.
Australian Bureau of Statistics. Information Paper: An Implementation Plan to maximise the use of transactions data in the CPI. Catalogue Number 6401.0.60.004. ABS, Canberra, 2017.
35.
IvancicIDiewertDFoxK. Scanner data, time aggregation and the construction of price indexes. Journal of Econometrics. 2011; 161: 24-35.
36.
Australian Bureau of Statistics. Consumer Price Index, September 2017. Catalogue Number 6401.0. ABS, Canberra, 2017.
37.
Handbook on earth observations for official statistics. Report prepared by the Satellite Imagery and Geo-spatial Statistics Task Team of the United Nations Global Working Group on Big Data. New York. https://unstats.un.org/bigdata/taskteams/satellite/ Accessed 22 October 2019, 2017.
38.
TamS-MHollowayJDunsmoreRJakabMHeldAKerblatFRossJ. Forcing close operation between EO scientists and official statisticians. In Part 2 of Satellite earth observations in support of the sustainable development goals. European Space Agency, Paris. http//ceos.org/home-2/eohb-sdgs/: Accessed 22 October 2019, 2018.
39.
Committee on Earth Observation Satellites. In Part 1 of Satellite earth observations in support of the sustainable development goals. European Space Agency, Paris. http//ceos.org/home-2/eohb-sdgs/, Accessed 22 October 2019, 2018.
40.
Handbook on the use of mobile phone data for official statistics. Report prepared by the Mobile Phone Task Team of the United Nations Global Working Group on Big Data. New York, 2017.
41.
VanhoofMReisFPloetzTSmoredaZ. Assessing the quality of home detection from mobile phone data for official statistics. Journal of Official Statistics. 2018; 34: 935-960.
