Big Data and artificial intelligence will have a profound transformational impact on governments around the world. Thus, it is important for scholars to provide a useful analysis on the topic to public managers and policymakers. This study offers an in-depth review of the Policy and Administration literature on the role of Big Data and advanced analytics in the public sector. It provides an overview of the key themes in the research field, namely the application and benefits of Big Data throughout the policy process, and challenges to its adoption and the resulting implications for the public sector. It is argued that research on the subject is still nascent and more should be done to ensure that the theory adds real value to practitioners. A critical assessment of the strengths and limitations of the existing literature is developed, and a future research agenda to address these gaps and enrich our understanding of the topic is proposed.
AgostinoDArnaboldiM (2017) Social media data used in the measurement of public services effectiveness: Empirical evidence from Twitter in higher education institutions. Public Policy and Administration32: 296–322.
2.
AllardSWiegandESchlechtC, et al. (2018) State agencies' use of administrative data for improved practice: Needs, challenges, and opportunities. Public Administration Review78(2): 240–250.
3.
ArinderM (2016) Bridging the divide between evidence and policy in public sector decision making: A practitioner's perspective. Public Administration Review76(3): 394–398.
4.
AshworthRFerlieEHammerschmidG, et al. (2013) Theorizing contemporary public management: International and comparative perspectives. British Journal of Management24(S1): 1–17.
5.
BachnerJHillK (2014) Advances in public opinion and policy attitudes research. Policy Studies Journal42(S1): 51–70.
6.
BaileySAnttiroikoAVValkamaP (2016) Application of Baumol's Cost Disease to Public Sector Services: Conceptual, theoretical and empirical falsities. Public Management Review18(1): 91–109.
7.
BarthTArnoldE (1999) Artificial intelligence and administrative discretion. The American Review of Public Administration29(4): 332–351.
8.
BertotJCJaegerPTGrimesJM (2010) Using ICTs to create a culture of transparency: E-government and social media as openness and anti-corruption tools for societies. Government Information Quarterly27(3): 264–271.
9.
Birckland T (2001) An Introduction to the Policy Process: Theories, Concepts, and Models of Public Policy Making. New York, NY: ME Shape.
BoydDCrawfordK (2012) Critical questions for big data. Information, Communication & Society15(5): 662–679.
12.
ChenY-CLeeJ (2018) Collaborative data networks for public service: governance, management, and performance. Public Management Review20(5): 672–690.
13.
ClarkeAMargettsH (2014) Governments and citizens getting to know each other? Open, closed, and big data in public management reform. Policy & Internet6(4): 393–417.
14.
ClearyD (2011) Predictive analytics in the public sector: Using data mining to assist better target selection for audit. Electronic Journal of e-Government9(2): 132–140.
15.
CombeC (2015) Privacy, big data, and the public good: Frameworks for engagement. Local Government Studies41(1): 181–182.
16.
CookT (2014) “Big data” in research on social policy. Journal of Policy Analysis and Management33(2): 544–547.
17.
CrozierM (2015) Governing codes: Information dynamics and contemporary coordination challenges. Administration & Society47(2): 151–170.
18.
DaniellKMortonARiosID (2015) Policy analysis and policy analytics. Annals of Operations Research236(1): 1–13.
19.
DeckerP (2014) Presidential address: False choices, policy framing, and the promise of “big data.”. Journal of Policy Analysis and Management33(2): 252–262.
20.
DesouzaKJacobB (2017) Big data in the public sector: Lessons for practitioners and scholars. Administration & Society49(7): 1043–1064.
21.
DesouzaKBhagwatwarA (2012) Leveraging technologies in public agencies: The case of the U.S. Census Bureau and the 2010 Census. Public Administration Review72(4): 605–614.
22.
EatonCDeRoosDDeutschT, et al. (2012) Understanding Big Data Analytics for Enterprise Class Hadoop and Streaming Data, New York: The McGraw-Hill Companies.
23.
Einav L and Levin J (2014) The data revolution and economic analysis. In: Lerner J and Stern S (eds) Innovation Policy and the Economy. vol.14. Chicago, IL: University of Chicago Press, pp.1–24.
24.
EsteveMBoyneGSierraV, et al. (2012) Organizational collaboration in the public sector: Do chief executives make a difference?. Journal of Public Administration Research and Theory23(4): 927–952.
25.
GamageP (2016) New development: Leveraging ‘big data’ analytics in the public sector. Public Money & Management36(5): 385–390.
26.
GiestS (2017) Big data for policymaking: Fad or fasttrack?. Policy Sciences50(3): 367–382.
27.
Goldsmith S and Crawford S (2014) The Responsive City: Engaging Communities Through Data-Smart Governance. Sant Francisco, CA: JosseyBass.
28.
GoodfellowIBengioYCourvilleA (2016) Deep Learning, Cambridge, MA: MIT Press.
29.
HaddenS (1986) Intelligent advisory systems for managing and disseminating information. Public Administration Review46: 572–578.
30.
HondulaDKurasELongoJ, et al. (2018) Toward precision governance: Infusing data into public management of environmental hazards. Public Management Review20(5): 746–765.
31.
HM Government. (2017) Industrial Strategy Building a Britain fit for the future. White Paper.
32.
Höchtl J, Parycek P and Schöllhammer R (2016) Big data in the policy cycle: Policy decision making in the digital era. Journal of Organizational Computing and Electronic Commerce 26(1–2): 147–169.
33.
HurleyMWallaceW (1986) Expert systems as decision aids for public managers: An assessment of the technology and prototyping as a design strategy. Public Administration Review46: 563–571.
34.
Isett K and Hicks D (2018) Providing public servants what they need: Revealing the “unseen” through data visualization. Public Administration Review 78(3): 479–485.
35.
JahodaM (1986) Artificial intelligence: An outsider's perspective. Science and Public Policy13(6): 333–340.
36.
JarminRO'HaraA (2016) Big data and the transformation of public policy analysis. Journal of Political Analysis and Management35(3): 715–721.
37.
JanssenMKukG (2016) The challenges and limits of big data algorithms in technocratic governance. Government Information Quarterly33(3): 371–377.
38.
JohnesGRuggieroJ (2017) Revenue efficiency in higher education institutions under imperfect competition. Public Policy and Administration32(4): 282–295.
39.
Joseph R and Johnson N (2013) Big data and transformational government. IT Pro. pp.43–48. Available at: http://computer.org/ITPro (accessed 28 August 2016).
40.
KettlD (2016) Making data speak: Lessons for using numbers for solving public policy puzzles. Governance29(4): 573–579.
41.
KimbleCMilolidakisG (2015) Big Data and business intelligence: Debunking the myths. Global Business and Organizational Excellence35(1): 23–34.
42.
KingGPanJRobertsM (2013) How censorship in China allows government criticism but silences collective expression. American Political Science Review107(2): 326–343.
43.
KuilerE (2014) From big data to knowledge: An ontological approach to big data analytics. Review of Policy Research31(4): 311–318.
44.
LaneJ (2016) Big data for public policy: The quadruple helix. Journal of Policy Analysis and Management35(3): 708–715.
45.
LavertuS (2016) We all need help: “Big data” and the mismeasure of public administration. Public Administration Review76(6): 864–872.
46.
LoftisMMortensenP (2018) Collaborating with the machines: A hybrid method for classifying policy documents. The Policy Studies Journal. . DOI: 10.1111/psj.12245.
47.
MaciejewskiM (2017) To do more, better, faster and more cheaply: Using big data in public administration. International Review of Administrative Sciences83(1): 120–135.
MasuchMLaPotinP (1989) Beyond garbage cans: An AI model of organizational choice. Administrative Science Quarterly34(1): 38–67.
50.
Mayer-SchoenbergerVCukierK (2013) Big Data – A Revolution that will Transform How We Live, Work, and Think, Boston: Eamon Dolan Book.
51.
MazurE (2015) Data Analytics – A Tool for Building Trust in Government. Journal of Government Financial Management64(2): 35–39.
52.
McNeelyCHahmJ (2014) The big (data) bang: Policy, prospects, and challenges. Review of Policy Research31(4): 304–310.
53.
MergelI (2016) Big data in public affairs education. Journal of Public Affairs Education22(6): S231–S248.
54.
MergelI (2017) Building holistic evidence for social media impact. Public Administration Review77(4): 489–495.
55.
MergelIRethemeyerKIsettK (2016) Big data in public affairs. Public Administration Review76(6): 928–937.
56.
NowlinM (2016) Modeling issue definitions using quantitative text analysis. The Policy Studies Journal44(3): 309–331.
57.
PandeySPandeySKMillerL (2017) Measuring innovativeness of public organizations: Using natural language processing techniques in computer-aided textual analysis. International Public Management Journal20(1): 78–107.
58.
Peled A (2013) The Politics of Big Data – A Three-Level Analysis. Paper presented at the European consortium of political research (ECPR) general conference, Bordeaux, France, 4–7 September.
59.
PhillipsF (2017) A perspective on ‘big data’. Science and Public Policy44(5): 730–737.
60.
PirogM (2014) Data will drive innovation in public policy and management research in the next decade. Journal of Policy Analysis and Management33(2): 537–543.
61.
PisanoM (2016) How research can drive policy: Econometrics and the future of California's infrastructure. Public Administration Review76(4): 538–539.
62.
PrincenS (2011) Agenda-setting strategies in EU policy processes. Journal of European Public Policy18(7): 927–943.
63.
PyrozhenkoV (2017) Open government: Missing questions. Administration & Society49(10): 1494–1515.
64.
RoggeNAgasistiTDe WitteK (2017) Big data and the measurement of public organizations' performance and efficiency: The state-of-the-art. Public Policy and Administration32(4): 263–281.
65.
RussellSNorvigP (2009) Artificial Intelligence: A Modern Approach, 3rd ed. Harlow, Essex: Prentice Hall.
66.
ShindelarS (2014) Big data and the government agency. Public Manager43: 52–56.
67.
SchintlerLKulkarniR (2014) Big data for policy analysis: The good, the bad, and the ugly. Review of Policy Research31(4): 343–348.
68.
SimsHSosseiS (2012) Federal government primed for data analytics. The Journal of Government Financial Management61: 34–37.
69.
StoughRMcBrideD (2014) Big data and U.S. public policy. Review of Policy Research31(4): 339–342.
70.
StritchJPedersenMTaggartG (2017) the opportunities and limitations of using Mechanical Turk (MTURK) in public administration and management scholarship. International Public Management Journal20(3): 489–511.
71.
TaeihaghA (2017) Crowdsourcing: A new tool for policy-making?. Policy Sciences50(4): 629–647.
72.
WashingtonA (2014) Government information policy in the era of big data. Review of Policy Research31(4): 319–325.
73.
WegrichKJannW (2006) Chapter 4: Theories of the policy cycle. In: FischerFMillerGJSidneyMJ (eds) Handbook of Public Policy Analysis. Theory, Politics, and Methods, Boca Raton: CRC Press, pp. 43–62.
74.
WeitzmanBSilverDBrazillC (2006) Efforts to improve public policy and programs through data practice: Experiences in 15 distressed American cities. Public Administration Review66: 386–399.
75.
WhitePBreckenridgeR (2014) Trade-offs, limitations, and promises of big data in social science research. Review of Policy Research31(4): 331–338.
76.
WilliamsonA (2014a) Big data and the implications for government. Legal Information Management14(4): 253–257.
77.
WilliamsonB (2014b) Knowing public services: Cross-sector intermediaries and algorithmic governance in public sector reform. Public Policy and Administration29(4): 292–312.
78.
WirtzBPiehlerRThomasM, et al. (2015) Resistance of public personnel to open government: A cognitive theory view of implementation barriers towards open government data. Public Management Review18(9): 1335–1364.
79.
YoutieJPorterAHuangY (2017) Early social science research about big data. Science and Public Policy44(1): 65–74.
80.
Zhu J, Huang H and Zhang D (2017) “Big tigers, big data”: Learning social reactions to China's anticorruption campaign through online feedback. Public Administration Review.
