An Eye for Artificial Intelligence: Insights Into the Governance of Artificial Intelligence and Vision for Future Research

Abstract

In this 60th anniversary of Business & Society essay, we seek to make three main contributions at the intersection of governance and artificial intelligence (AI). First, we aim to illuminate some of the deeper social, legal, organizational, and democratic challenges of rising AI adoption and resulting algorithmic power by reviewing AI research through a governance lens. Second, we propose an AI governance framework that aims to better assess AI challenges as well as how different governance modalities (architecture, laws, norms, and market) can support AI. At the heart of our framework lies the governance forces that apply to institutions, organizations, and individuals, who ultimately provide, regulate, and use AI decision-making. We discuss how businesses may harness AI’s economic power through governance solutions without creating or amplifying societal biases and inequalities. Third, as part of our section on future research, we identify a set of governance trade-offs in AI adoption, suggest future research avenues to conceptually strengthen research on the governance of AI, and lay out key policy recommendations.

Keywords

artificial intelligence big data governance institutions machine learning

Get full access to this article

View all access options for this article.

References

*Adner

Puranam

Zhu

(2019). What is different about digital strategy? From quantitative to qualitative change. Strategy Science, 4, 253–261. https://doi.org/10.1287/stsc.2019.0099

Agrawal

Gans

Goldfarb

(2018). Prediction machines: The simple economics of artificial intelligence. Harvard Business Press.

Aguilera

R. V.

Grøgaard

(2019). The dubious role of institutions in international business. A road forward. Journal of International Business Studies, 50, 20–35.

Aizenberg

van den Hoven

(2020). Designing for human rights in AI. Big Data & Society, 7(2), 2053951720949566.

*Alaimo

Kallinikos

(2020). Managing by data: Algorithmic categories and organizing. Organization Studies, 42(9), 1385–1407. https://doi.org/10.1177/0170840620934062

Allen

(2018). You snooze, you lose: Insurers make the old adage literally true. Pro Publica.

Amis

Barney

Mahoney

J. T.

Wang

(2020). From the editors—Why we need a theory of stakeholder governance—And why this is a hard problem. Academy of Management Review, 45, 499–503.

*Andrew

Baker

(2019). The General Data Protection Regulation in the age of surveillance capitalism. Journal of Business Ethics, 168(3), 565–578.

Angwin

Larson

Mattu

Kirchner

(2016). Machine bias. Pro Publica. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing

10.

*Arthur

K. N. A.

Owen

(2019). A micro-ethnographic study of big data-based innovation in the financial services sector: Governance, ethics and organisational practices. Journal of Business Ethics, 160, 363–375.

11.

Bacq

Aguilera

R. V.

(2022). Stakeholder governance for responsible innovation: A theory of value creation, appropriation, and distribution. Journal of Management Studies, 59(1), 29–60.

12.

*Balasubramanian

(2020). Substituting human decision-making with machine learning: Implications for organizational learning. Academy of Management Review. Advance online publication.

13.

Benner

Mozur

(2016, February 20). Apple sees value in its stand to protect security. The New York Times. https://www.nytimes.com/2016/02/21/technology/apple-sees-value-in-privacy-vow.html

14.

Besharov

M. L.

Khurana

(2015). Leading amidst competing technical and institutional demands: Revisiting Selznick’s conception of leadership. In Kraatz

M. S.

(Ed.), Institutions and ideals: Philip Selznick’s legacy for organizational studies (Research in the sociology of organizations) (Vol. 44, pp. 53–88). Emerald Group.

15.

*Binns

(2020). Human judgment in algorithmic loops: Individual justice and automated decision-making. Regulation & Governance, 16(1), 197–211. https://doi.org/10.1111/rego.12358

16.

*Blohm

Antretter

Sirén

Grichnik

Wincent

(2020). It’s a peoples game, isn’t it?! A comparison between the investment returns of business angels and machine learning algorithms. Entrepreneurship Theory and Practice, 1042258720945206.

17.

*Bolander

(2019). What do we lose when machines take the decisions? Journal of Management and Governance, 23, 849–867. https://doi.org/10.1007/s10997-019-09493-x

18.

*Bolin

Andersson Schwarz

(2015). Heuristics of the algorithm: Big Data, user interpretation and institutional translation. Big Data & Society, 2(2), 2053951715608406.

19.

Braga

Logan

R. K.

(2017). The emperor of strong AI has no clothes: Limits to artificial intelligence. Information, 8(4), Article 156.

20.

*Brock

J. K. U.

Von Wangenheim

(2019). Demystifying AI: What digital transformation leaders can teach you about realistic artificial intelligence. California Management Review, 61(4), 110–134.

21.

*Brynjolfsson

Hui

Liu

(2019). Does machine translation affect international trade? Evidence from a large digital platform. Management Science, 65(12), 5449–5460.

22.

Brynjolfsson

Mcafee

(2017). The business of artificial intelligence. Harvard Business Review, 7, 3–11.

23.

Bughin

Hazan

(2019, August). Can artificial intelligence help society as much as it helps business? The McKinsey Quarterly.

24.

*Buhmann

Paßmann

Fieseler

(2020). Managing algorithmic accountability: Balancing reputational concerns, engagement strategies, and the potential of rational discourse. Journal of Business Ethics, 163(2), 265–280.

25.

*Burrell

(2016). How the machine “thinks’: Understanding opacity in machine learning algorithms. Big Data & Society, 3(1), 2053951715622512.

26.

*Cennamo

Marchesi

Meyer

(2020). Two sides of the same coin? Decentralized versus proprietary blockchains and the performance of digital currencies. Academy of Management Discoveries, 6, 382–405.

27.

*Chalmers

MacKenzie

N. G.

Carter

(2020). Artificial intelligence and entrepreneurship: Implications for venture creation in the fourth industrial revolution. Entrepreneurship Theory and Practice, 45(5), 1028–1053.

28.

*Chen

Chiang

R. H. L.

Storey

V. C.

(2012). Business intelligence and analytics: From big data to big impact. MIS Quarterly, 36, 1165–1188.

29.

*Chen

Pereira

Patel

P. C.

(2021). Decentralized governance of digital platforms. Journal of Management, 47(5), 1305–1337.

30.

*Chenou

J. M.

Radu

(2019). The “right to be forgotten”: Negotiating public and private ordering in the European Union. Business & Society, 58, 74–102.

31.

*Choudhury

Starr

Agarwal

(2020). Machine learning and human capital complementarities: Experimental evidence on bias mitigation. Strategic Management Journal, 41(8), 1381–1411.

32.

*Christin

(2017). Algorithms in practice: Comparing web journalism and criminal justice. Big Data & Society, 4(2), 2053951717718855.

33.

*Clough

D. R.

(2020). Artificial intelligence, data-driven learning, and the decentralized structure of platform ecosystems. Academy of Management Review, 47, 184–189.

34.

Colback

(2020, October 15). The impact of AI on business and society. Financial Times. https://www.ft.com/content/e082b01d-fbd6-4ea5-a0d2-05bc5ad7176c

35.

*Curchod

Patriotta

Cohen

Neysen

(2019). Working for an algorithm: Power asymmetries and agency in online work settings. Administrative Science Quarterly, 65(3), 644–676.

36.

Dastin

(2018). Amazon scraps secret AI recruiting tool that showed bias against women. Reuters.

37.

*Dietvorst

B. J.

Simmons

J. P.

Massey

(2015). Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology, 144, 114–126.

38.

Dietvorst

B. J.

Simmons

J. P.

Massey

(2018). Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management Science, 64, 1155–1170.

39.

Donahue

J. D.

Zeckhauser

(2012). Collaborative governance: Private roles for public goals in turbulent times. Princeton University Press.

40.

*Dourish

(2016). Algorithms and their others: Algorithmic culture in context. Big Data & Society, 3(2), 2053951716665128.

41.

*Efendić

Van de Calseyde

P. P.

Evans

A. M.

(2020). Slow response times undermine trust in algorithmic (but not human) predictions. Organizational Behavior and Human Decision Processes, 157, 103–114.

42.

Elkin-Koren

(2020). Contesting algorithms: Restoring the public interest in content filtering by artificial intelligence. Big Data & Society, 7(2), 2053951720932296.

43.

*Etzioni

(2018). Apple: Good business, poor citizen? Journal of Business Ethics, 151, 1–11.

44.

*Eyert

Irgmaier

Ulbricht

(2020). Extending the framework of algorithmic regulation. The Uber case. Regulation & Governance, 16(1), 23–44. https://doi.org/10.1111/rego.12371

45.

*Felten

Raj

Seamans

(2021). Occupational, industry, and geographic exposure to artificial intelligence: A novel dataset and its potential uses. Strategic Management Journal, 42(12), 2195–2217.

46.

*Festic

(2020). Same, same, but different! Qualitative evidence on how algorithmic selection applications govern different life domains. Regulation & Governance, 16, 85–101. https://doi.org/10.1111/rego.12333

47.

*Firlej

Taeihagh

(2020). Regulating human control over autonomous systems. Regulation & Governance, 15(4), 1071–1091. https://doi.org/10.1111/rego.12344

48.

*Fleming

(2019). Robots and organization studies: Why robots might not want to steal your job. Organization Studies, 40, 23–38.

49.

*Flyverbom

Deibert

Matten

(2019). The governance of digital technology, big data, and the internet: New roles and responsibilities for business. Business & Society, 58, 3–19.

50.

*Gellert

(2020). Comparing definitions of data and information in data protection law and machine learning: A useful way forward to meaningfully regulate algorithms? Regulation & Governance, 16(1), 156–176. https://doi.org/10.1111/rego.12349

51.

Girish

(2020, September 9). “The Social Dilemma” review: Unplug and run. The New York Times. https://www.nytimes.com/2020/09/09/movies/the-social-dilemma-review.html

52.

Glikson

Woolley

A. W.

(2020). Human trust in artificial intelligence: Review of empirical research. Academy of Management Annals, 14(2), 627-660.

53.

*Gregory

R. W.

Henfridsson

Kaganer

Kyriakou

(2020). The role of artificial intelligence and data network effects for creating user value. Academy of Management Review, 46, 534–551.

54.

*Haenlein

Kaplan

(2019). A brief history of artificial intelligence: On the past, present, and future of artificial intelligence. California Management Review, 61(4), 5–14.

55.

*Hartmann

Henkel

(2020). The rise of corporate science in AI: Data as a strategic resource. Academy of Management Discoveries, 6, 359–381.

56.

Heukamp

(2020). AI and the leadership development of the future. In Heukamp

C.J. F.

(Eds.), The future of management in an AI world: Redefining purpose and strategy in the fourth industrial revolution (pp. 137–148). Palgrave Macmillan.

57.

Hornik

Stinchcombe

White

(1989). Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359–366.

58.

Hosanagar

(2020). A human’s guide to machine intelligence: How algorithms are shaping our lives and how we can stay in control. Penguin Books.

59.

*Huang

M. H.

Rust

Maksimovic

(2019). The feeling economy: Managing in the next generation of artificial intelligence (AI). California Management Review, 61(4), 43–65.

60.

*Jago

A. S.

(2019). Algorithms and authenticity. Academy of Management Discoveries, 5, 38–56.

61.

Jensen

M. C.

Meckling

W. H.

(1976). Theory of the firm: Managerial behavior, agency costs and ownership structure. Journal of Financial Economics, 3, 305–360.

62.

*Johnson

C. D.

Bauer

B. C.

Niederman

(2019). The automation of management and business science. Academy of Management Perspectives, 35(2), 292–309.

63.

Kane

G. C.

Young

A. G.

Majchrzak

Ransbotham

(2021). Avoiding an oppressive future of machine learning: A design theory for emancipatory assistants. MIS Quarterly, 45, 371–396.

64.

*Kang

Frenkel

(2018, April 4). Facebook says Cambridge Analytica harvested data of up to 87 million users. The New York Times. https://www.nytimes.com/2018/04/04/technology/mark-zuckerberg-testify-congress.html

65.

Kaplan

Haenlein

(2019). Siri, Siri, in my hand: Who’s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Business Horizons, 62, 15–25. https://doi.org/10.1016/j.bushor.2018.08.004

66.

*Kellogg

K. C.

Valentine

M. A.

Christin

(2020). Algorithms at work: The new contested terrain of control. Academy of Management Annals, 14, 366–410.

67.

Khanna

(2018). When technology gets ahead of society. Harvard Business Review, 96(4), 86–95.

68.

*Koo

W. W.

Eesley

C. E.

(2021). Platform governance and the rural–urban divide: Sellers’ responses to design change. Strategic Management Journal, 42(5), 941–967.

69.

*Kumar

Rajan

Venkatesan

Lecinski

(2019). Understanding the role of artificial intelligence in personalized engagement marketing. California Management Review, 61(4), 135–155.

70.

*Lambrecht

Tucker

(2019). Algorithmic bias? An empirical study of apparent gender-based discrimination in the display of STEM career ads. Management Science, 65(7), 2966–2981.

71.

*Lee

M. K.

(2018). Understanding perception of algorithmic decisions: Fairness, trust, and emotion in response to algorithmic management. Big Data & Society, 5(1), 2053951718756684.

72.

*Leicht-Deobald

Busch

Schank

Weibel

Schafheitle

Wildhaber

Kasper

(2019). The challenges of algorithm-based HR decision-making for personal integrity. Journal of Business Ethics, 160, 377–392.

73.

*Leonardi

P. M.

Treem

J. W.

(2020). Behavioral visibility: A new paradigm for organization studies in the age of digitization, digitalization, and datafication. Organization Studies, 41(12), 1601–1625. https://doi.org/10.1177/0170840620970728

74.

Lessig

(1998). The new Chicago school. The Journal of Legal Studies, 27(S2), 661–691.

75.

Lessig

(2006). Code: Version 2.0. New York. Basic Books.

76.

*Lévesque

Obschonka

Nambisan

(2020). Pursuing impactful entrepreneurship research using artificial intelligence. Entrepreneurship Theory and Practice, 1042258720927369.

77.

Levi-Faur

(2012). From “big government” to “big governance.” In Levi-Faur

(Ed.), The Oxford handbook of governance (pp. 3–18). Oxford University Press.

78.

*Li

X. B.

Sarkar

(2014). Digression and value concatenation to enable privacy-preserving regression. MIS Quarterly, 38(3), 679–698.

79.

Libecap

G. D.

(1989). Contracting for property rights. Cambridge University Press.

80.

*Logg

J. M.

Minson

J. A.

Moore

D. A.

(2019). Algorithm appreciation: People prefer algorithmic to human judgment. Organizational Behavior and Human Decision Processes, 151, 90–103.

81.

*Lundvall

B. Å

. (2017). Is there a technological fix for the current global stagnation? A response to Daniele Archibugi, Blade Runner economics: Will innovation lead the economic recovery? Research Policy, 46, 544–549.

82.

*Martin

(2019). Ethical implications and accountability of algorithms. Journal of Business Ethics, 160(4), 835–850.

83.

*Metcalf

Askay

D. A.

Rosenberg

L. B.

(2019). Keeping humans in the loop: Pooling knowledge through artificial swarm intelligence to improve business decision making. California Management Review, 61(4), 84–109.

84.

*Miklós-Thal

Tucker

(2019). Collusion by algorithm: Does better demand prediction facilitate coordination between sellers? Management Science, 65(4), 1552–1561.

85.

Mozur

(2019, April 14). One month, 500,000 face scans: How China is using A.I. to profile a minority. The New York Times. https://www.nytimes.com/2019/04/14/technology/china-surveillance-artificial-intelligence-racial-profiling.html

86.

*Munoko

Brown-Liburd

H. L.

Vasarhelyi

(2020). The ethical implications of using artificial intelligence in auditing. Journal of Business Ethics, 167, 209–234.

87.

*Murray

Rhymer

Sirmon

D. G.

(2020). Humans and technology: Forms of conjoined agency in organizations. Academy of Management Review, 46, 552–571.

88.

*Newlands

(2021). Algorithmic surveillance in the gig economy: The organization of work through Lefebvrian conceived space. Organization Studies, 42(5), 719–737.

89.

Newman

(2012). The governance of privacy. In Levi-Faur

(Ed.), The Oxford handbook of governance (pp. 599–610). Oxford University Press.

90.

*Newman

D. T.

Fast

N. J.

Harmon

D. J.

(2020). When eliminating bias isn’t fair: Algorithmic reductionism and procedural justice in human resource decisions. Organizational Behavior and Human Decision Processes, 160, 149–167.

91.

North

D. C.

(1990). A transaction cost theory of politics. Journal of Theoretical Politics, 2(4), 355–367.

92.

*Nunan

Di Domenico

(2017). Big data: A normal accident waiting to happen? Journal of Business Ethics, 145, 481–491.

93.

*Overgoor

Chica

Rand

Weishampel

(2019). Letting the computers take over: Using AI to solve marketing problems. California Management Review, 61(4), 156–185.

94.

*Pachidi

Berends

Faraj

Huysman

(2021). Make way for the algorithms: Symbolic actions and change in a regime of knowing. Organization Science, 32(1), 18–41.

95.

*Parsons

(2019). The (in) effectiveness of voluntarily produced transparency reports. Business & Society, 58, 103–131.

96.

Phan

Wright

Lee

S.-H.

(2017). Of robots, artificial intelligence, and work. Academy of Management Perspectives, 31(4), 253–255. https://doi.org/10.5465/amp.2017.0199

97.

Platt

(2020, December 1). S&P Global’s $44bn deal shows data is the oil of the 21st century. Financial Times. https://www.ft.com/content/cd99579c-e01f-4a71-a124-e9c03598e5b9

98.

Potier

(2019, September 8). New tech to help disabled people. The Guardian. https://www.theguardian.com/technology/2019/sep/08/the-five-technology-to-help-disabled-people-blindness-paralysis-research-ai.

99.

Purdy

(2020, October 27). Unlocking AI’s potential for social good. https://hbr.org/2020/10/unlocking-ais-potential-for-social-good.

100.

*Rahman

H. A.

(2021). The invisible cage: Workers’ reactivity to opaque algorithmic evaluations. Administrative Science Quarterly, 66(4), 945–988.

101.

Raisch

Krakowski

(2021). Artificial intelligence and management: The automation-augmentation paradox. Academy of Management Review, 46(1), 192–210.

102.

Rao

Verweij

(2017). Sizing the prize: What’s the real value of AI for your business and how can you capitalise. PwC.

103.

Ratcliffe

(2020, November 30). Facebook and YouTube accused of complicity in Vietnam repression. The Guardian. https://www.theguardian.com/world/2020/dec/01/facebook-youtube-google-accused-complicity-vietnam-repression.

104.

*Raveendhran

Fast

N. J.

(2021). Humans judge, algorithms nudge: The psychology of behavior tracking acceptance. Organizational Behavior and Human Decision Processes, 164, 11–26.

105.

*Redden

(2018). Democratic governance in an age of datafication: Lessons from mapping government discourses and practices. Big Data & Society, 5(2), 2053951718809145.

106.

*Rietveld

Ploog

J. N.

Nieborg

D. B.

(2020). The coevolution of platform dominance and governance strategies: Effects on complementor performance outcomes. Academy of Management Discoveries, 6, 488–513.

107.

Romm

Zakrzewski

Lerman

(2020, October 7). House investigation faults Amazon, Apple, Facebook and Google for engaging in anti-competitive monopoly tactics. The Washington Post. https://www.washingtonpost.com/technology/2016/10/06/amazon-apple-facebook-google-congress/

108.

*Schafheitle

Weibel

Ebert

Kasper

Schank

Leicht-Deobald

(2020). No stone left unturned? Toward a framework for the impact of datafication technologies on organizational control. Academy of Management Discoveries, 6, 455–487.

109.

Scherer

A. G.

Voegtlin

(2020). Corporate governance for responsible innovation: Approaches to corporate governance and their implications for sustainable development. Academy of Management Perspectives, 34, 182–208.

110.

Scott

W. R.

(2013). Institutions and organizations: Ideas, interests, and identities. SAGE.

111.

Selznick

(1957). Leadership in administration: A sociological interpretation. Harper & Row.

112.

Shepardson

Somerville

(2019, March 5). Uber not criminally liable in fatal 2018 Arizona self-driving crash: Prosecutors 2018. Reuters. https://www.reuters.com/article/us-uber-crash-autonomous/uber-not-criminally-liable-in-fatal-2018-arizona-self-driving-crash-prosecutors-idUSKCN1QM2O8

113.

*Shrestha

Y. R.

Ben-Menahem

S. M.

Von Krogh

(2019). Organizational decision-making structures in the age of artificial intelligence. California Management Review, 61(4), 66–83.

114.

Singer

Isaac

(2020, January 29). Facebook to pay $550 million to settle facial recognition suit. The New York Times. https://www.nytimes.com/2020/01/29/technology/facebook-privacy-lawsuit-earnings.html

115.

Stempel

(2020, June 2). Google faces $5 billion lawsuit in U.S. for tracking “private” internet use. Reuters. https://www.reuters.com/article/us-alphabet-google-privacy-lawsuit/google-faces-5-billion-lawsuit-in-u-s-for-tracking-private-internet-use-idUSKBN23933H

116.

Sunstein

C. R.

(2018). Citizens. In #Republic divided democracy in the age of social media (pp. 163–164). Princeton University Press.

117.

*Tambe

Cappelli

Yakubovich

(2019). Artificial intelligence in human resources management: Challenges and a path forward. California Management Review, 61(4), 15–42.

118.

*Tschang

F. T.

Almirall

(2020). Artificial intelligence as augmenting automation: Implications for employment. Academy of Management Perspectives, 35, 642–659. https://doi.org/10.5465/amp.2019.0062

119.

*Vergne

J. P.

(2020). Decentralized vs. distributed organization: Blockchain, machine learning and the future of the digital platform. Organization Theory, 1(4), 2631787720977052.

120.

*West

S. M.

(2019). Data capitalism: Redefining the logics of surveillance and privacy. Business & Society, 58, 20–41.

121.

*Whelan

(2019). Born political: A dispositive analysis of Google and copyright. Business & Society, 58, 42–73.

122.

*Yeung

(2018). Algorithmic regulation: A critical interrogation: Algorithmic regulation. Regulation & Governance, 12(4), 505–523. https://doi.org/10.1111/rego.12158

123.

Zuboff

(2019). The age of surveillance capitalism: The fight for the future at the new frontier of power. Profile Books.

124.

*Zwitter

(2014). Big data ethics. Big Data & Society, 1(2), 205395171455925. https://doi.org/10.1177/2053951714559253

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.03 MB