Don’t Fear Artificial Intelligence,Question the Business Model: How Surveillance Capitalists Use Media to Invade Privacy,Disrupt Moral Autonomy,and Harm Democracy

Abstract

This paper analyzes the causes, consequences, and logic of surveillance capitalism, delineating how behavioral surplus became the latest form of accumulation and questioning its ethical, legal, and material implications. The purpose of this project is to provide a decisively human response to an otherwise reductive, totalizing political economic system that uses equally reductive technology. Using history, political economy, and media ethics, it shows how surveillance capitalists use artificial intelligence (AI) to disrupt the privacy necessary for identity work and distort the moral autonomy necessary for democratic worldmaking. Exploiting human psychology and emotional vulnerabilities, surveillance capitalists interfere with our ability to become better versions of our personal and collective selves. We must therefore reject surveillance capitalism and embrace a more inconclusive understanding of democracy informed by care. While experts and technocrats can endlessly debate the potential outcomes and possibilities, the challenges of AI and an abusive surveillance capitalist system must ultimately be answered by a caring citizenry with equally resilient social institutions.

Keywords

surveillance capitalism care ethics political economy artificial intelligence digital media commodification

Get full access to this article

View all access options for this article.

References

Allen

(2018, November 21). You snooze, you lose: Insurers make the old adage literally true. ProPublica. https://www.propublica.org/article/you-snooze-you-lose-insurers-make-the-old-adage-literally-true

Aristotle (1984). Aristotle’s politics. University of Chicago Press.

Arvanitakis

Francis

Obst

(2018, June 21). Data ethics is just more than what we do with data, it’s also about who’s doing it. The Conversation. https://theconversation.com/data-ethics-is-more-than-just-what-we-do-with-data-its-also-about-whos-doing-it-98010

Baldasty

G. J.

(1992). The commercialization of news in the nineteenth century. University of Wisconsin Press.

Banaji

(2020). A brief history of commercial capitalism. Haymarket Books.

Bauman

(2000). Liquid modernity. Polity Press.

Bauman

(2007). Consuming life. Polity Press.

Beck

Beck-Gernsheim

(2000). Individualization. Sage.

Berlin

(2004). Liberty. Oxford University Press.

10.

Birhane

(2021). Algorithmic injustice: a relational ethics approach. Patterns. https://doi.org/10.1016/j.patter.2021.100205

11.

Blevins

(2016). Panoptic mis-sorts and the hegemony of U.S. Data privacy. The Political Economy of Communication, 4(2), 18–33. https://www.polecom.org/index.php/polecom/article/view/69

12.

Bröckling

(2015). The entrepreneurial self: Fabricating a new type of subject. Sage.

13.

Busby

(2018, April 30). Revealed: How bookies use AI to keep gamblers hooked. Guardian. https://www.theguardian.com/technology/2018/apr/30/bookies-using-ai-to-keep-gamblers-hooked-insiders-say

14.

Butler

(1990). Gender trouble. Routledge.

15.

Clement

(1996). Care, autonomy, justice: Feminism and the ethic of care. Westview Press.

16.

Computer program can’t lose at checkers. (2007, July 19). Science X . https://phys.org/news/2007-07-checkers.html

17.

Couldry

Mejias

(2019). The costs of connection: How data is colonizing human life and appropriating it for capitalism. Stanford University Press.

18.

Curran

(2023). Surveillance capitalism and systemic digital risk: The imperative to collect and connect and the risks of interconnectedness. Big Data & Society, 10(1). https://doi.org/10.1177/20539517231177621

19.

Dahlberg

(2011). Re-constructing digital democracy: An outline of four ‘positions.’ New Media & Society, 13(6), 855–872. https://doi.org/10.1177/1461444810389569

20.

Deibert

(2020). Reset: Reclaiming the internet for civil society. Ananasi.

21.

Dietz

(1987). Context is all: Feminism and theories of citizenship. Daedalus, 116(4), 1–24. https://www.jstor.org/stable/20025121

22.

D’Ignazio

Klein

L. F.

(2020). Data feminism. MIT Press.

23.

Eubanks

(2018). Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin’s Press.

24.

Fairclough

(1992). Discourse and social change. Blackwell.

25.

Fairclough

(2015). Language and power (2^nd ed.). Routledge.

26.

Federal Trade Commission. (2018, January 8). Electronic toy maker VTech settles FTC allegations that it violated Children’s privacy law and the FTC Act. https://www.ftc.gov/news-events/news/press-releases/2018/01/electronic-toy-maker-vtech-settles-ftc-allegations-it-violated-childrens-privacy-law-ftc-act

27.

Ferguson

(2005, January 1). What’s next for Google. MIT Technology Review. https://www.technologyreview.com/2005/01/01/231826/whats-next-for-google/

28.

Frank

. (2000). One market under God: Extreme capitalism, market populism, and the end of economic democracy. Anchor Books.

29.

Fuchs

(2012). Dallas Smythe today – the audience commodity, the digital labor debate, Marxist political economy, and critical theory. Prolegomena to a digital labor theory of value. triple C: Cognition, Communication, co-Operation, 10(2), 692–740. https://doi.org/10.31269/triplec.v10i2.443

30.

Gibson-Graham

J. K.

(2007). The end of capitalism (as we knew it). University of Minnesota Press.

31.

Gibson-Graham

J. K.

Cameron

Healy

(2013). Take back the economy: An ethical guide for transforming our communities. University of Minnesota Press.

32.

Giddens

(1991). Modernity and self-identity. Stanford University Press.

33.

Gilligan

(1982). In a different voice: Psychological theory and women’s development. Harvard University Press.

34.

Gitelman

(2013). Raw data is an oxymoron. MIT Press.

35.

Grafanaki

(2017). Autonomy challenges in the age of big data. Fordham Intellectual Property, 27(4), 803–868. https://ir.lawnet.fordham.edu/iplj/vol27/iss4/3

36.

Grandinetti

& Bruinsma

(2023). The affective algorithms of Conspiracy TikTok. Journal of Broadcasting & Electronic Media, 67(3), 274–293. https://doi.org/10.1080/08838151.2022.2140806

37.

Gross

(2019, October 8). Whistleblower explains how Cambridge Analytica helped fuel US ‘insurgency’. NPR . https://www.npr.org/2019/10/08/768216311/whistleblower-explains-how-cambridge-analytica-helped-fuel-u-s-insurgency

38.

Haidt

(2021, November 21). The dangerous experiment on teen girls. The Atlantic. https://www.theatlantic.com/ideas/archive/2021/11/facebooks-dangerous-experiment-teen-girls/620767/

39.

Hall

(2000). Who needs ‘identity’? In Du Gay

Evans

Redman

(Eds.), Identity: A reader (pp. 15–30). Sage.

40.

Haraway

(2008). When species meet. University of Minnesota Press.

41.

Harding

(1993). Rethinking standpoint epistemology: What is strong objectivity? In Alcoff

Potter

(Eds.), Feminist epistemologies (pp. 49–82). Routledge.

42.

Harvey

(1989). The condition of postmodernity. Wiley-Blackwell.

43.

Harvey

(2005). A brief history of neoliberalism. Oxford University Press.

44.

Harvey

(2010). The enigma of capital: and the crises of capitalism (2^nd ed.). Oxford University Press.

45.

Hearn

(2017). Commodification. In Ouellette

Gray

(Eds.), Keywords for media studies (pp. 43–46). New York University Press.

46.

Hines

(2004, March 29). Google takes searching personally. C/Net . https://www.cnet.com/tech/services-and-software/google-takes-searching-personally/

47.

Hobsbawm

(1996). The age of capital: 1848–1875. Vintage Books.

48.

Horkheimer

Adorno

(2002). Dialectic of Enlightenment. Stanford University Press. (Original work published 1947).

49.

Jenkins

Jr. (2010, August 14). Google and the search for the future. The Wall Street Journal. https://www.wsj.com/articles/SB10001424052748704901104575423294099527212

50.

Jones

(2021). Caring with the public: An integration of feminist moral, environmental, and political philosophy in journalism ethics. Journal of Media Ethics, 36(2), 74–84. https://doi.org/10.1080/23736992.2021.1926255

51.

Jones

(2023). Reclaiming media: Answering surveillance capitalists with care-based democracy. Journal of Media Ethics, 38(4), 241–254. https://doi.org/10.1080/23736992.2023.2265343

52.

Keegan

(2021, December 6). The popular family safety app Life360 is selling precise location data on its tens of millions of users. The Markup. https://themarkup.org/privacy/2021/12/06/the-popular-family-safety-app-life360-is-selling-precise-location-data-on-its-tens-of-millions-of-user

53.

Kellner

(1995). Cultural studies, multiculturalism, and media culture. In Dines

Humez

(Eds.), Gender, race, and class in media (pp. 5–17). Sage.

54.

Kelly

(2001). The divine right of capital: Dethroning the corporate aristocracy. Berrett-Koehler Publishers.

55.

King

M. L.

Jr. (1967, April 4). Beyond Vietnam: A time to break silence. American Rhetoric. https://www.americanrhetoric.com/speeches/mlkatimetobreaksilence.htm

56.

König

(2022). Two tales about the power of algorithms in online environments: On the need for transdisciplinary dialogue in the study of algorithms and digital capitalism. Media, Culture & Society, 44(7), 1372–1382. https://doi.org/10.1177/01634437221111893

57.

Kramer

A. I.

Guillory

J. E.

Hancock

J. T.

(2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, 111(24), 8788–8790. https://doi.org/10.1073/pnas.1320040111

58.

LaFrance

(2021, October 25). ‘History will not judge us kindly’: The Facebook papers. The Atlantic. https://www.theatlantic.com/ideas/archive/2021/10/facebook-papers-democracy-election-zuckerberg/620478/

59.

McChesney

(2013). Digital disconnect: How capitalism is turning the internet against democracy. The New Press.

60.

McGuigan

(2012). Consumers: The commodity product of interactive commercial television, or, is Dallas Smythe’s thesis more Germane than ever? Journal of Communication Inquiry, 36(4), 288–304. https://doi.org/10.1177/0196859912459756

61.

Metcalf

Keller

Boyd

(2016, May 23). Perspectives on big data, ethics, and society. The Council for Big Data, Ethics, and Society. https://bdes.datasociety.net/council-output/perspectives-on-big-data-ethics-and-society/

62.

Murgia

Hancock

(2022, August 5). Ad tracking by online gambling industry comes under scrutiny. Financial Times. https://www.ft.com/content/f55bf4f9-43ba-4bc3-a4f6-53c6dcc5cf48

63.

Nissenbaum

(2010). Privacy in context: Technology, policy, and the integrity of social life. Stanford Law Books.

64.

Noble

(2018). Algorithms of oppression. NYU Press.

65.

O'Hara

(2021). Feedback loops: Algorithmic authority, emergent biases, and implications for information literacy. Pennsylvania Libraries: Research & Practice, 9(1), 8–15. https://doi.org/10.5195/palrap.2021.231

66.

Olsen

(2019). The sovereign consumer: A new intellectual history of neoliberalism. Palgrave-MacMillan.

67.

O’Mara

(2019). The code: Silicon Valley and the remaking of America. Penguin Press.

68.

O’Neil

(2016). Weapons of math destruction: How big data increases inequality and threatens democracy. Crown.

69.

Orlowski

(2020). The Social Dilemma. Netflix.

70.

Personalized search for everyone. (2009, December 4). Google. https://googleblog.blogspot.com/2009/12/personalized-search-for-everyone.html

71.

Phelan

(2014). Neoliberalism, media, and the political. Palgrave Macmillan.

72.

Regehr

Shaughnessy

Zhao

Shaughnessy

(2024). Safer scrolling: How algorithms popularize and gamify online hate and misogyny. University College of London and University of Kent. https://www.ascl.org.uk/ASCL/media/ASCL/Help%20and%20advice/Inclusion/Safer-scrolling.pdf

73.

Reviglio

Agosti

(2020). Thinking outside the black-box: The case for “algorithmic sovereignty” in social media. Social Media & Society, 6(2). https://doi.org/10.1177/2056305120915613

74.

Shaban

(2022). Iranian feminism and transnational ethics in media discourse. Rowman & Littlefield.

75.

Shiva

(2015). Earth democracy: Justice, sustainability, and peace. North Atlantic Books.

76.

Smythe

D. W.

(2001). On the audience commodity and its work. In Durham

M. G.

Kellner

(Eds.), Media and cultural studies: Key works (pp. 253–279). Blackwell.

77.

Statt

(2018, December 4). Google personalizes search results even when you’re logged out, new study claims. The Verge. https://www.theverge.com/2018/12/4/18124718/google-search-results-personalized-unique-duckduckgo-filter-bubble

78.

Tronto

(1995). Care as a basis for radical political judgments. Hypatia, 10(2), 141–149. https://doi.org/10.1111/j.1527-2001.1995.tb01376.x

79.

Tronto

(2013). Caring democracy: Markets, equality, justice. NYU Press.

80.

Turow

Hennessy

Draper

(2015). The tradeoff fallacy. Annenberg School for Communication. ScholarlyCommons. https://repository.upenn.edu/cgi/viewcontent.cgi?article=1554&context=asc_papers

81.

Vermeulen

(2022). To nudge or not to nudge: News recommendation as a tool to achieve online media pluralism. Digital Journalism, 10(10), 1671–1690. https://doi.org/10.1080/21670811.2022.2026796

82.

Warren

Brandeis

(1890). The right to privacy. Harvard Law Review, 4(5), 193–220. https://groups.csail.mit.edu/mac/classes/6.805/articles/privacy/Privacy_brand_warr2.html

83.

Wells

Horwitz

Seetharaman

(2021, September 14). Facebook knows Instagram is toxic for teen girls, company documents show. The Wall Street Journal. https://www.wsj.com/articles/facebook-knows-instagram-is-toxic-for-teen-girls-company-documents-show-11631620739?mod=article_inline

84.

Yeung

(2018). ‘Hypernudge’: Big data as a mode of regulation by design. Information, Communication, & Society, 20(1), 118–136. https://doi.org/10.1080/1369118X.2016.1186713

85.

Zuboff

(2014). A digital declaration: Big data as surveillance capitalism. Frankfurter Allgemeine Zeitung. https://opencuny.org/pnmarchive/files/2019/01/Zuboff-Digital-Declaration.pdf

86.

Zuboff

(2019). The age of surveillance capitalism: The fight for a human future at the new frontier of power. PublicAffairs.

87.

Zuboff

(2022). Surveillance capitalism or democracy? the death match of institutional orders and the politics of knowledge in our information civilization. Organization Theory, 3(3). https://doi.org/10.1177/26317877221129290