Statistical Imaginaries,State Legitimacy: Grappling With the Arrangements Underpinning Quantification in the U.S. Census

Abstract

Over the last century, the adoption of novel scientific methods for conducting the U.S. census has been met with wide-ranging receptions. Some were quietly embraced, while others sparked decades-long controversies. What accounts for these differences? We argue that controversies emerge from and reconfigure arrangements of statistical imaginaries, putting into tension divergent visions of the census. To analyze these dynamics, we compare reactions to two methods designed to improve data accuracy – imputation and adjustment – and two methods designed to protect confidentiality – swapping and differential privacy, offering insight into how each method reconfigures stakeholder orientations and rhetorical claims. These cases allow us to reflect on how technocratic efforts to improve accuracy and confidentiality can strengthen – or erode – trust in data. Our analysis shows how the credibility of the Census Bureau and its data stem not just from empirical evaluations of quantification but also from how statistical imaginaries are contested and stabilized.

Keywords

science and technology studies (STS)census privacy statistics imaginaries epistemology government modernization

Get full access to this article

View all access options for this article.

References

Abowd

(2018a) Disclosure avoidance for block level data and protection of confidentiality in public tabulations. Available at: https://www2.census.gov/cac/sac/meetings/2018-12/abowd-disclosure-avoidance.pdf

Abowd

(2018b) Protecting the confidentiality of America’s statistics: adopting modern disclosure avoidance methods at the census Bureau. The United States Census Bureau. Available at: https://www.census.gov/newsroom/blogs/research-matters/2018/08/protecting_the_confi.html (accessed 23 July 2021).

Abowd

Hawes

(2023) Confidentiality protection in the 2020 US census of population and housing. Annual Review of Statistics and Its Application 10(1): 119–144.

Abowd

Velkoff

(2019) Balancing privacy and accuracy: new opportunity for disclosure avoidance analysis. Available at: https://www.census.gov/newsroom/blogs/research-matters/2019/10/balancing_privacyan.html (accessed 17 July 2021).

Akin

(1977) Technocracy and the American Dream: The Technocrat Movement, 1900–1941. Berkeley, CA: University of California Press.

Alabama v. Department of Commerce, Case No. 3:21-cv-211-RAH-ECM-KCN (WO) (M.D. Ala. 2021). https://www.brennancenter.org/our-work/court-cases/alabama-v-us-dept-commerce

Alonso

Starr

(eds) (1987) The Politics of Numbers. New York: Russell Sage Foundation.

Anderson

(1983) Imagined Communities: Reflections on the Origin and Spread of Nationalism. London: Verso Books.

Anderson

(2015) The American Census: A Social History. 2nd ed. New Haven, CT: Yale University Press.

10.

Anderson

Fienberg

(1999) To sample or not to sample? The 2000 census controversy. The Journal of Interdisciplinary History 30(1): 1–36.

11.

Anderson

Fienberg

(2001) Who Counts? The Politics of Census-Taking in Contemporary America. 1st ed. New York: Russell Sage Foundation.

12.

Andridge

Little

RJA

(2010) A review of hot deck imputation for survey non-response. International Statistical Review 78(1): 40–64.

13.

Bach

Swartz

(2022) Making money public: the journalistic construction of the paycheck protection program. International Journal of Communication 16(0): 021.

14.

Barry

(2002) The anti-political economy. Economy and Society 31(2): 268–284.

15.

Beck

Lash

Wynne

(1992) Risk Society: Towards a New Modernity. London: Sage.

16.

Berman

(2022) Thinking Like an Economist: How Efficiency Replaced Equality in U.S. Public Policy. Princeton, NJ: Princeton University Press. Available at: https://www.degruyter.com/document/doi/10.1515/9780691226606/html?lang=en (accessed 9 December 2022).

17.

Berman

Hirschman

(2018) The sociology of quantification: where are we now? Contemporary Sociology: A Journal of Reviews 47(3): 257–266.

18.

Bouk

boyd

(2021) Democracy’s data infrastructure. Available at: https://knightcolumbia.org/content/democracys-data-infrastructure

19.

boyd

Sarathy

(2022) Differential perspectives: epistemic disconnects surrounding the U.S. Census Bureau’s use of differential privacy. Harvard Data Science Review. Available at: https://hdsr.mitpress.mit.edu/pub/3vj5j6i0/release/3

20.

Brissette

(2016) From complicit citizens to potential prey: state imaginaries and subjectivities in US war resistance. Critical Sociology 42(7–8): 1163–1177.

21.

Bryant

Dunn

(1995) Moving Power and Money: The Politics of Census Taking. Ithaca, NY: New Strategist Publications.

22.

Cantwell

(2021) How we complete the census when households or group quarters don’t respond. Available at: https://www.census.gov/newsroom/blogs/random-samplings/2021/04/imputation-when-households-or-group-quarters-dont-respond.html (accessed 17 November 2023).

23.

Cantwell

Hogan

Styles

(2005) Imputation, Apportionment, and Statistical Methods in the U.S. Census: Issues Surrounding Utah V. Evans. Washington, DC: Statistical Research Division U.S. Bureau of the Census. Available at: https://www.census.gov/content/dam/Census/library/working-papers/2005/adrm/rrs2005-01.pdf

24.

Castells

(2011) A network theory of power. International Journal of Communication 5: 15.

25.

Choldin

(1994) Looking for the Last Percent: The Controversy Over Census Undercounts. New Brunswick, NJ: Rutgers University Press.

26.

Christ

Radway

Bellovin

(2022) Differential privacy and swapping: examining de-identification’s Impact on minority representation and privacy preservation in the U.S. Census. In: 2022 IEEE symposium on security and privacy (S&P), San Francisco, CA, 22–26 May, pp.457–472. New York: IEEE.

27.

Clarke

Braun

(2017) Thematic analysis. The Journal of Positive Psychology 12(3): 297–298.

28.

Daipha

(2015) Masters of Uncertainty: Weather Forecasters and the Quest for Ground Truth. Chicago, IL: The University of Chicago Press.

29.

Dalenius

Reiss

(1982) Data-swapping: a technique for disclosure control. Journal of Statistical Planning and Inference 6(1): 73–85.

30.

Davis

(2023) The routinization of lay expertise: a diachronic account of the invention and stabilization of an open-source artificial pancreas. Social Studies of Science. Epub ahead of print 28 December. DOI: 10.1177/03063127231214237.

31.

Department of Commerce v. U.S. House of Representatives, 525 U.S. 316 (1999). https://supreme.justia.com/cases/federal/us/525/316/

32.

Deringer

(2018) Calculated Values: Finance, Politics, and the Quantitative Age. Cambridge, MA: Harvard University Press.

33.

Desrosières

(1990) How to make things which hold together: social science, statistics and the state. In: Wittrock

Wagner

Whitley

, et al. (eds) Discourses on Society. Dordrecht: Springer, pp.195–218.

34.

Desrosières

(2011) The Politics of Large Numbers: A History of Statistical Reasoning. Cambridge, MA: Harvard University Press.

35.

Didier

(2018) Globalization of quantitative policing: between management and statactivism. Annual Review of Sociology 44(1): 515–534.

36.

Dinur

Nissim

(2003) Revealing information while preserving privacy. In: PODS ’03: Proceedings of the twenty-second ACM SIGMOD-SIGACT-SIGART symposium on principles of database systems, San Diego, CA, 9–11 June, pp.202–210. New York: ACM. Available at: http://portal.acm.org/citation.cfm?doid=773153.773173 (accessed 14 January 2022).

37.

Dupree

(1986) Science in the Federal Government: A History of Policies and Activities ( Johns

Hopkins

pbk. ed). Baltimore, MD: Johns Hopkins University Press.

38.

Dwork

McSherry

Nissim

, et al. (2006) Calibrating noise to sensitivity in private data analysis. In: Halevi

Rabin

(eds) Theory of Cryptography Conference. Berlin: Springer, pp.265–284.

39.

Dwork

Smith

Steinke

, et al. (2017) Exposed! A survey of attacks on private data. Annual Review of Statistics and Its Application 4(1): 61–84.

40.

Emigh

Riley

Ahmed

(2016) Antecedents of Censuses from Medieval to Nation States: How Societies and States Count. New York: Palgrave Macmillan.

41.

Epstein

(1996) Impure Science: AIDS, Activism, and the Politics of Knowledge. Oakland, CA: University of California Press.

42.

Eyal

(2019) The Crisis of Expertise. Cambridge; Medford, MA: Polity Press.

43.

Ezrahi

(1990) The Descent of Icarus: Science and the Transformation of Contemporary Democracy. Cambridge, MA: Harvard University Press.

44.

Fienberg

McIntyre

(2005) Data swapping: variations on a theme by Dalenius and Reiss. Journal of Official Statistics 21(2): 309–323.

45.

Freedman

(1993) Adjusting the census of 1990. Jurimetrics 34(1): 99–106.

46.

Ghosh

(2020) Making It Count: Statistics and Statecraft in the Early People’s Republic of China. Princeton, NJ: Princeton University Press. Available at: https://www.degruyter.com/document/doi/10.1515/9780691199214/html?lang=de (accessed 9 December 2022).

47.

Hacking

(1990) The Taming of Chance. Cambridge: Cambridge University Press.

48.

Hacking

(2006) Making up people. London Review of Books 28(16): 161–171.

49.

Hawes

(2019) Title 13, differential privacy, and the 2020 decennial census. Available at: https://www2.census.gov/about/policies/2019-11-paper-differential-privacy.pdf (accessed 1 January 2020).

50.

Hawes

Rodriguez

(2021) Determining the privacy-loss budget: research into alternatives to differential privacy. Available at: https://www.census.gov/data/academy/webinars/2021/disclosure-avoidance-series/research-into-alternatives-to-differential-privacy.html

51.

Hogan

(2001) Declaration of Howard Hogan (Civil No. 2001: CV-000292G, 11 July). Salt Lake City, UT: Utah v. Evans, U.S. District Court for the District of Utah, Central Division.

52.

Hotz

Salvo

(2020) Assessing the use of differential privacy for the 2020 census: summary of what we learned from the CNSTAT workshop. American Statistical Association. Available at: https://www.amstat.org/asa/files/pdfs/POL-CNSTAT_CensusDP_WorkshopLessonsLearnedSummary.pdf

53.

Hotz

Salvo

(2022) A chronicle of the application of differential privacy to the 2020 Census. Harvard Data Science Review. Available at: https://hdsr.mitpress.mit.edu/pub/ql9z7ehf/release/8

54.

Jackson

(2014) Rethinking repair. In: Foot

Boczkowski

Gillespie

(eds) Media Technologies: Essays on Communication, Materiality, and Society. Cambridge, MA: MIT Press, pp.221–250.

55.

Jasanoff

Kim

S-H

(2009) Containing the atom: sociotechnical imaginaries and nuclear power in the United States and South Korea. Minerva 47(2): 119–146.

56.

JASON (2020) Formal privacy methods for the 2020 census. Available at: https://www2.census.gov/programs-surveys/decennial/2020/program-management/planning-docs/privacy-methods-2020-census.pdf

57.

Joyce

Mukerji

(2017) The state of things: state history and theory reconfigured. Theory & Society 46(1): 1–19.

58.

Lampland

(2010) False numbers as formalizing practices. Social Studies of Science 40(3): 377–404.

59.

Lane

(2021) Democratizing Our Data: A Manifesto. Cambridge, MA; London: MIT Press.

60.

Latour

(1993) We Have Never Been Modern. Cambridge, MA: Harvard University Press.

61.

Levitt

(2019) Citizenship and the census. Columbia Law Review 119(5): 1355–1398.

62.

McCormick

(2009) William Petty and the Ambitions of Political Arithmetic. Oxford and New York: Oxford University Press.

63.

Mennicken

Espeland

(2019) What’s new with numbers? Sociological approaches to the study of quantification. Annual Review of Sociology 45(1): 223–245.

64.

Mitchell

(2008) Rethinking economy. Geoforum 39(3): 1116–1121.

65.

Mora

(2014) Making Hispanics: How Activists, Bureaucrats, and Media Constructed a New American. Chicago, IL: University of Chicago Press.

66.

Murphy

(2017) The Economization of Life. Durham, NC: Duke University Press.

67.

National Research Council (1978) Counting the People in 1980: An Appraisal of Census Plans. Washington, DC: The National Academies Press. Available at: https://nap.nationalacademies.org/catalog/27262/counting-the-people-in-1980-an-appraisal-of-census-plans (accessed 7 March 2024).

68.

National Research Council (2006) Once, Only Once, and in the Right Place: Residence Rules in the Decennial Census. Washington, DC: National Academies Press. Available at: http://www.nap.edu/catalog/11727 (accessed 17 March 2024).

69.

National Research Council (2009) Reengineering the Survey of Income and Program Participation. Washington, DC: National Academies Press. Available at: http://www.nap.edu/catalog/12715 (accessed 17 March 2024).

70.

Nobles

(2000) Shades of Citizenship: Race and the Census in Modern Politics. Redwood City, CA: Stanford University Press.

71.

O’Hare

(2019) Differential Undercounts in the U.S. Census. New York: Springer Berlin Heidelberg.

72.

Parks

(2015) Stuff you can kick: toward a theory of media infrastructures. In: Goldberg

Svensson

(eds) Between Humanities and the Digital. Cambridge, MA: MIT Press, pp.355–374.

73.

Persily

(2010) The law of the census: how to count, what to count, whom to count, and where to count them. ID 1724982, SSRN Scholarly Paper, 13 December. Rochester, NY: Social Science Research Network. Available at: https://papers.ssrn.com/abstract=1724982 (accessed 24 January 2022).

74.

Pinch

Bijker

(1984) The social construction of facts and artefacts: or how the sociology of science and the sociology of technology might benefit each other. Social Studies of Science 14(3): 399–441.

75.

Porter

(2020) Trust in Numbers. Princeton, NJ: Princeton University Press. Available at: https://press.princeton.edu/books/paperback/9780691208411/trust-in-numbers (accessed 17 July 2021).

76.

Power

(1997) The Audit Society: Rituals of Verification. Oxford: OUP.

77.

Prewitt

(2016) What Is Your Race? The Census and Our Flawed Efforts to Classify Americans. Princeton, NJ: Princeton University Press.

78.

Rodríguez

(2000) Changing Race: Latinos, the Census, and the History of Ethnicity in the United States. New York: NYU Press.

79.

Rodríguez-Muñiz

(2021) Figures of the Future: Latino Civil Rights and the Politics of Demographic Change. Princeton, NJ: Princeton University Press.

80.

Rosa

(2014) Gender statactivism and NGOs: development and use of gender sensitive-data for mobilizations and women’s rights. Partecipazione e Conflitto 7(2): 314–347.

81.

Rosenthal

(2000) Striving for perfection: a brief history of advances and undercounts in the U.S. Census. Government Information Quarterly 17(2): 193–208.

82.

Roy

(2009) Field Notes on Democracy. Chicago, IL: Haymarket Books.

83.

Rubin

(2018) Multiple imputation. In: Van Buuren

(ed.) Flexible Imputation of Missing Data. 2nd ed. Boca Raton, FL: Chapman & Hall/CRC, pp.29–62.

84.

Ruggles

Fitch

Magnuson

, et al. (2019) Differential privacy and census data: implications for social and economic research. AEA Papers and Proceedings 109: 403–408.

85.

Scheuren

(2005) Multiple imputation. The American Statistician 59(4): 315–319.

86.

Schor

(2017) Counting Americans: How the US Census Classified the Nation. Oxford: Oxford University Press.

87.

Scott

(1999) Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed. New Haven, CT; London: Yale University Press.

88.

Seltzer

Anderson

(2001) The dark side of numbers: the role of population data systems in human rights abuses. Social Research 68(2): 481–513.

89.

Seltzer

Anderson

(2007) Census confidentiality under the second war powers act (1942–1947). In: Population association of America 2007 annual meeting, New York, 29 March. Available at: https://paa2007.populationassociation.org/papers/70299 (accessed 10 August 2024).

90.

Stapleford

(2009) The Cost of Living in America: A Political History of Economic Statistics, 1880–2000. Cambridge and New York: Cambridge University Press.

91.

Star

(1999) The ethnography of infrastructure. American Behavioral Scientist 43(3): 377–391.

92.

Star

Ruhleder

(1996) Steps toward an ecology of infrastructure: design and access for large information spaces. Information Systems Research 7(1): 25.

93.

Starr

(1987) The sociology of official statistics. In: Alonso

Starr

(eds) The Politics of Numbers. New York: Russell Sage Foundation, pp.7–57.

94.

Strathern

(2000) The tyranny of transparency. British Educational Research Journal 26(3): 309–321.

95.

Sturge

(2022) Bad Data: How Governments, Politicians and the Rest of Us Get Misled by Numbers. New York: Little Brown Book Group Limited.

96.

Taylor

(2004) Modern Social Imaginaries. Durham, NC: Duke University Press.

97.

Tooze

(2008) Trouble with numbers: statistics, politics, and history in the construction of Weimar’s trade balance, 1918–1924. The American Historical Review.

98.

U.S. Census Bureau (2009) History: 2000 Census of Population and Housing (Volume 1). Washington, DC: U.S. Census Bureau.

99.

U.S. Census Bureau (2019) A history of census privacy protections. Available at: https://www.census.gov/library/visualizations/2019/comm/history-privacy-protection.html

100.

U.S. Census Bureau (2021) Comparing Differential Privacy with Older Disclosure Avoidance Methods. Washington, DC: U.S. Census Bureau.

101.

Utah v. Evans, 536 U.S. 452 (2002).

102.

Vertesi

boyd

(2023) The resource bind: system failure and legitimacy threats in sociotechnical organizations. Sociologica 17(3): 325–349.

103.

Villacis

Thiel

Capistrano

, et al. (2022) Statistical innovation in the Global South: mechanisms of translation in censuses of Brazil, Ecuador, Ghana and Sierra Leone. Comparative Sociology 21(4): 419–446.

104.

Wilson

(1887) The study of administration. Political Science Quarterly 2(2): 197–222.

105.

Wisconsin v. City of New York, 517 U.S. 1 (1996).