Using Administrative Data to Better Understand the Reliability of ICMA’s Alternative Service Delivery Survey

Abstract

The International City/County Management Association’s Alternative Service Delivery (ASD) Survey has been highly influential in the study of make-or-buy and sector choice decisions at the local level. Recently, the reliability of the ASD has been called into question. This paper builds on Lamothe, Lamothe, and Bell’s findings of inconsistencies in these data by comparing 2007 ASD survey results with those found in 2007–2008 administrative data from California. The findings lend further credence to the idea that ASD data should be used with caution and an understanding of its limits and weaknesses, as well as the need to collect more reliable data on local service delivery decisions.

Keywords

local service delivery ICMA ASD survey data reliability administrative data

Get full access to this article

View all access options for this article.

References

American Statistical Association. 1977. “Report of Ad Hoc Committee on Privacy and Confidentiality.” The American Statistician 31 (2): 59–78.

Biemer

Paul P.

2010. “Total Survey Error: Design, Implementation, and Evaluation.” Public Opinion Quarterly 74 (5): 817–48.

Blalock

Hubert M.

Jr.

1979. Social Statistics. revised 2nd ed. Boston, MA: WCB McGraw-Hill.

Bound

John

Krueger

Alan B.

1991. “The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?” Journal of Labor Economics 9 (1): 1–24.

Brown

Trevor L.

Potoski

Matthew

. 2003. “Transaction Costs and Institutional Explanations for Government Service Production Decisions.” Journal of Public Administration Research and Theory 13 (4): 441–68.

Brown

Trevor L.

Potoski

Matthew

Van Slyke

David M.

2008. “Changing Modes of Service Delivery: How Past Choices Structure Future Choices.” Environment and Planning C: Government and Policy 26 (1): 127–43.

California State Controller’s Office. 2010. 2007-2008 Cities Annual Report. http://californiacityfinance.com/SCOcities200708.pdf (accessed August 26, 2023).

Ferris

James

Graddy

Elizabeth

. 1986. “Contracting Out: For What? With Whom?” Public Administration Review 46 (4): 332–44.

Groen

Jeffrey A.

2012. “Sources of Error in Survey and Administrative Data: The Importance of Reporting Procedures.” Journal of Official Statistics 28 (2): 173–98.

10.

Hefetz

Amir

Warner

Mildred

. 2004. “Privatization and Its Reverse: Explaining the Dynamics of the Government Contracting Process.” Journal of Public Administration Research and Theory 14 (2): 171–90.

11.

ICMA. 2007. Profile of Local Government Service Delivery Choices, Survey Data. Washington, DC: International City/County Management Association.

12.

Johnson

Barry

Moore

Kevin

. n.d. “Consider the Source: Differences in Estimates of Income and Wealth from Survey and Tax Data.” Washington, DC: United States Internal Revenue Service. https://www.irs.gov/pub/irs-soi/11pwcompench9asource.pdf (accessed July 12, 2024).

13.

Kang

Seong C.

Nesbit

Rebecca

Brudney

Jeffrey L.

2022. “Local Government Volunteer Use: A Resource Dependence and Transaction Costs Explanation.” Public Administration Review 82 (5): 806–817.

14.

Lamothe

Meeyoung

Lamothe

Scott

Bell

Elizabeth

. 2018. “Studying Local Service Delivery Arrangements: Is ICMA Data Reliable?” Public Administration Review 78 (4): 613–25.

15.

Lamothe

Scott

Lamothe

Meeyoung

. 2024. “Towards a Better Understanding of Local Service Provision: Implications for Studying the Determinants of Production Choice.” Public Administration Review 84 (5): 904–917.

16.

Lamothe

Scott

Lamothe

Meeyoung

Feiock

Richard C.

2008. “Examining Local Government Service Delivery Arrangements over Time.” Urban Affairs Review 44 (1): 27–57.

17.

Levin

Jonathan

Tadelis

Steven

. 2010. “Contracting for Government Services: Theory and Evidence from U.S. Cities.” Journal of Industrial Economics 58 (3): 507–541.

18.

Marvel

Mary K.

Marvel

Howard P.

2007. “Outsourcing Oversight: A Comparison of Monitoring for In-House and Contracted Services.” Public Administration Review 67 (3): 521–30.

19.

PublicCEO. 2009. “Breaking down California City Governments.” https://www.publicceo.com/2009/06/breaking-down-california-city-governments/ (accessed September 24, 2024).

20.

Smith

Steven Rathgeb

. 2017. “Cross-Sector Nonprofit-Government Financing.” In Nonprofits and Government: Collaboration and Conflict, edited by Boris

Elizabeth T.

Steuerle

C. Eugene

, 103–132. New York, NY: Rowman & Littlefield.

21.

Stein

Robert

. 1993. “Arranging City Services.” Journal of Public Administration Research and Theory 3 (1): 66–92.

22.

Stuber

Heiko

Grabka

Markus M.

Schnitzlein

Daniel D.

2023. “A Tale of Two Data Sets: Comparing German Administrative and Survey Data Using Wage Inequality as an Example.” Journal for Labour Market Research 57 (8): 1–18.

23.

Warner

Mildred

Hefetz

Amir

. 2004. “Pragmatism over Politics: Alternative Service Delivery in Local Government, 1992-2002.” In Municipal Year Book 2004, edited by International City/County Management Association, 8–16. Washington, DC: International City/County Management Association.

24.

Warner

Mildred E.

Hefetz

Amir

. 2009. “Trends in Public and Contracted Government Services: 2002-2007 (Policy Brief 80).” Washington, DC: Reason Foundation. https://reason.org/wp-content/uploads/files/pb80_privatization_trends.pdf (accessed August 26, 2023).