Research correlating stringency in land-use regulation to low housing supply, high housing costs, and segregation relies on surveys of planners about land-use regulation. Housing policy reform proposals rely on much of this same research. We assess the reliability and validity of questions from three surveys using objective data on land-use regulation and its application. Response errors indicate that planners systematically underestimate the stringency effects of local regulation while overestimating the impact of state law. This signals potential bias that may skew some analysis. Scholars should account for this potential bias when analyzing survey data to inform land-use policy debates.
BethlehemJelke. 2009. Applied Survey Methods: A Statistical Perspective. Wiley Series in Survey Methodology. Edited by GrovesRobert M.KaltonGrahamRaoJ. N. K.SchwarzNorbertSkinnerChristopher. Hoboken: Wiley.
CowlesErnest L.NelsonEdward. 2015. An Introduction to Survey Research. 1st ed. New York: Business Expert Press Quantitative Approaches to Decision Making Collection.
7.
CreswellJohn W.2013. Qualitative Inquiry & Research Design: Choosing among Five Approaches. New York: Sage.
8.
CreswellJohn W.ClarkVicki L. Plano. 2011. Designing and Conducting Mixed Methods Research. New York: Sage.
9.
Data Strategy, An Appendix to the Statewide Housing Plan, Department of Housing and Community Development (Ca. 2022).
10.
ElmendorfChristopher S.BiberEricMonkkonenPaavoO’NeillMoira. 2020. “Making It Work: Legal Foundations for Administrative Reform of California’s Housing Framework.” Ecology Law Quarterly47 (4): 973–1060.
11.
FischelWilliam A.1995. Regulatory Takings: Law, Economics, and Politics. Cambridge: Harvard University Press.
12.
FowlerFloyd J.2012. Survey Research Methods. 4th ed.New York: Sage.
13.
GabbeC. J.2018. “How Do Developers Respond to Land Use Regulations? An Analysis of New Housing in Los Angeles.” Housing Policy Debate28 (3): 411–27.
14.
GlaeserEdwardGyourkoJoseph. 2002. “The Impact of Zoning on Housing Affordability.” Working Paper No. 8835, NBER Working Paper Series. National Bureau of Economic Research, Cambridge.
15.
GlaeserEdwardGyourkoJosephSaksRaven. 2005. “Why Is Manhattan so Expensive? Regulation and the Rise in Housing Prices” Journal of Law and Economics48 (2): 331–69.
16.
GlaeserEdwardGyourkoJosephSaksRaven. 2006. “Urban Growth and Housing Supply.” Journal of Economic Geography6 (1): 71–89.
17.
GyourkoJosephHartleyJonathanKrimmelJacob. 2019. “The Local Residential Land Use Regulatory Environment Across U.S. Housing Markets: Evidence from a New Wharton Index.” National Bureau of Economic Research. https://www.nber.org/papers/w26573.
18.
GyourkoJosephMolloyRaven. 2015. “Regulation and Housing Supply.” In: DurantonGillesVernon HendersonJ.StrangeWilliam, (eds) Handbook of Regional and Urban Economics. Amsterdam: Elsevier, 1289–1337.
19.
GyourkoJosephSaizAlbertSummersAnita. 2008. “A New Measure of the Local Regulatory Environment for Housing Markets: The Wharton Residential Land Use Regulatory Index.” Urban Studies45 (3): 693–729.
20.
Inglewood Municipal Code §12-39.50 and §12-101 (2018).
21.
JacksonKristoffer. 2016. “Do Land Use Regulations Stifle Residential Development? Evidence from California Cities.” Journal of Urban Economics91:45–56.
22.
KazisNoah. 2020. Ending Exclusionary Zoning in New York City’s Suburbs. New York: NYU Furman Center, New York University.
23.
KingGaryKeohaneRobert O.VerbaSidney. 1994. Designing Social Inquiry: Scientific Inference in Qualitative Research. Princeton: Princeton University Press.
24.
LeeGeonBenoit-BryanJenniferJohnsonTimothy. 2012. “Survey Research in Public Administration: Assessing Mainstream Journals with a Total Survey Error Framework.” Public Administration Review72 (1): 87–97.
25.
LemarAnika Singh. 2018. “The Role of States in Liberalizing Land Use Regulations.” North Carolina Law Review97 (2): 293–354.
26.
LensMichaelMonkkonenPaavo. 2016. “Do Strict Land Use Regulations Make Metropolitan Areas More Segregated by Income?” Journal of the American Planning Association82(1): 6–21.
27.
LevineNed. 2020. “What’s Wrong with Objective Questions?” Journal of the American Planning Association86 (2): 267–68.
28.
LewisPaul G.MarantzNicholas J.2019. “What Planners Know: Using Surveys about Local Land-Use Regulation to Understand Housing Development.” Journal of the American Planning Association85: 445–462.
29.
LewisPaul G.MarantzNicholas J.2020. “A Response to Comments on ‘What Planners Know: Using Surveys about Local Land Use Regulation to Understand Housing Development.’” Journal of the American Planning Association86 (2): 270–71.
ManvilleMichaelMonkkonenPaavoLensMichael. 2020. “It’s Time to End Single-Family Zoning.” Journal of the American Planning Association86 (1): 106–12.
32.
MawhorterSarahReidCarolina. 2018. Local Housing Policies Across California: Presenting the Results of a New Statewide Survey. Berkeley: Terner Center for Housing Innovation, UC Berkeley.
33.
MenendianStephenGambhirSamirGailesArthur. 2020. Racial Segregation in the San Francisco Bay Area, Part 5. Berkeley: University of California, Berkeley.
34.
MleczkoMatthewDesmondMatthew. 2023. “Using natural language processing to construct a National Zoning and Land Use Database”. Urban Studies60(13): 2564–2584.
O’NeillMoiraBiberEricMarantzNicholas. 2023. “Measuring Local Policy to Advance Fair Housing and Climate Goals through a Comprehensive Assessment of Land Use Entitlements” Pepperdine Law Review50:505.
37.
O’NeillMoiraBiberEricGiuliaGualco-NelsonMarantzNicholas. 2022. “Examining Entitlement in California to Inform Policy and Process: Advancing Social Equity in Housing Development Patterns.” Report prepared for the California Air Resources Board and the California Environmental Protection Agency, University of California, Berkeley.
38.
O’NeillMoiraGualco-NelsonGiuliaBiberEric. 2019. “Developing Policy from the Ground Up: Examining Entitlement in the Bay Area to Inform California’s Housing Policy Debates.” Hastings Environmental Law Journal25(1): 1–84.
39.
O’NeillMoiraGualco-NelsonGiuliaBiberEric. 2021. “Sustainable Communities or the Next Urban Renewal?” Ecology Law Quarterly47(4):1061.
40.
PendallRolf. 2000. “Local Land Use Regulation and the Chain of Exclusion.” Journal of the American Planning Association66 (2): 125.
41.
PendallRolf. 2020. “Knowing What Land Use Regulations Localities Have “On the Books” Can Reveal Regulatory Stringency—And Much More.” Journal of the American Planning Association86 (2): 264–65.
42.
PuentesRobertMartinJonathanPendallRolf. 2006. “From Traditional to Reformed: A Review of the Land Use Regulations in the Nation’s 50 Largest Metropolitan Areas.” Research Brief, Metropolitan Policy Program. Washington, DC: The Brookings Institution.
43.
QuigleyJohn M.RaphaelS.RosenthalL. A.2009. “Measuring Land Use Regulations and their Effects in the Housing Market.” In Housing Markets and the Economy: Risk, Regulation, and Policy: Essays in Honor of Karl E. Case, edited by CaseKarl E.GlaeserEdward L.QuigleyJohn M., 271–300. Cambridge: Lincoln Institute of Land Policy.
44.
Rodriguez-PoseAndresStorperMichael. 2020. “Housing, Urban Growth and Inequalities: The Limits to Deregulation and Upzoning in Reducing Economic and Spatial Inequality.” Urban Studies57 (2): 223–48.
45.
RothwellJonathan. 2019. “Land Use Politics, Housing Costs, and Segregation in California Cities.” Terner Center Land Use Working Paper Series. Terner Center for Housing Innovation, University of California, Berkeley, Berkeley, CA, September 5, 2019.
46.
SarisWillemGallhoferIrmtraud. 2014. Design, Evaluation, and Analysis of Questionnaires for Survey Research. Wiley Series in Survey Methodology. 2nd ed., edited by CouperMick P.KaltonGrahamRaoJ. N. K.SchwarzNorbertSkinnerChristopher. Hoboken: Wiley.
SullivanGail M.2011. “A primer on the validity of assessment instruments.” Journal of Graduate Medical Education3(2): 119–20.
52.
VannetteDavid L.KrosnickJon A.2018. The Palgrave Handbook of Survey Research. London: Palgrave Macmillan.
53.
WikmanAnders. 2006. “Reliability, Validity and True Values in Surveys.” Social Indicators Research78 (1): 85–110.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
