Real and fake data in Shanghai’s informal rental housing market: Groundtruthing data scraped from the internet

Abstract

Chinese

China’s planned mega-cities contain hidden, informal housing markets. We analyse Shanghai’s ‘group rental’ market in which formal commercial and residential units have been illegally converted into extremely crowded dormitories. In 2016, we collected more than 33,000 online classified advertisements for beds in group rental apartments and find that this market serves a specific demographic with robust preference order patterns. Furthermore, groundtruthing fieldwork revealed that the scraped online data misrepresented the market. Therefore, we also collected a second set of ‘real’ market data for comparative analysis. The study highlights both the exciting possibilities and the limitations of using online content to study informality.

Keywords

informality migration rental housing scraped online data

Get full access to this article

View all access options for this article.

References

Anderson

(2008) The end of theory: The data deluge makes the scientific method obsolete. Wired Magazine, 23 June. Available at: https://www.wired.com/2008/06/pb-theory/ (accessed 27 March 2020).

Bayer

Ferreira

McMillan

(2007) A unified framework for measuring preferences for schools and neighborhoods. Journal of Political Economy 115(4): 588–638.

Beijing News (2019) Beijing releases a new version of the rental contract model text: Explicitly prohibiting illegal group rentals (北京发布新版租房合同示范文本：明确禁止违法群租). Available at: http://www.bjnews.com.cn/news/2019/07/08/600569.html (accessed 1 September 2019).

Beracha

Wintoki

M B

(2013) Forecasting residential real estate price changes from online search activity. Journal of Real Estate Research 35(3): 283–312.

Boeing

(2019) Online rental housing market representation and the digital reproduction of urban inequality. Environment and Planning A: Economy and Space 52(2): 449–468.

Boeing

Waddell

(2017) New insights into rental housing markets across the united states: Web scraping and analyzing craigslist rental listings. Journal of Planning Education and Research 37(4): 457–476.

boyd

Crawford

(2012) Critical questions for big data: Provocations for a cultural, technological, and scholarly phenomenon. Information, Communication & Society 15(5): 662–679.

Chen

(2017) 上海： 2016年外来农民工月均收入超5000元. [Shanghai: The average monthly income of migrant workers in 2016 exceeded 5,000 yuan]. Xinhua, 27 May. Available at: http://www.xinhuanet.com//politics/2017-05/27/c_1121049739.htm (accessed 9 September 2019).

Chen

Hao

(2010) Submarket, heterogeneity and hedonic prediction accuracy of real estate prices: Evidence from Shanghai. International Real Estate Review 13(2): 190–217.

10.

Chen

Hao

Stephens

(2010) Assessing housing affordability in post-reform China: A case study of Shanghai. Housing Studies 25(6): 877–901.

11.

Chen

Liu

, et al. (2016) Mapping the fine-scale spatial pattern of housing rent in the metropolitan area by using online rental listings and ensemble learning. Applied Geography 75: 200–212.

12.

China Internet Network Information Center (CNNIC) (2018) Statistical report on internet development in China. Available at: https://cnnic.com.cn/IDR/ReportDownloads/201807/P020180711391069195909.pdf (accessed 24 January 2019).

13.

Cramer

Rost

Holmquist

(2011) Performing a check-in: Emerging practices, norms and ‘conflicts’ in location-sharing using foursquare. In: 13th International Conference on Human Computer Interaction with Mobile Devices and Services. New York: ACM, pp. 57–66.

14.

Das

Ziobrowski

Coulson

(2015) Online information search, market fundamentals and apartment real estate. The Journal of Real Estate Finance and Economics 51(4): 480–502.

15.

Evans

Aceves

(2016) Machine translation: Mining text for social theory. Annual Review of Sociology 42: 21–50.

16.

Fraser

(2000) Inventing oasis: Luxury housing advertisements and reconfiguring domestic space in Shanghai. In: Davis

(ed.) The Consumer Revolution in Urban China. Berkeley, CA and Los Angeles, CA: University of California Press, pp. 25–53.

17.

Gibbon

Bell

(1939) History of the London County Council 1889–1939. New York: Macmillan Company.

18.

Guihaire

Hao

(2008) Transit network design and scheduling: A global review. Transportation Research Part A: Policy and Practice 42(10): 1251–1273.

19.

Home Affairs Department (HAD), The Government of the Hong Kong Special Administrative Region (2017) Bedspace apartments: Code of practice. Available at: https://www.hadla.gov.hk/filemanager/en/docs/code_practice_bedspace.pdf (accessed 1 September 2019).

20.

Han

, et al. (2019) Monitoring housing rental prices based on social media: An integrated approach of machine-learning algorithms and hedonic modeling to inform equitable housing policies. Land Use Policy 82: 657–673.

21.

Huang

Clark

(2002) Housing tenure choice in transitional urban China: A multilevel analysis. Urban Studies 39(1): 7–32.

22.

Huang

Tao

(2015) Housing migrants in Chinese cities: Current status and policy design. Environment and Planning C: Government and Policy 33(3): 640–660.

23.

Huang

(2015) Invisible migrant enclaves in Chinese cities: Underground living in Beijing, China. Urban Studies 52(15): 2948–2973.

24.

Kim

(2004) A market without the ‘right’ property rights. Economics of Transition 12(2): 275–305.

25.

Kim

(2007) North versus South: The impact of social norms in the market pricing of private property rights in Vietnam. World Development 35(12): 2079–2095.

26.

Kim

(2016) The extreme primacy of location: Beijing’s underground rental housing market. Cities 52: 148–158.

27.

Kim

(2018) Smarter than Smart Cities: GIS and spatial analysis for socio-economic applications that recover humanistic media and visualization. In: Cao

Silva

(eds) Comprehensive Geographic Information Systems. Vol. 3. Waltham, MA: Elsevier, pp. 360–370.

28.

Kim

(2019) The new geographies and spatialities of informality. In: Banerjee

Loukaitou-Sideris

(eds) The New Companion to Urban Design. New York: Routledge, pp. 152–162.

29.

Kitchin

(2013) Big data and human geography: Opportunities, challenges and risks. Dialogues in Human Geography 3(3): 262–267.

30.

Kitchin

(2014) The real-time city? Big data and smart urbanism. GeoJournal 79(1): 1–14.

31.

Duda

(2010) Employers as landlords for rural-to-urban migrants in Chinese cities. Environment and Urbanization 22(1): 13–31.

32.

Wei

, et al. (2019) Analyzing housing prices in Shanghai with open data: Amenity, accessibility and urban structure. Cities 91: 165–179.

33.

Wang

Chang

(2018) Do internal migrants suffer from housing extreme overcrowding in urban China? Housing Studies 33(5): 708–733.

34.

Liu

(2016) The jobs-housing relationship and commuting in Guangzhou, China: Hukou and dual structure. Journal of Transport Geography 54: 286–294.

35.

(2008) Tenure-based residential segregation in post-reform Chinese cities: A case study of Shanghai. Transactions of the Institute of British Geographers 33(3): 404–419.

36.

Liao

Wong

(2015) Changing urban residential patterns of Chinese migrants: Shanghai, 2000–2010. Urban Geography 36(1): 109–126.

37.

Liu

, et al. (2016) Rethinking big data: A review on the data quality and usage issues. ISPRS Journal of Photogrammetry and Remote Sensing 115(2016): 134–142.

38.

Lubove

(1963) The Progressives and the Slums: Tenement House Reform in New York City, 1890–1917. Pittsburgh, PA: University of Pittsburgh Press.

39.

Mak

Choy

(2007) Privatization, housing conditions and affordability in the People’s Republic of China. Habitat International 31(2): 177–192.

40.

Markham

(2003) Representation in online ethnographies. In: Johns

Chen

Hall

(eds) Online Social Research: Methods, Issues, and Ethics. New York: Peter Lang, pp. 141–156.

41.

Ministry of Housing and Urban-Rural Development (MOHURD) (2010) 关于加快发展公共租赁住房的指导意见. [Guiding opinions on accelerating the development of public rental housing]. Available at: http://www.mohurd.gov.cn/wjfb/201006/t20100612_201308.html (accessed 2 September 2019).

42.

Mossberger

Tolbert

Bowen

, et al. (2012). Unraveling different barriers to Internet use: Urban residents and neighborhood effects. Urban Affairs Review 48(6): 771–810.

43.

Noble

(2018) Algorithms of Oppression: How Search Engines Reinforce Racism. New York: NYU Press.

44.

Pun

Smith

(2007) Putting transnational labour process in its place: The dormitory labour regime in post-socialist China. Work, Employment and Society 21(1): 27–45.

45.

Rae

(2015) Online housing search and the geography of submarkets. Housing Studies 30(3): 453–472.

46.

Redfearn

(2009) How informative are average effects? Hedonic regression and amenity capitalization in complex urban housing markets. Regional Science and Urban Economics 39(3): 297–306.

47.

Reuters (2015) Chinese Classified Ad Site 58.com to Buy 43 Percent of Rival Ganji. Available at: https://www.reuters.com/article/us-58-com-inc-ganji/chinese-classified-ad-site-58-com-to-buy-43-percent-of-rival-ganji-idUSKBN0N80V820150417 (accessed 30 August 2019).

48.

Rosen

(1974) Hedonic prices and implicit markets: Product differentiation in pure competition. Journal of Political Economy 82(1): 34–55.

49.

Schweitzer

(2014) Planning and social media: A case study of public transit and stigma on Twitter. Journal of the American Planning Association 80: 218–238.

50.

Shanghai Municipal Government (2011) 市政府关于修改《上海市居住房屋租赁管理办法》的决定. [The Municipal Government’s decision on amending the measures for the administration of Shanghai residential housing leasing]. Available at: http://www.shanghai.gov.cn/nw2/nw2314/nw2319/nw2407/nw32093/u26aw38946.html (accessed 5 January 2018).

51.

Shanghai Municipal Government (2017) 上海外来农民工生活情况. [The living conditions of migrant workers in Shanghai]. Available at: http://www.shanghai.gov.cn/nw2/nw2314/nw24651/nw42131/nw42178/u21aw1232783.html (accessed 9 September 2019).

52.

Shelton

Poorthuis

Zook

(2015) Social media and the city: Rethinking urban socio-spatial inequality using user-generated geographic information. Landscape and Urban Planning 142: 198–211.

53.

Shen

(2015) Why does the government fail to improve the living conditions of migrant workers in Shanghai? Reflections on the policies and the implementations of public rental housing under neoliberalism. Asia & the Pacific Policy Studies 2(1): 58–74.

54.

Shi

Chen

Wang

(2016) Affordable housing policy in China: New developments and new challenges. Habitat International 54: 224–233.

55.

Shu

(2015) China’s largest online marketplace for classified ads. Tech Crunch. Available at: https://techcrunch.com/2015/04/20/58ganji/ (accessed 30 August 2019).

56.

Song

Zenou

Ding

(2008) Let’s not throw the baby out with the bath water: The role of urban villages in housing rural migrants in China. Urban Studies 45(2): 313–330.

57.

Swider

(2016) Building China: Informal Work and the New Precariat. Ithaca, NY: Cornell University Press.

58.

UN-HABITAT (2003) The Challenge of Slums. Global Report on Human Settlements. London: Earthscan.

59.

Ren

, et al. (2016) Spatial and social media data analytics of housing prices in Shenzhen, China. PloS One 11(10): e0164553.

60.

(2016) Housing in Chinese urban villages: The dwellers, conditions and tenancy informality. Housing Studies 31(7): 852–870.

61.

(2002) Migrant housing in urban China: Choices and constraints. Urban Affairs Review 38(1): 90–119.

62.

(2004) Sources of migrant housing disadvantage in urban China. Environment and Planning A 36(7): 1285–1304.

63.

Xinhua (2018) 2017年农民工总量达28652万人新生代农民工占比首次过半. [In 2017, the total number of migrant workers reached 286.52 million and the share of new generation migrant workers was more than half for the first time]. 27 May. Available at: http://www.xinhuanet.com/finance/2018-04/27/c_129860718.htm (accessed 23 August 2019).

64.

Yang

Chen

(2014) Housing reform and the housing market in urban China. In: Yang

Chen (eds) Housing Affordability and Housing Policy in Urban China. Berlin: Springer, pp. 15–43.

65.

Huang

(2014) Housing consumption and housing inequality in Chinese cities during the first decade of the twenty-first century. Housing Studies 29(2): 291–311.

66.

Zhang

LSXB

Zhao

Tian

(2003) Self-help in housing and chengzhongcun in China’s urbanization. International Journal of Urban and Regional Research 27(4): 912–937.

67.

Zhang

Chen

(2014) The changing prevalence of housing overcrowding in post-reform China: The case of Shanghai, 2000–2010. Habitat International 42: 214–223.

68.

Zhong

Wang

Xie

, et al. (2017) Dynamic characteristics of Shanghai’s population distribution using cell phone signaling data. 地理研究 (Geographical Research) 36(5): 972–984.