A Random Digit Search (RDS) Method for Sampling of Blogs and Other User-Generated Content

Abstract

Blogs are arguably the most popular genre of user-generated content (UGC), which make blogs a gold mine for social science research. However, existing research on blogs has suffered from nonprobability samples collected either manually or by computerized crawling based on random walks method. The current article presents a probability sampling method for blogs, called random digit search (RDS), that is modified from the popular ‘‘random digit dialing’’ (RDD) method used in telephone surveys. The RDS method was tested in a study of Sina Blog, a popular blog service provider (BSP) in China. The results show that, while ‘‘random walks’’ sampling tends to oversample popular/active blogs, probability samples generated by RDS yield consistent and precise estimates of population parameters. Although the RDS takes advantage of the numeric identification (ID) system used on Sina Blog, the general principles may be applicable to other BSPs and many other genres of UGC.

Keywords

random walks random digit search web sampling web crawling

Get full access to this article

View all access options for this article.

References

American Association for Public Opinion Research. ( 2009). Standard definitions: Final dispositions of case codes and outcome rates for surveys. Retrieved April 9, 2010, from http://www.aapor.org/AM/Template.cfm?Section=Standard_Definitions&Template=/CM/ContentDisplay.cfm&ContentID=1819.

Ayhan, H.O. , & Islam, M.Q. ( 2005). Sample design and allocation for random digit dialling . Quality & Quantity, 39, 625-641.

Barabási, A.-L. , & Albert, R. ( 1999). Emergence of scaling in random networks. Science, 286, 509-512.

Becchetti, L. , Castillo, C. , Donato, D. , & Fazzone, A. ( 2006). A comparison of sampling techniques for web graph characterization . Proceedings of the workshop on link analysis (LinkKDD’06), Philadelphia, PA.

Berg, S. ( 1988). Snowball sampling. In S. Kotz & N. L. Johnson (Eds.), Encyclopedia of statistical sciences (Vol. 8, pp. 529-532). New York, NY: John Wiley.

China Internet Network Information Center. ( 2010). Statistical report of Internet development in China. Retrieved April 9, 2010, from http://www.cnnic.cn/uploadfiles/pdf/2010/3/15/142705.pdf

Du, H.S. , & Wagner, C. ( 2006). Weblog success: Exploring the role of technology. International Journal of Human-Computer Studies, 64, 789-798.

Henzinger, M.R. , Heydon, A. , Mitzenmacher, M. , & Najrok, M. ( 1999). Measuring index quality using random walks on the web . In Proceedings of the 8th international World Wide Web conference (WWW8), Toronto, Canada. 213-225.

Herring, S.C. , Scheidt, L.A. , Kouper, I. , & Wright, E. ( 2006). A longitudinal content analysis of weblogs: 2003-2004 . In M. Tremayne (Ed.), Blogging, citizenship and the future of media. London, England: Routledge.

10.

Hui, K.L. , Lai, Y.L. , & Yee, S.J. ( 2007). Empirical advances for the study of weblogs: Relevance and testing of random effects models. In R. J. Kauffman & P. P. Tallon (Eds.), Economics, information systems and electronic commerce. New York, NY: M. E. Sharpe.

11.

Kish, L. ( 1965). Survey sampling. New York, NY: John Wiley.

12.

Lohr, S.L. ( 1999). Sampling: Design and analysis. Pacific Grove, CA: Duxbury Press.

13.

Nardi, B.A. , Schiano, D.J. , Gumbrecht, M. , & Swartz, L. ( 2004). Why we blog. Communications of the ACM , 47, 41-46.

14.

Park, H.W. , & Thelwall, M. ( 2008). Developing network indicators for ideological landscapes from the political blogosphere in South Korea. Journal of Computer-Mediated Communication, 13, 856-879.

15.

Rimmer, T. , Willis, C. , & Zhu, J.H. ( 1987, November). Locating households via random digit dialing: A test of Waksberg’s sampling modification. Midwest Association for Public Opinion Research, Chicago, IL .

16.

Thelwall, M. ( 2006). Interpreting social science link analysis research: A theoretical framework. Journal of American Society for Information Science and Technology, 57, 60-68.

17.

Waksberg, J. ( 1978). Sampling methods for random digit dialing. Journal of the American Statistical Association, 73, 40-46.