Are Demographics Adequate Controls for Cell-Phone-Only Coverage Bias in Mass Communication Research?

Abstract

Cell-phone-only (CPO) households differ along key variables from non-CPO households, creating potential coverage biases in landline-only random-digit-dialing (RDD) surveys. Researchers have attempted to correct for this by weighting their data based on demographic differences. Previous research, however, has not examined CPO coverage biases in media-use surveys—an important oversight as cell phone use is itself a media choice. This article presents a secondary analysis of Pew’s 2012 media consumption survey and concludes that demographics alone are not adequate controls for the CPO bias in media-use surveys.

Keywords

coverage bias cell phone mobile surveys online surveys sampling methodology

Get full access to this article

View all access options for this article.

References

Ansolabehere

Schaffner

B. F.

(2010). Residential mobility, family structure, and the cell-only population. Public Opinion Quarterly, 74, 244-259. doi:10.1093/poq/nfq018

Avery

(2010). Contextual and audience moderators of channel selection and message reception of public health information in routine and crisis situations. Journal of Public Relations Research, 22, 378-403. doi:10.1080/10627261003801404

Blumberg

S. J.

Ganesh

Luke

J. V.

Gonzales

(2013). Wireless substitution: State-level estimates from the National Health Interview Survey, 2012. National Health Statistics Reports. Retrieved from http://www.cdc.gov/nchs/data/nhsr/nhsr070.pdf

Blumberg

S. J.

Luke

J. V.

(2009). Reevaluating the need for concern regarding noncoverage bias in landline surveys. American Journal of Public Health, 99, 1806-1810. doi:10.2105/AJPH.2008.152835

Blumberg

S. J.

Luke

J. V.

Ganesh

Davern

M. E.

Boudreaux

M. H.

(2012). Wireless substitution: State-level estimates from the National Health Interview Survey, 2010–2011. Retrieved from http://www.cdc.gov/nchs/data/nhsr/nhsr061.pdf

Bobkowski

P. S.

(2009). Adolescent religiosity and selective exposure to television. Journal of Media and Religion, 8, 55-70. doi:10.1080/15348420802670942

Chan-Olmsted

Rim

Zerba

(2013). Mobile news adoption among young adults examining the roles of perceptions, news consumption, and media usage. Journalism & Mass Communication Quarterly, 90, 126-147. doi:10.1177/1077699012468742

Conci

Pianesi

Zancanaro

(2009). Useful, social and enjoyable: Mobile phone adoption by older people. Human-Computer Interaction—INTERACT 2009, 5726, 63-76. Retrieved from http://link.springer.com/chapter/10.1007/978-3-642-03655-2_7

Correa

Hinsley

A. W.

de Zúñiga

H. G.

(2010). Who interacts on the Web? The intersection of users’ personality and social media use. Computers in Human Behavior, 26, 247-253. doi:10.1016/j.chb.2009.09.003

10.

Curran

Iyengar

Lund

A. B.

Salovaara-Moring

(2009). Media system, public knowledge and democracy: A comparative study. European Journal of Communication, 24, 5-26. doi:10.1177/0267323108098943

11.

Dahlgren

(2009). Media and political engagement: Citizens, communication and democracy. Cambridge, UK: Cambridge University Press.

12.

Dennis

DiSorga

(2009). Meeting the challenge of cell phone-only households, young adults and minorities: Introducing address-based sampling to KnowledgePanel^®. Retrieved from http://www.knowledgenetworks.com/accuracy/spring2009/Dennis-DiSogra-Graham-spring09.html

13.

de Zúñiga

H. G.

Jung

Valenzuela

(2012). Social media use for news and individuals’ social capital, civic engagement and political participation. Journal of Computer-Mediated Communication, 17, 319-336. doi:10.1111/j.1083-6101.2012.01574.x

14.

Dillman

D. A.

Smyth

J. D.

Christian

L. M.

(2008). Internet, mail, and mixed-mode surveys: The tailored design method (3rd ed.). Hoboken, NJ: John Wiley.

15.

Emig

A. G.

(1995). Community ties and dependence on media for public affairs. Journalism & Mass Communication Quarterly, 72, 402-411. doi:10.1177/107769909507200212

16.

GfK Knowledge Networks. (n.d.). Description of selected past projects. Retrieved from http://www.knowledgenetworks.com/ganp/past-projects.html

17.

Graber

D. A.

(2009). Mass media and American politics (8th ed.). Washington, DC: CQ Press.

18.

Groves

R. M.

Lyberg

(2010). Total survey error: Past, present, and future. Public Opinion Quarterly, 74, 849-879. doi:10.1093/poq/nfq065

19.

Hill

M. R.

Tchernev

J. M.

Holbert

R. L.

(2012). Do we need to go cellular? Assessing political media consumption using a single-frame landline/cellular survey design. Mass Communication and Society, 15, 284-306. doi:10.1080/15205436.2011.642926

20.

Hmielowski

J. D.

(2012). Intramedia moderation, electoral ambivalence, and electoral decision making. Mass Communication and Society, 15, 454-477. doi:10.1080/15205436.2011.616640

21.

Keeter

(2006). The impact of cell phone noncoverage bias on polling in the 2004 presidential election. Public Opinion Quarterly, 70, 88-98. doi:10.1093/poq/nfj008

22.

Keeter

Kennedy

Clark

Tompson

Mokrzycki

(2007). What’s missing from national landline RDD surveys? The impact of the growing cell-only population. Public Opinion Quarterly, 71, 772-792. doi:10.1093/poq/nfm053

23.

Lavrakas

P. J.

Shuttles

C. D.

Steeh

Finberg

(2007). The state of surveying cell phone numbers in the United States 2007 and beyond. Public Opinion Quarterly, 71, 840-854. doi:10.1093/poq/nfm054

24.

Leung

Wei

(2009). Who are the mobile phone have-nots? Influences and consequences. New Media & Society, 1, 209-226. doi:10.1177/1461444899001002003

25.

Link

M. W.

Battaglia

M. P.

Frankel

M. R.

Osborn

Mokdad

A. H.

(2007). Reaching the U.S. cell phone generation comparison of cell phone survey results with an ongoing landline telephone survey. Public Opinion Quarterly, 71, 814-839. doi:10.1093/poq/nfm051

26.

Liu

Yao

J. E.

(2003). Technology acceptance model for wireless Internet. Internet Research, 13, 206-222. doi:10.1108/10662240310478222

27.

McLeod

J. M.

Scheufele

D. A.

Moy

(1999). Community, communication, and participation: The role of mass media and interpersonal discussion in local political participation. Political Communication, 16, 315-336. doi:10.1080/105846099198659

28.

Mitchell

Guskin

(2013). Twitter news consumers: Young, mobile and educated. Retrieved from http://www.journalism.org/2013/11/04/twitter-news-consumers-young-mobile-and-educated/

29.

Mokrzycki

Keeter

Kennedy

(2009). Cell-phone-only voters in the 2008 exit poll and implications for future noncoverage bias. Public Opinion Quarterly, 73, 845-865. doi:10.1093/poq/nfp081

30.

Noar

S. M.

(2006). A 10-year retrospective of research in health mass media campaigns: Where do we go from here? Journal of Health Communication, 11, 21-42. doi:10.1080/10810730500461059

31.

Pew Research Center for the People and the Press. (2011). Cell phone surveys. Retrieved from http://www.people-press.org/methodology/collecting-survey-data/cell-phone-surveys/

32.

Pew Research Center for the People and the Press. (2012a). About the media consumption survey data. Retrieved from http://www.people-press.org/2012/09/27/about-the-media-consumption-survey-data/

33.

Pew Research Center for the People and the Press. (2012b). 2012 media consumption survey. Retrieved from http://www.people-press.org/2012/06/03/2012-media-consumption-survey/

34.

Prior

(2009). The immensely inflated news audience: Assessing bias in self-reported news exposure. Public Opinion Quarterly, 73, 130-145. doi:10.1093/poq/nfp002

35.

Rice

R. E.

Katz

J.E.

(2003). Comparing internet and mobile phone usage: Digital divides of usage, adoption, and dropouts. Telecommunications Policy, 27, 597-623. doi:10.1016/S0308-5961(03)00068-5

36.

Rittenberg

Tewksbury

Casey

(2012). Media preferences and democracy: Refining the “relative entertainment preference” hypothesis. Mass Communication and Society, 15, 921-942. doi:10.1080/15205436.2011.622065

37.

van Biljon

Kotzé

(2007). Modeling the factors that influence mobile phone adoption. In Proceedings of the 2007 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT Research in Developing Countries (pp. 152-161). ACM, New York, NY. doi:10.1145/1292491.1292509

38.

Weeks

B. E.

Holbert

R. L.

(2013). Predicting dissemination of news content in social media: A focus on reception, friending, and partisanship. Journalism & Mass Communication Quarterly, 90, 212-232. doi:10.1177/1077699013482906

39.

Wei

Hindman

D. B.

(2011). Does the digital divide matter more? Comparing the effects of new media and old media use on the education-based knowledge gap. Mass Communication and Society, 14, 216-235. doi:10.1080/15205431003642707

40.

Wei

(2008). Motivations for using the mobile phone for mass communications and entertainment. Telematics and Informatics, 25, 36-46. doi:10.1016/j.tele.2006.03.001