Fast pace of technology changes makes conduction of high-quality web surveys increasingly easy, and performance of web surveys should be continuously monitored. In this article, a comparison is made of the results of telephone and web surveys of items measuring international news knowledge. The authors compare web surveys of general populations conducted in the United States and Norway in January 2009 with their telephone replications conducted in the same month. Results show rather small differences between web and telephone surveys, particularly in Norway. The authors discuss the results and make recommendations for use of web surveys and for future methodological research.
Berelson, B.R., Lazarsfeld, P.F., & McPhee, W.N. (1954). Voting-A study of opinion formation in a presidential campaign. Chicago, IL: The University of Chicago Press.
2.
Berrens, R.P., Bohara, A.K., Jenkins-Smith, H., Silva, C., & Weimer, D.L. ( 2003). The advent of Internet surveys for political research: A comparison of telephone and Internet samples. Political Analysis, 11, 1-22.
3.
Best, S.J., Krueger, B., Hubbard, C., & Smith, A. ( 2001). An assessment of the generalizability of internet surveys . Social Science Computer Review, 19(2), 131-145.
4.
Blumberg, S.J., & Luke, J.V. ( 2009). Wireless substitution: Early release of estimates from the National Health Interview Survey, July-December 2008. National Center for Health Statistics. Retrieved July 13, 2009, from http://www.cdc.gov/nchs/data/nhis/earlyrelease/wireless200905.pdf
5.
Campbell, A., Converse, P.E., Miller, W.E., & Stokes, D.E. ( 1960). The American voter. Chicago, IL: The University of Chicago Press.
6.
Castells, M. ( 2009). Communication power. Oxford, UK: Oxford University Press.
7.
Converse, P.E. ( 1964). The nature of belief systems in mass publics. In David E. Apter (Ed.), Ideology and discontent. New York, NY: The Free Press.
8.
Curran, J., Iyengar, S., Lund, A.B., & Salovaara-Moring, I. (2009). Media system, public knowledge and democracy: A comparative study. European Journal of Communication, 24, 5-26.
9.
Curran, J., Salovaara-Moring, I., Cohen, S., & Iyengar, S. ( 2010). Crime, foreigners and hard news: A cross-national comparison of reporting and public perception. Journalism, 11, 3-19.
10.
Curtin, R., Presser, S., & Singer, E. ( 2005). Changes in telephone survey nonresponse over the past quarter century. Public Opinion Quarterly, 69, 87-98.
11.
de Leeuw, E., & de Heer, W. ( 2002). Trends in household survey nonresponse: A longitudinal and international comparison. In Robert M. Groves, Don A. Dillman, John E. Eltinge, & Roderick J. A. Little (Eds.), Survey nonresponse (pp. 41-54). New York, NY: Wiley.
12.
Delli Carpini, M.X., & Keeter, S. ( 1993). Measuring political knowledge-Putting first things first . American Journal of Political Science, 37, 1179-1206.
13.
Delli Carpini, M.X., & Keeter, S. ( 1996). What Americans know about politics and why it matters . New Haven, CT: Yale University Press.
14.
DeMaris, A. ( 2004). Regression with social data: Modeling continuous and limited response variables. Hoboken, NJ: John Wiley & Sons.
15.
Dimock, M.D., & Popkin, S.L. ( 1997). Political knowledge in comparative perspective. In S. Iyengar & R. Reeves (Eds.), Do the media govern?Beverly Hills, CA: SAGE.
16.
Fricker, S., Galesic, M., Tourangeau, R., & Yan, T. ( 2005). An experimental comparison of web and telephone surveys . Public Opinion Quarterly, 69, 370-392.
17.
Hansen, K. ( 2009). Measuring political knowledge. Paper presented at ECPR Joint Sessions, Workshop 16: Political information, public knowledge and perceptions of reality. Lisbon, Portugal, April 14-19.
18.
Healey, B. ( 2007). Drop downs and scroll mice: The effect of response option format and input mechanism employed on data quality in web surveys. Social Science Computer Review, 25, 111-128.
19.
Holland, J.L., & Christian, L.M. (2009). The influence of topic interest and interactive probing on responses to open-ended questions in web surveys. Social Science Computer Review, 27, 196-212.
20.
Internet World Stats.2009. Top 47 countries with highest Internet penetration rate. Retrieved July 13, 2009, from http://www.internetworldstats.com/top25.htm
21.
Iyengar, S., Hahn, K.S., Bonfidelli, H., & Marr, M. ( 2009). Dark areas of ignorance’ revisited: Comparing international affairs knowledge in Switzerland and California. Communication Research, 36, 341-358.
22.
Jenssen, A.T. ( 2009). Does public broadcasting make a difference? Political knowledge and electoral campaigns on television. Scandinavian Political Studies, 32, 247-271.
23.
Keeter, S., Kennedy, C., Clark, A., Tompson, T., & Mokrzycki, M. ( 2007). What’s missing from national landline RDD surveys? The impact of the growing cell-only population. Public Opinion Quarterly, 71, 772-792.
24.
Keeter, S., Kennedy, C., Dimock, M., Best, J., & Craighill, P. ( 2006). Gauging the impact of growing nonresponse on estimates from a national RDD telephone survey. Public Opinion Quarterly , 70, 759-779.
25.
Kennedy, C. ( 2007). Evaluating the effects of screening for telephone service in dual frame RDD surveys. Public Opinion Quarterly, 71, 750-771.
26.
Kull, S., Ramsay, C., & Lewis, E. ( 2004). Misperceptions, the media and the Iraq war. Political Science Quarterly, 118, 569-598.
27.
Lavrakas, P.J., Shuttles, C.D., Steeh, C., & Fienberg, H. ( 2007). The state of surveying cell phone numbers in the United States 2007 and beyond. Public Opinion Quarterly, 71, 840-854.
28.
Lowe, F.E., & McCormick, T.C. (1955). Some Survey sampling biases . Public Opinion Quarterly, 19, 303-315.
29.
Merkle, D.M., & Edelman, M. ( 2002). Nonresponse in exit polls: A comprehensive analysis. In Robert M. Groves, Don A. Dillman, John E. Eltinge, & Roderick J. A. Little (Eds.), Survey nonresponse (pp. 243- 257). New York, NY: Wiley.
30.
Milner, H. ( 2002). Civic literacy: How informed citizens make democracy work. Hanover, NH: University Press of New England.
31.
Mondak, J.J. ( 2001). Developing valid knowledge scales. American Journal of Political Science, 45, 224-238.
32.
Nadeau, R., & Niemi, R.G. ( 1995). Educated guesses: Survey knowledge questions. Public Opinion Quarterly, 59, 323-346.
33.
Sills, S.J., & Song, C. ( 2002). Innovations in survey research: An application of web-based surveys. Social Science Computer Review, 20, 22-30.
34.
Singer, E. ( 2006). Introduction. Nonresponse bias in household surveys. Public Opinion Quarterly, 70, 637-645.
35.
Sudman, S., & Bradburn, N.M. (1982). Asking questions: A practical guide to questionnaire design. San Francisco, CA: Jossey-Bass.
36.
Tourangeau, R. ( 2004). Survey research and societal change. Annual Review of Psychology, 55, 775-801.
37.
Westholm, A., Lindquist, A., & Niemi, R.G. ( 1990). Education and the making of the informed citizen: Political literacy and the outside world. In Orit Ichilov (Ed.), Political socialization, citizenship education and democracy. New York, NY: Teachers College Press.
38.
Zaller, J.R. ( 1992). The nature and origins of mass politics. Cambridge, UK: Cambridge University Press.
