The existence of a mode effect is assessed using data from two matched groups of 15- to 16-year-olds (n = 466) who completed a questionnaire either as a Web-based online version or an “optical mark recognition” paper version. This article focuses specifically on the length of answers to four open-ended questions included in the questionnaire. It was found that although the online answers to three of the four questions tended to be slightly longer than those from the paper version, the differences were not statistically significant. Other factors, specifically gender and educational aspirations, appeared to have much more influence on the length of answers to open-ended questions than the mode of delivery per se. The findings do not provide conclusive evidence of any mode effect with respect to the online delivery of questionnaires.
Boyer, K.K., Olson, J.R., Calatone, R.J., & Jackson, E.C. (2002). Print versus electronic surveys: a comparison of two data collection methodologies. Journal of Operations Management, 20(4), 357-373.
2.
Brecko, B.N., & Carstens, R. (2006, November). Online data collection in SITES 2006 . Paper versus web survey-do they provide comparable results? Proceedings of the 2nd IEA International Research Conference, Washington, DC.
3.
Couper, M.P., Tourangeau, R., Conrad, F.G., & Crawford, S.D. (2004). What they see is what we get: response options for web surveys. Social Science Computer Review, 22(1), 111-127.
4.
Couper, M.P., Kapteyn, A., Schonlau, M., & Winter, J. (2007). Noncoverage and nonresponse in an Internet survey . Social Science Research, 36(1), 131-148.
5.
Denscombe, M. (2006). Web-based questionnaires and the mode effect: An evaluation based on completion rates and data contents of near-identical questionnaires delivered in different modes. Social Science Computer Review, 24(2), 246-254. Available online at http://ssc.sagepub.com/cgi/content/abstract/24/2/246
6.
Deutskens, E., de Ruyter, K., & Wetzels, M. (2006). An assessment of equivalence between online and mail surveys in service research. Journal of Service Research , 8(4), 346-355.
7.
Dillman, D.A. (2007). Mail and Internet surveys: The tailored design method (2nd ed.). New York: Wiley.
8.
Etter, R. (2002). Do response rates and responses differ between mail and Internet answers in a mixed mode survey? Working Paper No. 68, Swiss Institute for Business Cycle Research, Swiss Federal Institute of Technology, Zurich, Switzerland.
9.
Grandcolas, U., Rettie, R., & Marusenko, K. (2003). Web survey bias: Sample or mode effect? Journal of Marketing Management, 19(5/6), 541-561.
10.
Haraldsen, G., Dale, T., Dalheim, E., & Hrydahl, E. (2002, August 25-28). Mode effects in a mail plus Internet designed census. Paper presented at the ICIS 2002-International Conference on Improving Surveys, Copenhagen, Denmark.
11.
Kaplovitz, M.D., Hadlock, T.D., & Levine, R. (2004). A comparison of web and mail survey response rates . Public Opinion Quarterly, 68(1), 94-101.
12.
Kwak, N., & Radler, B. (2002). A comparison between mail and web surveys: response patter, respondent profile, and data quality. Journal of Official Statistics, 18(2), 257-273.
13.
Lee, S. (2006). An evaluation of nonresponse and coverage errors in a prerecruited probability web panel survey. Social Science Computer Review, 24(4), 460-475.
14.
Lozar Manfreda, K., Bosnjak, M., Haas, I., & Vehovar, V. (2005, September 26-28). A meta-analysis of response rates in Web surveys compared to other survey modes. ESF Workshop on Internet survey methodology, Dubrovnik .
15.
Lozar Manfreda, K., & Vehovar, V. (2002). Do mail and web surveys provide the same results? In A. Ferligov & A. Mrvar (Eds.), Development in social science methodology (pp. 149-169). Ljubljana, Slovenia: Metodoloski zvezki.
16.
Lozar Manfreda, K., Vehovar, V., Batageli, Z., (2001). Web versus mail questionnaires for an institutional survey. Association for Survey Computing. Available online at http://www.or.zuma-mannheim.de/gaeste/klm2001/lozar%20manfreda_vehovar_batagelj%202001.pdf
17.
MacElroy, B., Micucki, J., & McDowell, P. (2002). A comparison of quality in open-ended responses and response rates between web-based and paper and pencil survey modes. IMRO Journal of Online Research (Interactive Marketing Research Organization). Retrieved May 25, 2007, from www.ijor.org
18.
McCabe, S.E. (2004). Comparison of web and mail surveys in collecting illicit drug use data: a randomized experiment. Journal of Drug Education, 34(1), 61-73.
19.
McCabe, S.E., Boyd, C.J., Couper, M.P., Crawford, S.D., & D'Arcy, H. (2002). Mode effects for collecting alcohol and other drug use data: Web and U.S. mail. Journal of Studies on Alcohol , 63(6), 755-762.
20.
Porter, S., R., & Whitcomb, M.E. (2003). The impact of contact type on web survey response rates. Public Opinion Quarterly , 67(4), 579-589.
21.
Reja, U., Lozar Manfreda, K., Hlebec, V., & Vehovar, V. (2003). Open-ended vs. Close-ended Questions in Web Questionnaires . Advances in Methodology and Statistics (Metodološki zvezki), 19, 159-177.
22.
Ritter, P., Lorig, K., Laurent, D., & Matthews, K. (2004). Internet versus mailed questionnaires: a randomised comparison. Journal of Medical Internet Research, 6(3), Article e29. Retrieved December 14, 2006, from http://www.jmir.org/2004/3/e29/
23.
Ross, M.W., Mansson, S.-A., Daneback, K., Cooper, A., & Tikkanen, R. (2005). Biases in internet sexual health samples: comparison of an internet sexuality survey and a national health survey in Sweden. Social Science and Medicine, 61(1), 245-252.
24.
Schaefer, D., & Dillman, D. (1998). Development of a standard e-mail methodology: results of an experiment. Public Opinion Quarterly, 62, 378-397.
25.
Sills, S.J., & Song, C. (2002). Innovations in survey research: An application of web-based surveys. Social Science Computer Review, 20(1), 22-31.
26.
Smyth, J.D., Dillman, D.A., Christian, L.M., & Stern, M.J. (2006). Comparing check-all and forced-choice question formats in web surveys. Public Opinion Quarterly, 70(1), 66-77.
27.
Stangl, A. (2004). Mode effects on data quality: benefits and drawbacks of mixed-mode surveys. 27th CIRET (Centre for International Research on Economic Tendency Surveys) conference, Warsaw , 2004.
28.
Sturgeon, K., & Winter, S. (1999, February 21-23). International marketing on the World Wide Web. New opportunities for research: What works, what does not and what is next (pp. 191-200). Proceedings of the ESOMAR Worldwide Internet Conference Net Effects, London.
29.
Taylor, H. (2000). Does Internet research work? Comparing online survey results with telephone survey. International Journal of Market Research, 42, 51-63.
30.
Tourangeau, R., Rips, L.J., & Rasinski, K. (2000). The psychology of survey response. Cambridge, MA: Cambridge University Press.
31.
Truell, A.D., Bartlett, J.E., & Alexander, M.W. (2002). Response rate, speed and completeness: a comparison of Internet-based and mail surveys. Behavior Research Methods, Instruments and Computers, 34(1), 46-49.
32.
Vehovar, V., & Lozar Manfreda, K. (2002). Mode effect in web surveys . The American Association for Public Opinion Research (AAPOR) 57th Annual conference, St. Pete Beach, Florida .
33.
Willke, J., Adams, C.O., & Girnius, Z. (1999, February 21-23). Internet testing. A landmark study of the differences between mall intercept and on-line interviewing in the United States (pp. 145-157). Proceedings of the ESOMAR Worldwide Internet Conference Net Effects, London.
