Most methodological evaluations of web-based questionnaires have focused on the issues of sampling and response rates. Some have considered the issues of privacy and ethics. Relatively few have addressed the question of whether people provide different information depending on the mode of questionnaire delivery. This article contributes to this relatively overlooked aspect of the evaluation of web surveys. It presents initial findings from a survey that was designed to enable near-identical groups to respond to near-identical questionnaires delivered in different modes. Web-based questionnaires and paper-based questionnaires, used as part of a schoolbased study of young people's health-related behavior, are compared in terms of (a) completion rates and (b) data contents. Issues surrounding the quality of data and the reliability of webbased questionnaires are discussed. It is concluded that, on the basis of the quantitative data from this survey, there is little evidence of a mode effect linked to web-based questionnaires.
Bandilla, W., Bosnjak, M., & Altdorfer, P. (2003). A comparison of web-based and traditional written selfadministered surveys using the ISSP environment module. Social Science Computer Review, 21, 235-243.
2.
Best, S. J., Krueger, B., Hubbard, C., & Smith, A. (2001). An assessment of the generalizability of Internet surveys. Social Science Computer Review, 19, 131-141.
3.
Boyer, K. K., Olson, J. R., Calantone, R. J.,& Jackson, E. C. (2002). Print versus electronic surveys: Acomparison of two data collection methodologies. Journal of Operations Management, 20, 357-373.
4.
Couper, M. P. (2000). Web surveys. Public Opinion Quarterly, 64, 464-495.
5.
Couper, M. P., Tourangeau, R., Conrad, F. G.,& Crawford, S. D. (2004). What they see is what we get: Response options for web surveys. Social Science Computer Review, 22, 111-127.
6.
Crawford, S. D., Couper, M. P.,& Lamias, M. J. (2001). Web surveys: Perceptions of burden. Social Science Computer Review, 19, 146-162.
7.
Denscombe, M., & Aubrook, L. (1992). The ethics of questionnaire research on pupils in schools: “It's just another piece of schoolwork.” British Educational Research Journal, 18, 113-131.
8.
Dillman, D. A. (2000). Mail and Internet surveys: The tailored design method. New York: John Wiley.
9.
Heerwegh, D.,& Loosveldt, G. (2002). An evaluation of the effect of response formats on data quality in web surveys. Social Science Computer Review, 20, 471-485.
10.
Kaplovitz, M. D., Hadlock, T. D.,& Levine, R. (2004). Acomparison of web and mail survey response rates. Public Opinion Quarterly, 68(1), 94-101.
11.
Loke, S. D.,& Gilbert, B. O. (1995). Method of psychological assessment, self disclosure, and experiential differences: A study of computer questionnaire and interview assessment formats. Journal of Social Behavior and Personality, 10, 255-263.
12.
Lozar Manfreda, K., & Vehovar, V. (2002). Do mail and web surveys provide the same results? In A. Ferligov & A. Mrvar (Eds.), Development in social science methodology(pp. 149-169). Ljubljana, Slovenia: Metodoloski zvezki.
13.
McCabe, S. E. (2004). Comparison of web and mail surveys in collecting illicit drug use data: A randomized experiment. Journal of Drug Education, 34(1), 61-73.
14.
McCabe, S. E., Boyd, C. J., Couper, M. P., Crawford, S. D.,& D'Arcy, H. (2002). Mode effects for collecting alcohol and other drug use data: Web and U.S. mail. Journal of Studies on Alcohol, 63, 755-762.
15.
Nosek, B. A., Banjani, M. R.,& Greenwald, A. G. (2002). E-research: Ethics, security, design, and control in psychological research on the Internet. Journal of Social Issues, 58(1), 161-176.
16.
Porter, S. R.,& Whitcomb, M. E. (2003). The impact of contact type on web survey response rates. Public Opinion Quarterly, 67, 579-589.
17.
Ross, M. W., Mansson, S.-A., Daneback, K., Cooper, A., & Tikkanen, R. (2005). Biases in Internet sexual health samples: Comparison of an Internet sexuality survey and a national health survey in Sweden. Social Science and Medicine, 61(1), 245-252.
18.
Schaefer, D., & Dillman, D. (1998). Development of a standard e-mail methodology: Results of an experiment. Public Opinion Quarterly, 62, 378-397.
19.
Shah, D. A., & Madden, L. V. (2004). Nonparametric analysis of ordinal data in designed factorial experiments. Phytopathology, 94(1), 33-43.
20.
Sills, S. J., & Song, C. (2002). Innovations in survey research: An application of web-based surveys. Social Science Computer Review, 20, 22-31.
21.
Stangl, A. (2004, September). Mode effects on data quality: Benefits and drawbacks of mixed-mode surveys. Paper presented to the 27th Centre for International Research on Economic Tendency Surveys conference, Warsaw, Poland.
22.
Stanton, J. M. (1998). An empirical assessment of data collection using the Internet. Personnel Psychology, 51, 709-726.
23.
Truell, A. D., Bartlett, J. E.,& Alexander, M. W. (2002). Response rate, speed and completeness: Acomparison of Internet-based and mail surveys. Behavior Research Methods, Instruments and Computers, 34(1), 46-49.
24.
Witte, J. C., Amoroso, L. M., & Howard, P. E. N. (2000). Method and representation in Internet-based survey tools—Mobility, community, and cultural identity in Survey2000. Social Science Computer Review, 18, 179-195.
25.
Yun, G. W., & Trumbo, C. W. (2000). Comparative response to a survey executed by post, e-mail, and web form. Journal of Computer-Mediated Communication, 6(1), 1-24.
