Even though e-mail is the most widely used computer-mediated communication medium, its considerable potential as a survey technique has received little attention from management scholars. Using a three-dimensional framework focused on sampling issues, nonsampling errors, and comparative performance, the authors review and integrate previous research on the electronic survey technique and provide an assessment of the comparative trade-offs vis-à-vis other techniques. Moreover, they provide recommendations for future researchers interested in using this approach. Finally, they conclude that although this approach poses unique challenges and drawbacks, when an unbiased sampling frame exists or can be constructed, it allows researchers to inexpensively gather data with less effort than other available approaches.
Get full access to this article
View all access options for this article.
References
1.
Aaker, D. A., Kumar, V., & Day, G. S. (1995).Marketing research. New York: John Wiley.
2.
Albaum, G. (1987). Do source and anonymity affect mail survey results.Academy of Marketing Science,15, 74-81.
3.
Anderson, S. E., & Gansender, B. M. (1995). Using electronic mail surveys and computermonitored data for studying computer-mediated communication systems.Social Science Computer Review,13, 33-46.
4.
Ayidiya, S. A., & McClendon, J. M. (1990). Response effects in mail surveys.Public Opinion Quarterly,54, 229-247.
5.
Bachmann, D., Elfrink, J., & Vazzana, G. (1996). Tracking the progress of e-mail vs. snail-mail. Marketing Research,8, 31-35.
6.
Baker, R. P. (1992). New technology in survey research: Computer-assisted personal interviewing (CAPI).Social Science Computer Review,10, 145-156.
7.
Batinic, B. (1997). How to make an Internet based survey.Advances in Statistical Software,6, 125-132.
8.
Beebe, T. J., Mika, T., Harrison, P. A., Anderson, R. E., & Fulkerson, J. A. (1997). Computerized school surveys.Social Science Computer Review,15, 159-169.
9.
Bloom, P. N., Milne, G. R., & Adler, R. (1995). Avoiding misuse of new information technologies: Legal and societal considerations.Journal of Marketing,58, 98-110.
10.
Box, G. E., & Hunter, J. S. (1961). The 2k-p factorial design part I.Technometrics,3, 311-351.
11.
Chadwick, B. A., Bahr, H. M., & Albrecht, S. L. (1984).Social science research methods. Englewood Cliffs, NJ: Prentice Hall.
12.
Childers, T. L., Pride, W. M., & Ferrell, O. C. (1980). Areassessment of the effects of appeals on response to mail surveys.Journal of Marketing Research,17, 365-370.
13.
Church, A. H. (1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis.Public Opinion Quarterly,57, 62-79.
14.
Churchill, G. A. (1995).Marketing research methodological foundations. New York: Dryden.
15.
Clayton, P., Applebee, A., & Pascoe, C. (1996). E-mail surveys: Old problems with a new delivery medium.LASIE,27, 30-39.
Corman, S. R. (1990). Computerized vs. pencil and paper collection of network data.Social Networks,12, 375-384.
18.
Couper, M. P., & Burt, G. (1994). Interviewer attitudes toward computer-assisted personal interviewing (CAPI).Social Science Computer Review,12, 38-54.
19.
Couper, M. P., & Rowe, B. (1996). Evaluation of a computer-assisted self-interview component in a computer-assisted personal interview survey.Public Opinion Quarterly,60, 89-105.
20.
Cox, D. R. (1992).Planning of experiments. New York: John Wiley.
21.
Dacko, S. G. (1995). Data collection should not be manual labor.Marketing News,29, 31-35.
22.
Daft, R. L., & Lengel, R. H. (1984). Information richness: Anew approach to managerial behavior and organizational design.Research in Organizational Behavior,6, 191-233.
23.
Daft, R. L., Lengel, R. H., & Trevino, L. K. (1987). Message equivocality, media selection, and managerial performance: Implications for information systems.MIS Quarterly,11, 355-366.
24.
Devor, R. E., Chang, T., & Sutherland, J. W. (1992).Statistical quality design and control: Contemporary concepts and methods. New York: Macmillan.
25.
Dillman, D. A. (1978).Mail and telephone surveys: The total design method. New York: John Wiley.
26.
Dillman, D. A. (1991). The design and administration of mail surveys.Annual Review Sociology,17, 225-249.
27.
Dillon, W. R., Madden, T. J., & Firtle, N. H. (1987).Marketing research in a marketing environment. Homewood, IL: Irwin.
28.
Dyson, E. (1994). If nothing on e-mail is private, just say so.Computerworld,27, 22, 33-33.
29.
Emery, V. (1995).How to grow your business on the internet. New York: Coriolis.
30.
Erdos, P. L. (1983).Professional mail surveys. Malabar, FL: Krieger.
31.
Fox, R. J., Crask, M. R., & Kim, J. (1988). Mail survey response rate: A meta analysis of selected techniques for inducing response.Public Opinion Quarterly,52, 229-247.
32.
Gaiser, T. J. (1997). Conducting on-line focus groups.Social Science Computer Review,15, 135-144.
33.
Garton, L., & Wellman, B. (1995). Social impacts of electronic e-mail in organizations: A review of the research literature. In B. R. Burleson (Ed.),Communication yearbook (Vol. 18, pp. 434-452). Thousand Oaks, CA: Sage.
34.
Gates, R. H., & Jarboe, G. R. (1987). Changing trends in data acquisition for marketing research. Journal of Data Collection,27, 25-29.
35.
Gilbert, G. H., Longmate, J., & Branch, L. G. (1992). Factors influencing mailed health surveys. Public Health Reports,107, 576-584.
36.
Goree, C. T., & Marszalek, J. F., III. (1995). Electronic surveys: Ethical issues for researchers. College Student Affairs Journal,15, 75-79.
37.
Gwyne, S. C., & Dickerson, J. F. (1997, April 21). Lost in the e-mail.Time, pp. 88-90.
38.
Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1995).Multivariate data analysis with readings. Englewood Cliffs, NJ: Prentice Hall.
39.
Havice, M. J. (1990). Measuring non-responses and refusals to an electronic survey.Journalism Quarterly,67, 521-530.
40.
Heberlin, T. A., & Baumgartner, R. (1978). Factors affecting response rate to mailed questionnaires: A quantitative analysis of the published literature.American Sociological Review, 3, 447-462.
41.
Helliwell, J. (1986). Global standards promise fluency in electronic mail.PC Week,3, 73-77.
42.
Higgins, C. A., Dimnik, T. P., & Greenwood, H. P. (1987). The DISKQ survey method.Journal of the Market Research Society,29, 437-445.
43.
Hunt, S. D., Sparkman, R. D., & Wilcox, J. (1982). The pretest in survey research: Issues and preliminary findings.Journal of Marketing Research,19, 269-273.
44.
Jobber, D. (1986). Improving response rates in industrial mail surveys.Industrial Marketing Management,15, 183-195.
45.
Jobber, D., & Sanderson, S. M. (1985). Evaluating the effectiveness of two variables on industrial mail survey response rates.Industrial Marketing Management,14, 119-121.
46.
Johnston, J., & Walton, C. (1995). Reducing response effects for sensitive questions: A computer-assisted self interview with audio.Social Science Computer Review,13, 304-319.
47.
Kaldenberg, D. O. (1994). Mail survey response patterns in a population of elderly: Does response deteriorate with age?Public Opinion Quarterly,58, 68-76.
48.
Kalton, G. (1983).Compensating for missing survey data. Ann Arbor: University of Michigan Press.
49.
Kambil, A. (1995). Electronic commerce: Implications of the Internet for business practice and strategy.Business Economics,30, 27-32.
50.
Kantor, J. (1991). The effects of computer administration and identification on the Job Descriptive Index (JDI).Journal of Business & Psychology,5, 309-323.
51.
Karweit, N., & Meyers, E. D. (1983). Computers in survey research. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.),Handbook of survey research (pp. 379-413). New York: Academic Press.
52.
Kerr, E. B., & Hiltz, S. R. (1982).Computer-mediated communication systems. New York: Academy Press.
53.
Kiesler, S. (1989). E-mail brings out the best and worst in group interaction.Infoworld, 4-9.
54.
Kiesler, S., & Sproull, L. S. (1986). Response effects in the electronic survey.Public Opinion Quarterly,50, 402-413.
55.
Kiesler, S., Zubrow, D., & Moses, A. M. (1985). Affect in computer-mediated communication: An experiment in synchronous terminal-to-terminal discussion.Human-Computer Interaction,1, 77-104.
56.
Kittleson, M. J. (1995). An assessment of the response rate via the postal service and e-mail. Health Values,18, 27-29.
57.
Kittleson, M. J. (1997). Determining effective follow-up of e-mail surveys.American Journal of Health Behavior,21, 193-196.
58.
Kochmer, J., & Northwest. (1993).Northwestnet’s guide to our world Internet (4th ed.). Washington, DC: Northwest Academic Computing Consortium.
59.
Komsky, S. H. (1991). A profile of users of electronic mail in a university.Management Communication Quarterly,4, 310-340.
60.
Lavrakas, P. C. (1996). To err is human.Marketing Research,8, 30-36.
61.
Leeuw, E. D., Hox, J. J., & Snijkers, G. (1995). The effect of computer-assisted interviewing on data quality: A review.Journal of the Market Research Society,37, 325-335.
62.
Liefeld, J. P. (1988). Response effects in computer-administered questioning.Journal of Marketing Research,25, 405-409.
63.
Linsky, A. S. (1975). Stimulating responses to mailed questionnaires: Areview.Public Opinion Quarterly,3, 82-101.
64.
Lockhart, D. C., & Russo, J. R. (1996). Mail and telephone surveys in marketing research: A perspective from the field. In R. P. Bagozzi (Ed.),Principles of marketing research (pp. 117- 161). Cambridge, UK: Blackwell.
65.
Malhotra, N. K. (1993).Marketing research: An applied orientation. Englewood Cliffs, NJ: Prentice Hall.
66.
Markus, M. L. (1994). Electronic mail as the medium of managerial choice.Organization Science,5, 502-527.
67.
Mehta, R., & Sivadas, E. (1995). Comparing response rates and response content in mail versus electronic mail surveys.Journal of the Market Research Society,37, 429-439.
68.
Montgomery, D. C. (1991).Design and analysis of experiments. New York: John Wiley.
69.
Mortensen, E. (1985). Electronic mail: An ever changing technology.The Office,102, 101-103.
70.
Neal, W. D. (1989). Computering and software in marketing research: The US perspective. Journal of the Market Research Society,31, 567-576.
71.
O’Lear, S.R.M. (1996). Using electronic mail (e-mail) surveys for geographic research: Lessons from a survey of Russian environmentalists.Professional Geographer,48, 209-217.
72.
Oppermann, M. (1995). E-mail surveys: Potential and pitfalls.Marketing Research: A Magazine of Management & Applications,7, 29-33.
73.
Parker, L. (1992). Collecting data the e-mail way.Training & Development,46, 52-54.
74.
Parker, T. (1995). How internet e-mail works. In M. A. Pike (Ed.),Using the Internet (pp. 283-322). Indianapolis, IN: Que.
75.
Paxson, M. C. (1995). Increasing survey response rates: Practical instructions from the totaldesign method.Cornell Hotel & Restaurant Administration Quarterly,36, 66-74.
76.
Perl, Y., & Whitley, E. (1995, December). The environmental contribution of personal computers: A state of the art report.Computers and Society, pp. 6-8.
77.
Rice, R. E. (1990). Computer-mediated communication system network data: Theoretical concerns and empirical examples.International Journal of Man-Machine Studies,32, 627-647.
78.
Rossi, P. H., Wright, J. D., & Anderson, A. B. (1983). Sample surveys: History, current practice, and future prospects. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.),Handbook of survey research (pp. 1-20). New York: Academic Press.
79.
Roth, P. L., & BeVier, C. A. (1998). Response rates in HRM/OB survey research: Norms and correlates, 1990-1994.Journal of Management,24, 97-118.
80.
Salant, P., & Dillman, D. A. (1994).How to conduct your own survey. New York: John Wiley.
81.
Saltzman, A. (1995). Improving response rates in disk-by-mail surveys.Marketing Research: A Magazine of Management & Applications,5, 32-39.
82.
Schaefer, D. R., & Dillman, D. A. (1998). Development of standard e-mail methodology: Results of an experiment.Public Opinion Quarterly,62, 378-386.
83.
Schuldt, B. H., & Totten, J. W. (1994). Electronic mail vs. mail survey response rate.Marketing Research: A Magazine of Management & Applications,6, 36-44.
84.
Sell, R. L. (1997). Research and the Internet: An e-mail survey of sexual orientation.American Journal of Public Health,2, 297-297.
85.
Shannon, J. H., & Rosenthal, D. A. (1993). Electronic mail and privacy: Can the conflicts be resolved?Business Forum,18, 31-42.
86.
Sproull, L. S. (1986). Using electronic mail for data collection in organizational research.Academy of Management Journal,29, 159-169.
87.
Stanton, J. M. (1998). An empirical assessment of data collection using the Internet.Personnel Psychology,51, 709-725.
88.
Subramanian, A. K., McAfee, A. T., & Getzinger, J. P. (1997). Use of the World Wide Web for multisite data collection.Academic Emergency Medicine,4, 811-817.
89.
Sudman, S. (1996). Sampling. In R. P. Bagozzi (Ed.),Principles of marketing research (pp. 73- 115). Cambridge, UK: Blackwell.
90.
Swoboda, W. J., Muhlberger, N., Weitkunat, R., & Scheneeweib, S. (1997). Internet surveys by direct mailing: An innovative way of collecting data.Social Science Computer Review,15, 242-255.
91.
Synodinos, N. E., & Brennan, J. M. (1988). Computer active interviewing in survey research. Psychology & Marketing,5, 117-137.
92.
Tourangeau, R., & Smith, T. W. (1996). Asking sensitive questions: The impact of data collection mode, question format, and question context.Public Opinion Quarterly,60, 275-304.
93.
Tse, A.C.B. (1998). Comparing the response rate, response speed and response quality of tow methods of sending questionnaires: E-mail vs. mail.Journal of the Market Research Society,40, 353-361.
94.
Tull, D. S., & Hawkins, D. I. (1993).Marketing research: Measurement & method. New York: Macmillan.
95.
Vazzana, G. S., & Bachmann, D. (1994). Fax attracts.Marketing Research: AMagazine of Management & Applications,6, 19-25.
96.
Veiga, J. F. (1984). Getting the mail questionnaire returned: Some practical research considerations.Journal of Applied Psychology,59, 217-238.
97.
Walsh, J. P., Kiesler, S., Sproull, L. S., & Hesse, B. W. (1992). Self-selected and randomly selected respondents in a computer network survey.Public Opinion Quarterly,56, 241-244.
98.
Watson, S. C. (1998). Aprimer in survey research.Journal of Continuing Higher Education,46, 31-40.
99.
Weisband, S., & Kiesler, S. (1996). Self disclosure on computer forms: Meta analysis and implications.Human Factors in Computing Systems Conference Proceedings, 3-10.
100.
Yammarino, F. J., Skinner, S. J., & Childers, T. L. (1991). Understanding mail survey response behavior: A meta-analysis.Public Opinion Quarterly,55, 613-639.
101.
Yu, J., & Cooper, H. (1983). Aquantitative review of research design effects on response rates to questionnaires.Journal of Marketing Research,20, 36-44.
102.
Zikmund, W. G. (1994).Business research methods. New York: Harcourt Brace.
