This randomized experiment examined survey mode effects for self-reporting illicit drug use by comparing prevalence estimates between a Web-based survey and a mail-based survey. A random sample of 7,000 traditional-aged undergraduate students attending a large public university in the United States was selected to participate in the spring of 2001. Students were randomly assigned to self-administer a survey via the Web or U.S. mail. The Web survey produced a significantly higher response rate than the U.S. mail survey. The prevalence estimates of illicit drug use (lifetime and past year) did not differ significantly between the two survey modes. The findings provide preliminary evidence that Web and U.S. mail surveys produce similar results regarding illicit drug use among undergraduate students. Although additional research is needed involving more diverse samples, these findings bode well for using Web surveys in college-based research.
Get full access to this article
View all access options for this article.
References
1.
Bas onJ. J., Comparison of Telephone, Mail, Web, and IVR Surveys of Drug and Alcohol Use among University of Georgia Students, paper presented at the American Association of Public Opinion Research, Portland, Oregon, May 2000.
2.
CariniR. M.HayekJ. H.KuhG. D.KennedyJ. M., and OuimetJ.A.. College Student Responses to Web and Paper Surveys: Does Mode Matter?Research in Higher Education, 44, pp. 1–19, 2003.
3.
KennedyJ. M.KuhG. D., and CariniR., Web and Mail Surveys: Preliminary Results of Comparisons Based on a Large-Scale Project, paper presented at the Annual Meeting of the American Association for Public Opinion Research, Portland, Oregon, May 2000.
4.
KwakN. and RadlerB., A Comparison between Mail and Web Surveys: Response Pattern, Respondent Profile, and Data Quality, Journal of Official Statistics, 18, pp. 257–273, 2002.
5.
KypriK. and GallagherS. J., Incentives to Increase Participation in an Internet Survey of Alcohol Use: A Controlled Experiment, Alcohol and Alcoholism, 38, pp. 437–441, 2003.
6.
McCabeS. E., Gender Differences in Collegiate Risk Factors for Heavy Episodic Drinking, Journal of Studies on Alcohol, 63, pp. 49–56, 2002.
7.
McCabeS. E.BoydC. J.CouperM. P.CrawfordS., and d'ArcyH., Mode Effects for Collecting Alcohol and Other Drug Use Data: Web and U.S. Mail, Journal of Studies on Alcohol, 63, pp. 755–761, 2002.
8.
MillerE. T.NealD. J.RobertsL. J.BaerJ. S.CresslerS. O.MetrikJ., and MarlattG. A., Test-Retest Reliability of Alcohol Measures: Is There a Difference Between Internet-Based Assessment and Traditional Methods?Psychology of Addictive Behaviors, 16, pp. 56–63, 2002.
9.
PealerL.WeilerR. M.PiggR. M.MillerD., and DormanS. M., The Feasibility of a Web-Based Surveillance System to Collect Health Risk Behavior Data from College Students, Health Education Behavior, 28, pp. 547–559, 2001.
RainieH., The Changing Online Population: It's More and More Like the General Population, Pew Internet and American Life Project Report. Available at: http://www.pewinternet.org/reports/index.asp [accessed October 2001].
14.
AquilinoW. S., Telephone Versus Face-to-Face Interviewing for Household Drug Use Surveys, International Journal of Addictions, 27, pp. 71–91, 1992.
15.
FendrichM. and JohnsonT. P., Examining Prevalence Differences in Three National Surveys of Youth: Impact of Consent Procedures, Mode and Editing Rules, Journal of Drug Issues, 31, pp. 615–642, 2001.
16.
GfroererJ.WrightD., and KopsteinA., Prevalence of Youth Substance Use: The Impact of Methodological Differences Between Two National Surveys, Drug and Alcohol Dependence, 47, pp. 19–30, 1997.
17.
SudmanS., Examining Substance Abuse Data Collection Methodologies, Journal of Drug Issues, 31, pp. 695–716, 2001.
18.
TurnerC. F.KuL.RogersS. M.LindbergL. D.PleckJ. H., and SonensteinF. L., Adolescent Sexual Behavior, Drug Use, and Violence: Increased Reporting with Computer Survey Technology, Science, 280, pp. 867–873, 1998.
19.
WrightD. L.AquilinoW. S., and SuppleA. I., A Comparison of Computer-Assisted and Paper-and-Pencil Self-Administered Questionnaires in a Survey on Smoking, Alcohol, and Other Drug Use, Public Opinion Quarterly, 62, pp. 331–353, 1998.
20.
DillmanD. A.TortoraR. D., and BowkerD., Principles for Constructing Web Surveys, SESRC Technical Report 98–50, Pullman, Washington. Available at: http://survey.sesrc.wsu.edu/dillman/papers.htm [accessed December 1999].
21.
JohnstonL. D.O'MalleyP. M., and BachmanJ. G., Monitoring the Future National Survey Results on Drug Use, 1975–1999 (Vol. 2). Department of Health and Human Services, NIH Publication No. 00–4802, Bethesda, Maryland, 2000.
22.
PresleyC. A.MeilmanP. W., and CashinJ. R., Alcohol and Drugs on American College Campuses: Use, Consequences, and Perceptions of the Campus Environment (Vol. 4: 1992–1994), Southern Illinois University, Core Institute, Carbondale, Illinois, 1996.
23.
WechslerH.DavenportA.DowdallG.MoeykensB., and CastilloS., Health and Behavioral Consequences of Binge Drinking in College: A National Survey of Students at 140 Campuses, JAMA, 272, pp. 1672–1677, 1994.
24.
JohnstonL. D.O'MalleyP. M.BachmanJ. G., Monitoring the Future National Survey Results on Drug Use, 1975–2001 (Vol. 2), Department of Health and Human Services, NIH Publication No. 02–5107, Bethesda, Maryland, 2002.
25.
WechslerH.LeeJ. E.KuoM.SeibringM.NelsonT. F., and LeeH., Trends in College Binge Drinking during a Period of Increased Prevention Efforts. Findings from 4 Harvard School of Public Health College Alcohol Study Surveys: 1993–2001, Journal of American College Health, 50, pp. 203–217, 2002.
26.
Mohler-KuoM.LeeJ. E., and WechslerH., Trends in Marijuana and Other Illicit Drug Use among College Students: Results from 4 Harvard School of Public Health College Alcohol Study Surveys: 1993–2001, Journal of American College Health, 52, pp. 17–24, 2003.
27.
StroteJ.LeeJ. E., and WechslerH., Increased MDMA Use among College Students: Results of a National Survey, Journal of Adolescent Health, 30, pp. 64–72, 2002.
28.
ShettleC. and MooneyG., Monetary Incentives in U.S. Government Surveys, Journal of Official Statistics, 15, pp. 231–250, 1999.
29.
CouperM. P.TraugottM., and LamiasM., Web Survey Design and Administration, Public Opinion Quarterly, 65, pp. 230–253, 2001.
