Little is known about the quality and usability of on-line health information. This analysis evaluated smoking cessation Web sites' content quality and usability. Thirty sites were analyzed to determine their adherence to established tobacco cessation guidelines and their accessibility, usability, credibility, and currency. Most explained addiction (86.7%) and mentioned nicotine replacement therapy (NRT) (93.3%) and social support (93.3%). However, few explained potential side effects of NRT (33.3%) or which smokers should avoid using NRT (30.0%). Two sites advocated substituting smokeless tobacco or herbal cigarettes when quitting, and 16 (53.3%) provided information written at greater than an eighth-grade level. Few sites provided a search mechanism (40.0%) or offered text-only versions (30.0%), and most (83.3%) failed to indicate when content pages were last updated. Most sites adhered to established cessation guidelines. A small subset offered erroneous and potentially harmful information. Applying fundamental design principles would improve accessibility, usability, credibility, and currency.
Albright, J., deGuzman, C., Acebo, P., Paiva, D., Faulkner, M., & Swanson, J. (1996). Readability of patient education materials: Implications for clinical practice. Applied Nursing Research, 9(3), 139-143.
3.
Berland, G. K., Elliott, M. N., Morales, L. S., Algazy, J. I., Kravitz, R. L., & Broder, M. S., et al. (2001). Health information on the Internet: Accessibility, quality, and readability in English and Spanish. Journal of the American Medical Association, 285, 2612-2621.
4.
Biermann, J. S., Golladay, G. J., Greenfield, M. L., & Baker, L. H. (1999). Evaluation of cancer information on the Internet. Cancer, 86, 381-390.
5.
Boyer, C., Selby, M., Scherrer, J. R., & Appel, R. D. (1998). The “health on the net” code of conduct for medical and health Web sites. Computers in Biology and Medicine, 28, 603-610.
6.
Brigham, J. (2000). Web-surfing for help “How can I stop using tobacco?” Web has answers—sometimes. Society for Research in Nicotine and Tobacco Newsletters, 6, 8-10.
7.
Cohen, S., Lichtenstein, E., Prochaska, J. O., Rossi, J. S., Gritz, E. R., & Carr, C. R., et al. (1989). Debunking myths about self-quitting: Evidence from 10 prospective studies of persons who attempt to quit smoking by themselves. American Psychology, 44, 1355-1365.
8.
Coiera, E. (1996). The Internet's challenge to health care provision. British Medical Journal, 312, 3-4.
9.
Fiore, M. C., Bailey, W. C., Cohen, S. J., Dorfman, S. F., Goldstein, M. G., & Gritz, E. R., et al. (1996). Smoking cessation (Clinical Practice Guideline No. 18, AHCPR Publication No. 96-0692). Rockville, MD: U.S. Department of Health and Human Services, Public Health Service, Agency for Health Care Policy and Research.
10.
Fiore, M. C., Bailey, W. C., Cohen, S. J., Dorfman, S. F., Goldstein, M. G., & Gritz, E. R., et al. (2000). Treating tobacco use and dependence. Clinical practice guideline. Rockville, MD: U.S. Department of Health and Human Services, Public Health Service.
11.
Fox, S., & Rainie, L. (2000). The online health care revolution: How the Web helps Americans take better care of themselves. Washington, DC: The Pew Internet & American Life Project. Retrieved April 19, 2000, from http://www.pewinternet.org/reports/pdfs/PIP_Health_Report.pdf
12.
Goldman J., Hudson, Z., & Smith, R. (2000). Privacy: Report on the privacy policies and practices of health Web sites. Oakland: California Healthcare Foundation. Retrieved April 5, 2000, from http://ehealth.chcf.org/priv_pol3/index_show.cfm?doc_id=33
Impicciatore, P., Pandolfini, C., Casella, N., & Bonati, M. (1997). Reliability of health information for the public on the World Wide Web: Systematic survey of advice on managing fever in children at home. British Medical Journal, 314, 1875-1879.
15.
Kim, P., Eng, T. R., Deering, M. J., & Maxfield, A. (1999). Published criteria for evaluating health related Web sites: Review. British Medical Journal, 318, 647-649.
16.
Kreuter, M., Farrell, D., Olevitch, L., & Brennan, L. (2000). Tailoring health messages: Customizing communication with computer technology. Hillsdale, NJ: Lawrence Earlbaum.
17.
Lindgaard, G. (1994). Usability testing and system evaluation: A guide for designing useful computer systems. New York: Chapman & Hall.
18.
Maxwell, B. (1998). How to find health information on the Internet. Washington, DC: Congressional Quarterly Books.
19.
McGinnis, J. M., Deering, M. J., & Patrick, K. (1995). Public health information and the new media: A view from the Public Health Service. In L. M. Harris (Ed.), Health and the new media: Technologies transforming personal and public health. (pp. 127-141). Hillsdale, NJ: Lawrence Erlbaum.
20.
McGinnis, J. M., & Foege, W. H. (1993). Actual causes of death in the United States. Journal of the American Medical Association, 270(18), 2207-2212.
21.
Meade, C. D., & Byrd, J. C. (1989). Patient literacy and the readability of smoking education literature. American Journal of Public Health, 79, 204-206.
Mitra, A., & Cohen, E. (1999). Analyzing the Web, directions and challenges. In S. Jones (Ed.), Doing Internet research: Critical issues and methods for examining the net (pp. 179-202). Thousand Oaks, CA: Sage.
25.
National Cancer Institute. (1992). Making health communication programs work: A planner's guide (NIH Publication No. 92-1493). Washington, DC: U.S. Department of Health and Human Services, Public Health Service, National Institutes of Health.
Prochaska, J. O., & DiClemente, C. C. (1983). Stages and processes of self-change of smoking: Toward an integrative model of change. Journal of Consulting and Clinical Psychology, 51, 390-395.
28.
Prochaska, J. O., Redding, C. A., & Evers, K. E. (1997). The transtheoretical model and stages of change. In K. Glanz, F. M. Lewis, & B. Rimer (Eds.), Health behavior and health education (2nd ed., pp. 60-84). San Francisco: Jossey-Bass.
29.
Silberg, W. M., Lundberg, G. D., & Musacchio, R. A. (1997). Assessing, controlling, and assuring the quality of medical information on the Internet: Caveat lector et viewor—Let the reader and viewer beware. Journal of the American Medical Association, 277, 1244-1245.
30.
Skaar, K. L., Tsoh, J. Y., McClure, J. B., Cinciripini, P. M., Friedman, K., & Wetter, D. W., et al. (1997). Smoking cessation 1: An overview of research. Behavioral Medicine, 23, 5-13.
31.
Strecher, V. J. (1999). Computer-tailored smoking cessation materials: A review and discussion. Patient Education and Counseling, 36, 107-117.
32.
Swinehart, J. W. (1997). Health behavior research and communication campaigns. In D. S. Gochman (Ed.), Handbook of health behavior research: Vol. 4. Relevance for professionals and issues for the future (pp. 351-373). New York: Plenum.
33.
Takahashi, Y., Satomura, K., Miyagishima, K., Nakahara, T., Higashiyama, A., & Iwai, K., et al. (1999). A new smoking cessation programme using the Internet [Letter]. Tobacco Control, 8, 109-110.
34.
Teach, L. (1998). Evaluating health-related Web sites. Atlanta, GA: Rollins School of Public Health, Health Promotion & Wellness. Retrieved February 1, 2000, from http://www.sph.emory.edu/WELLNESS/abstract.html
35.
Tomita, M. (1999). Administration design quality Web site evaluation method. Brooklyn: Department of Health and Nutrition Sciences, CUNY Brooklyn College.
36.
Tsoh, J. Y., McClure, J. B., Skaar, K. L., Wetter, D. W., Cinciripini, P. M., & Prokhorov, A. V., et al. (1997). Smoking cessation 2: Components of effective intervention. Behavioral Medicine, 23, 15-27.
37.
U.S. Centers for Disease Control and Prevention. (1999). Cigarette smoking among adults—United States, 1997. Morbidity and Mortality Weekly Report, 48(43), 993-996.
38.
U.S. Centers for Disease Control and Prevention. (2001). Cigarette smoking among adults—United States, 1999. Morbidity and Mortality Weekly Report, 50(40), 869-873.
39.
U.S. Internet Council & ITTA Inc. (2000). State of the Internet 2000. Washington, DC. Retrieved September 1, 2000, from http://usic.wslogic.com/intro.html
40.
Winker, M.A., Flanagin, A., Chi-Lum, B., White, J., Andrews, K., & Kennett, R.L., et al. (2000). Guidelines for medical and health information sites on the Internet: Principles governing AMA Web sites. Journal of the American Medical Association, 283, 1600-1606.
41.
Wyatt, J. C. (1997). Commentary: Measuring quality and impact of the World Wide Web. British Medical Journal, 314, 1879-1879.
