This article examines methodological issues for content analytic research of the World Wide Web. The outline of content analysis as a systematic and quantitative scientific method for measuring the content of messages have existed for centuries. Nevertheless, its development and diffusion have been primarily spurred by the rise of mass media, newspapers in the 19th century and electronic media in the 20th century. The growth of the Internet promises to induce a similar expansion of its use and refinement of its techniques. The World Wide Web is characterized by its ubiquity, global reach, interactivity, decentralized, hyperlinked structure, and multimedia format. All of these characteristics present researchers with opportunities and challenges at each step of a content analysis: sampling, unitization, development of content categories, coding, and analysis. Based on a review of recent content analytic research, this article analyzes these issues and suggests methodological improvements for future research.
Adams, W. C. (1978a). Network news in perspective: A bibliographic essay. In W. C. Adams & F. Schreibman (Eds.), Television network news: Issues in content research. Washington, DC: School of Public and International Affairs.
2.
Adams, W. C. (1978b). Visual analysis of newscasts: Issues in social science research. In W. C. Adams & F. Schreibman (Eds.), Television network news: Issues in content research. Washington, DC: School of Public and International Affairs.
3.
Alexa, M., & Zuell, C. (1999). A review of software for text analysis. Mannheim, Germany: Zentrum fur umfragen, methoden, und analysen.
4.
Anthony, O. (1998, October 29). Demystify your log files. CNET: Builder.Com [Online]. Available: http://www.builder.com/Servers/LogFile/index.html
5.
Barab, S. A., Bowdish, B. E., Young, M. F., & Owen, S. V. (1996). Understanding kiosk navigation: Using log files to capture hypermedia searches. Instructional Science, 24, 377-395.
6.
Bates, M. J., & Lu, S. (1997). An exploratory profile of personal home pages: content, design, metaphors. Online and CDROM Review, 21(6), 331-340.
Berelson, B. (1952). Content analysis in communication research. New York: Free Press.
9.
Berelson, B., & Lazarsfeld, P. (1948). The analysis of communication content. Chicago and New York: University of Chicago and Columbia University.
10.
Bremser, W. (1998, February 2). As Web sites grow unmanageably large, Webmasters need ways they can tame them. Internet world [Online]. Available: www.internetworld.com/print/1998/02/02/iwlabs/19980202-tools.html
11.
Bucy, E., Lang, A., Potter, R. F., & Grabe, M. E. (1999, May 27-31). Formal features of cyberspace: A content analysis of the World Wide Web. Paper presented at the International Communication Association Conference, San Francisco.
12.
Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum.
13.
Cool Netsites. (1999, September 25). How do Web rings work [Online]. Available: members.aol.com/skycheetah/whatis.html
14.
Dean, N. (1999, September 8). OCLC research project measures scope of the Web. Online Computer Library Center [Online]. Available: http://www.oclc.org/oclc/press/19990908.htm
15.
Faisal, A., Shahabi, C., McLaughlin, M., & Betz, F. (1999). IN site: Introduction to a generic paradigm for interpreting user-Web space interaction. Integrated Media Studies Center, University of Southern California [Online]. Available: http://www-scf.usc.edu/%7Efaisal/portfolio/research.html
16.
Fan, D. P. (1997). Computer content analysis of press coverage and prediction of public opinion for the 1995 sovereignty referendum in Quebec. Social Science Computer Review, 15(4), 351-366.
17.
Gibson, R. (1999). A methodology for measuring the functions and effectiveness of political party Web-sites. Unpublished manuscript, University of Salford.
18.
Gibson, R., & Ward, S. (1998). U.K. political parties and the Internet: “Politics as usual” in the new media?Press/Politics, 3(3), 14-38.
19.
Graphics, Visualization & Usability. (1999). GVU’s WWW user surveys. Graphics, Visualization & Usability Center at Georgia Tech [Online]. Available: http://www.cc.gatech.edu/gvu/user_surveys/
20.
Greatbatch, D. (1998). Conversational analysis: neutralism and British news interviews. In A. Bell & P. Garrett (Eds.), Approaches to media discourses. Oxford, UK: Blackwell.
21.
Greer, J., & LaPointe, M. (1999, May 27-31). Meaningful discourse or cyber-fluff? An analysis of gubernatorial campaign Web sites throughout the 1998 election cycle. Paper presented at the International Communication Association Conference, San Francisco.
22.
Ha, L., & James, E. L. (1998, April). Interactivity in business Web sites: A content analysis. Paper presented at the American Academy of Advertising Annual Conference, Lexington, KY.
23.
Haas, S. W., & Grams, E. S. (2000). Readers, authors, and page structure: A discussion of four questions arising from a content analysis of Web pages. Journal of the American Society for Information Science, 51(2), 181-192.
24.
Harpham, E. J. (1999, September). Going on-line: The 1998 congressional campaign. Paper presented at the American Political Science Association, Atlanta, GA.
25.
Hayduk, L. A. (1987). Structural equation modeling with LISREL: Essentials and advances. Baltimore: Johns Hopkins University Press.
26.
Ho, J. (1997). Evaluating the World Wide Web: A global study of commercial sites. Journal of Computer Mediated Communication [Online],3(1). Available: http://www.ascusc.org/jcmc/vol3/issue1/ho.html
27.
Holsti, O. R. (1969). Content analysis for the social science and humanities. Reading, MA: Addison-Wesley.
28.
Internet Assigned Numbers Authority. (1999). Domain name services [Online]. Available: http://www.iana.org/domain-names.html
29.
Ju-Pak, K. -H. (1999). Content dimensions of Web advertising: A cross-national comparison. International Journal of Advertising, 18(2), 207-231.
30.
Kahin, B., & Keller, J. (Eds.). (1997). Coordinating the Internet. Cambridge: MIT Press.
31.
Kiesler, S., & Sproull, L. (1992). Group decision making and communication technology. Organizational Behavior and Human Decision Processes, 52, 96-123.
32.
Koehler, W. (1999). An analysis of Web page and Web site constancy and permanence. Journal of American Society for Information Science, 50(2), 162-180.
33.
Koster, M. (2000, Jan. 19). The Web robots pages [Online]. Available: info.webcrawler.com/mak/projects/robots/robots.html
34.
Krippendorff, K. (1980). Content analysis: An introduction to its methodology. Beverly Hills, CA: Sage.
35.
Lawrence, S., & Giles, C. L. (1999). Accessibility of information on the Web. Nature, 400, 107-109.
36.
Li, X. (1998). Web page design and graphic use of three U.S. newspapers. Journalism & Mass Communication Quarterly, 75(2), 353-365.
37.
Lichty, L. W., & Bailey, G. A. (1978). Reading the wind: Reflections on content analysis of broadcast news. In W. C. Adams & F. Schreibman (Eds.), Television network news: Issues in content research. Washington, DC: School of Public and International Affairs.
38.
McLaughlin, M. L. (1996). The art site on the World Wide Web. Journal of Communication, 46(1), 51-79.
39.
McMillan, S. (1999, May 27-31). The Microscope and the moving target: The challenge of applying a stable research technique to a dynamic communication environment. Paper presented at the International Communication Association Conference, San Francisco.
40.
McTavish, D. G. (1997). Scale validity: A computer content analysis approach. Social Science Computer Review, 15(4), 379-393.
41.
Miller, M. M. (1997). Frame mapping and analysis of news coverage of contentious issues. Social Science Computer Review, 15(4), 367-378.
42.
Miller, M. M., Andsager, J. L., & Riechert, B. P. (1998). Framing the candidates in the presidential primaries: Issue and images in press releases and news coverage. Journalism and Mass Communication Quarterly, 75(2), 312-324.
43.
Musso, J. A., Weare, C., & Hale, M. (2000). Designing Web technologies for local governance reform: Good management or good democracy?Political Communication, 17(1), 1-19.
44.
Nash, P. R., & Greenstein, S. (1997). Lead users and their on-line communications: Independent software vendor usage of the World Wide Web for commercial purposes. Unpublished manuscript, Northwestern University, Kellogg School of Management.
45.
Newhagen, J., & Rafaeli, S. (1996). Why communication researchers should study the Internet: A dialogue. Journal of Computer-Mediated Communication [Online], 1(4). Available: http://www.ascusc.org/jcmc/vol1/issue4/rafaeli.html
46.
Nicholson, S. (1997). Indexing and abstracting on the World Wide Web: An examination of six Web databases. Information Technology and Libraries, 16(2), 73-81.
47.
Orellana, E. R. (1996). Comparative study of the information developed from messages containing picture and text. Instructional Science, 24(5), 357-375.
48.
Pavlik, J. V. (1999). Understanding the impact of new media on journalism [Online]. Available: http://www.columbia.edu/%7Ejp35/lectures/
49.
Postel, J. (1994). Request for comments: 1591. USC/Information Sciences Institute [Online]. Available: http://www.isi.edu/in-notes/rfc1591.txt
50.
Potter, R. F. (1999, May). Measuring the “bells & whistles” of a new medium: Using content analysis to describe structural features of cyberspace. Paper presented at the International Communication Association Conference, San Francisco.
51.
Riffe, D., & Freitag, A. (1997). A content analysis of content analyses: Twenty-five years of journalism quarterly. Journalism and Mass Communication Quarterly, 74(3), 515-524.
52.
Sadow, J. D., & James, K. (1999, September). Virtual billboards? Candidate Web sites and campaigning in 1998. Paper presented at the American Political Science Association, Atlanta, GA.
53.
Stone, C. N. (1989). Regime politics: Governing Atlanta 1946-1988. Lawrence: University Press of Kansas.
54.
Sudweeks, F., McLaughlin, M., & Rafaeli, S. (Eds.). (1998). Network and netplay: Virtual groups on the Internet. Cambridge: MIT Press.
55.
Swales, J. (1998). Other floors, other voices: A textography of a small university building. Mahwah, NJ: Lawrence Erlbaum.
56.
University of California, Berkeley Library. (1999). Meta-search engines [Online]. Available: http://www.lib.berkeley.edu/TeachingLib/Guides/Internet/MetaSearch.html
57.
Weare, C., Musso, J., & Hale, M. (1999, September). The political economy of electronic democratic forums: The design of Californian municipal Web sites. Paper presented at the American Political Science Association, Atlanta, GA.
58.
Zaremby, J. (1999). Dredging drudge. Brill’s Content, 2, 33.
