Circumventing Nonresponse - Upgrading Traditional Company Survey Data with Unobtrusive Data from Company Websites

Abstract

French

To validate a survey of small and medium sized enterprises (SMEs), we tested the similarity between respondents and nonrespondents using traditional methods of supplemental data collection. Additionally we also applied mixed methods by enhancing the survey data with data obtained by a novel unobtrusive method: observation of company websites. The website data were obtained through human collection of characteristics of the homepage with observation of functional items that were coded and combined into an index for general website quality. Analysis of these data supported the validity of the original survey and exhibited a positive significant correlation between the survey index for use of information technology (IT) and the website quality index. The finding supports unobtrusive website observation as an appropriate data collection substitute.

Keywords

Recherche par Internet Méthodes mixtes Non-réponse d’organisation PME Non-réponse d’enquête Méthodes discrètes Recherche sur les sites Web Internet Research Mixed Methods Organisational Nonresponse SME Survey Nonresponse Unobtrusive Methods Website Research

Get full access to this article

View all access options for this article.

References

Ackland

Gibson

Lusoli

Ward

(2010) Engaging with the Public? Assessing the Online Presence and Communication Practices of the Nanotechnology Industry. Social Science Computer Review 28(4): 443–65.

Bauer

Scharl

(2000) Quantitative Evaluation of Website Content and Structure. Internet Research 10(1): 31–43.

Beaird

(2007) The Principles of Beautiful Web Design. Melbourne: Sitepoint.

Calero

Caro

Piattini

(2008) An Applicable Data Quality Model for Web Portal Data Consumers. World Wide Web 11: 465–84. Berlin: Springer.

Carlson

Herdman

(2012) Understanding the Impact of Convergent Validity on Research Results. Organizational Research Methods 15(1): 17–32.

Caro

Calero

Caballero

Piattini

(2006) Defining a Data Quality Model for Web Portals. International Conference on Web Information Systems Engineering, Whan, China, October 2006. Berlin: Springer, 363–74.

Cloninger

(2009) Fresher Styles for Web Designers. More Eye Candy from the Underground. Berkeley CA: New Riders.

Daniel

Grimshaw

(2002) An Exploratory Comparison of Electronic Commerce Adoption in Large and Small Enterprises. Journal of Information Technology 17: 133–47.

De Leeuw

(2012) Counting and Measuring Online: The Quality of Internet Surveys. Bulletin de Méthodologie Sociologique 114:68–78.

10.

Dillman

(2007) Mail and Internet Surveys. The Tailored Design Method. New York: John Wiley and Sons (second edition).

11.

Edwards

(2011) The Fallacy of Formative Measurement. Organizational Research Methods 14(2): 370–88.

12.

Engholm

Salamon

(2005) Webgenres and -styles as Socio-cultural Indicators - An Experimental, Interdisciplinary Dialog. ‘In The Making’ Conference Copenhagen April 29th-May 1st 2005, 30–36.

13.

Filion

(1975) Estimating Bias Due to Nonresponse in Mail Surveys. Public Opinion Quarterly 39(4): 482–92.

14.

González

FJM

Palacios

TMB

(2004) Quantitative Evaluation of Commercial Web Sites: An Empirical Study of Spanish Firms. International Journal of Information Management 24: 313–28.

15.

Goode

Stevens

(2000) An Analysis of the Business Characteristics of Adopters and Non-adopters of World Wide Web Technology. Information Technology and Management 1: 129–54.

16.

Gregg

Walczak

(2010) The Relationship between Website Quality, Trust and Price Premiums at Online Auctions. Electronic Commerce Research 10(1): 10–25.

17.

Hackett

Parmanto

(2009) Homepage Not Enough when Evaluating Website Accessibility. Internet Research 19(1): 78–87.

18.

Haunberger

(2011) To Participate or Not to Participate: Decision Processes Related to Survey Non-response. Bulletin de Méthodologie Sociologique 109: 39–55.

19.

Hedlin

Wahlström

Bäckström

Erikson

(2006) An Experiment on Perceived Survey Response Burden among Businesses. Proceedings of European Conference on Quality in Survey Statistics. 1–10.

20.

Hernández

Jiménez

Martín

(2009) Key Website Factors in E-business Srategy. International Journal of Information Management 29: 362–71.

21.

Jose

Lee

(2007) Environmental Reporting of Global Corporations: A Content Analysis Based on Website Disclosures. Journal of Business Ethics 72: 307–21.

22.

Kim

Shaw

Schneider

(2003) Website Design Benchmarking within Industry Groups. Internet Research 13(1): 17–26.

23.

Lamertz

Heugens

PPMAR

Calmet

(2005) The Configuration of Organizational Images Among Firms in the Canadian Beer Brewing Industry. Journal of Management Studies 42(4): 817–843.

24.

McIntire

(2008) Visual Design for the Modern Web. Berkeley CA: New Riders.

25.

McKenny

Short

Zachary

Payne

(2012) Assessing Espoused Goals in Private Family Firms Using Content Analysis. Family Business Review 25(3): 298–317.

26.

Micelotta

Raynard

(2011) Concealing or Revealing the Family? Corporate Brand Identity Strategies in Family Firms. Family Business Review 24(3): 197–216.

27.

Murphy

Poist

Lynagh

Grazer

(2003) An Analysis of Select Website Practices among Supply Chain Participants. Industrial Marketing Management 32: 243–50.

28.

Nielsen

Landauer

(1993) A Mathematical Model of the Finding of Usability Problems. Proceedings of ACM INTERCHI’93 Conference. Amsterdam, The Netherlands, 24-29 April 1993, http://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/, 206–213.

29.

Paek

Bae

Hove

(2011) Theories into Practice: A Content Analysis of Anti-smoking Websites. Internet Research 21(1): 5–25.

30.

Rasmussen

(2010) It-anvendelse og samarbejde i SMV’er (‘IT-use and Collaboration in SMEs’). Odense: University Press of Southern Denmark.

31.

Rasmussen

Thimm

(2009) Fact-Based Understanding of Business Survey Non-Response. Electronic Journal of Business Research Methods 7(2): 83–92.

32.

Rasmussen

Thimm

(2013) Collaboration Experience and IT Use in SME Production Companies. International Conference on Collaboration Technologies and Systems (CTS), IEEE, San Diego, USA, May 2013, 617–21.

33.

Rogelberg

Conway

Sederburg

Spitzmüller

Aziz

Knight

(2003) Profiling Active and Passive Nonrespondents to an Organizational Survey. Journal of Applied Psychology 88(6): 1104–14.

34.

Rogelberg

Stanton

(2007) Understanding and Dealing with Organizational Survey Nonresponse. Organizational Research Methods 10(2): 195–209.

35.

Rubin

(1987) Multiple Imputation for Nonresponse in Surveys. New York: John Wiley & Sons Inc. (Wiley Series in Probability and Mathematical Statistics).

36.

Schubert

Selz

(1999) Web Assessment - Measuring the Effectiveness of Electronic Commerce Sites Going beyond Traditional Marketing Paradigms. Proceedings of the 32nd Hawaii International Conference on System Sciences, January 1999, 1–10.

37.

Sullivan

(1999) What are the Functions of Corporate Home Pages. Journal of World Business 34(2): 193–210.

38.

Thelwall

(2009) Introduction to Webometrics. Quantitative Web Research for the Social Sciences. San Rafael CA: Morgan & Claypool.

39.

Thorlacius

(2002) Visuel kommunikation på websites (‘Visual Communication on Websites’). Frederiksberg: Roskilde Universitetsforlag.

40.

Tkach-Kawasaki

(2010) Mapping Political Connections in Japan: The Functions of Hyperlinks on Japanese Diet Member Websites. Social Science Computer Review 29(3): 300–12.

41.

Vaughan

Gao

Kipp

(2006) Why Are Hyperlinks to Business Websites Created? A Content Analysis. Scientometrics 67(2): 291–300.

42.

Webb

Campbell

Schwartz

Sechrest

(1966) Unobtrusive Measures. Nonreactive Research in the Social Sciences. Chicago: Rand McNally & Co.

43.

Webb

Campbell

Schwartz

Sechrest

Grove

(1981) Nonreactive Research in the Social Sciences. Boston: Hougton Mifflin Company.