An analysis of how nonresponse error is assessed in academic marketing research

Abstract

Nonresponse error is a topic that draws little attention but can dramatically affect the ability to generalize results of a research study. The authors carried out an empirical investigation that took a critical look at the marketing discipline to see how nonresponse error was being addressed in three of the top five marketing journals. The data for this study consisted of a content analysis of all articles from the Journal of Marketing, the Journal of Marketing Research, and the Journal of the Academy of Marketing Science from 1999 through 2003 to determine if and how nonresponse error was being addressed in academic marketing research. This article details the findings of this content analysis, i.e., what measures are being used to assess nonresponse error along with the literature cited in support of these measures. The article concludes with an overall analysis of how well this topic is being addressed along with further suggestions for assessing nonresponse in the field of marketing research.

Keywords

assessment measures content analysis marketing research nonresponse error

Get full access to this article

View all access options for this article.

References

American Marketing Association (2003) `Dictionary of Marketing Terms', URL (consulted November 2005): http://www.marketingpower.com/mg-dictionary.php

Armstrong, S.J. and Overton, T.S. (1977) ` Estimating Nonresponse Error in Mail Surveys ', Journal of Marketing Research 14(3): 396—402 .

Baumgartner, H. and Pieters, R. (2003) ` The Structural Influence of Marketing Journals: A Citation Analysis of the Discipline and its Subareas Over Time' , Journal of Marketing 67(2): 123—39 .

Blair, W.S. (1964) ` How Subject Matter Can Bias a Mail Survey ', Media/Scope February: 70—2 .

Braunsberger, K. , Gates, R. , and Ortinau, D.J. (2005) ` Prospective Respondent Integrity Behavior in Replying to Direct Mail Questionnaires: A Contributor in Overestimating Nonresponse Rates ', Journal of Business Research 58(3): 260—7 .

Chen, C.K. (1996) ` Direction, Magnitude and Implications of Non-response Bias in Mail Surveys ', Journal of the Market Research Society 38(3): 267—76 .

Dillman, D.A. (2000) Mail and Internet Surveys: The Tailored Design Method. New York: John Wiley & Sons .

Griffis, S. , Goldsby, T.J. , and Cooper, M.C. (2003) ` Web-Based and Mail Surveys: A Comparison of Response, Data and Cost' , Journal of Business Logistics 24(2): 237—58 .

Hawkins, D.F. (1975) ` Estimation of Nonresponse Bias ', Sociological Methods and Research 3(4): 461—88 .

10.

House, J.S. and Wolf, S. (1978) ` Effects of Urban Residence on Interpersonal Trust and Helping Behavior' , Journal of Personality and Social Psychology 36(9): 1029—43 .

11.

Hult, G.T.M. , Neese, W.T. , and Bashaw, R.E. (1997) ` Faculty Perceptions of Marketing Journals ', Journal of Marketing Education 19(1): 37—52 .

12.

Johnson, P.O. (1959) ` Development of the Sample Survey as a Scientific Methodology ', Journal of Experiential Education 27: 167—76 .

13.

Klemmack, D.L. , Carlson, J.R. , and Edwards, J.N. (1974) ` Measures of Well Being: An Empirical and Critical Assessment ', Journal of Health and Social Behavior 15(3): 267—70 .

14.

Kish, L. (1965) Survey Sampling. New York: John Wiley & Sons .

15.

Li, T. and Calantone, R.J. (1998) ` The Impact of Market Knowledge Competence on New Product Advantage: Conceptualization and Emperical Examinination ', Journal of Marketing 62(4): 13—29 .

16.

Lindner, J.R. , Murphy, T.H. , and Briers, G.E. (2001) ` Handling Nonresponse in Social Science Research', Journal of Agricultural Education 42(4): 43—53 .

17.

Miller, L.E. and Smith, K.L. (1983) ` Handling Nonresponse Issues ', Journal of Extension 21(5): 45—50 .

18.

Morrison, D.F. (1976) Multivariate Statistical Methods (2nd ed.). New York: McGraw-Hill .

19.

Pace, R.C. (1939) ` Factors Influencing Questionnaire Returns from Former University Students ', Journal of Applied Psychology 23(June): 388—97 .

20.

Parker-Pope, T. (2006) ` In Study of Women's Health, Design Flaws Raise Questions ', Wall Street Journal, 28 February: A1 .

21.

Reuss, C.F. (1943) ` Differences between Persons Responding and Not Responding to a Mailed Questionnaire ', American Sociological Review 8(4): 433—8 .

22.

Richardson, A.J. (2000) ` Behavioural Mechanisms of Non-Response in Mailback Travel Surveys' . Paper presented at the 79th Annual Meeting of the Transportation Research Board, Washington, DC, January.

23.

Rossi, P.H. , Waite, E. , Bose, C.E. , and Berk, R.E. (1974) `' The Seriousness of Crimes: Normative Structure and Individual Differences ', American Sociological Review 39(2): 224—37 .

24.

Smith, T.W. (1983) ` The Hidden 25 Percent: An Analysis of Nonresponse on the 1980 General Social Survey' , The Public Opinion Quarterly 47(3): 386—404 .

25.

Stephenson, B.C. (1979) ` Probability Sampling with Quotas: An Experiment ', The Public Opinion Quarterly 43(4): 447—96 .

26.

Vincent, C.P. (1964) ` Socioeconomic Status and Familial Variables in Mail Questionnaire Responses ', American Journal of Sociology 69(6): 647—53 .

27.

Ward, J.C. , Russick, B. , and Rudelius, W. (1985) ` A Test of Reducing Callbacks and Not-at-Home Bias in Personal Interviews by Weighting At-Home Respondents' , Journal of Marketing Research 22(1): 66—73 .

28.

Zinkhan, G.M. (2003) ` A Look to the Future of JAMS: Three Years Out, Thirty Years Out … ', Journal of the Academy of Marketing Science 31(3): 225—8 .