To increase the validity and reliability of survey data, one must minimize total error and its components, sampling and nonsampling error. This article examines and empirically compares the components of total survey error for several research designs and data collection methods. The consistent finding is that nonsampling error is the major contributor to total survey error, while random sampling error is minimal. On this basis guidelines for improving quality of survey data are provided.
Get full access to this article
View all access options for this article.
References
1.
AndersonRonald, KasperJudith, and FrankelMartin R. (1977), “Total Survey Error: Bias and Random Error in Health Survey Estimates,” prepublication manuscript, The University of Chicago.
2.
ArmstrongJ. Scott, and OvertonTerry S. (1977), “Estimating Nonresponse Bias in Mail Surveys,”Journal of Marketing Research, 14 (August), 396–402.
3.
BradburnNorman M., SudmanSeymour and Associates (1979), Improving Interview Method & Questionnaire Design: Response Effects to Threatening Questions in Survey Research, San Francisco: Jossey-Bass.
4.
BrownRex V. (1967), “Evaluation of Total Survey Error,”Journal of Marketing Research, 4 (May), 117–27.
5.
CannellCharles F., OksenbergLouis, and ConverseJean M. (1977), “Striving for Response Accuracy: Experiments in New Interviewing Techniques,”Journal of Marketing Research, 14 (August), 306–15.
6.
DillmanDon (1978), Mail & Telephone Survey: The Total Design Method, New York: Wiley.
7.
DutkaSoloman, and FrankelLester R. (1976), Let's Not Forget About Response Error, Modern Marketing Series No. 12, New York: Audits & Surveys, Inc.
8.
FerberRobert (1953), “On the Reliability of Response Secured in Sample Surveys,”Journal of the American Statistical Association, 50 (September), 788–810.
9.
FilionF. L. (1975–76), “Estimating Bias Due to Nonresponse in Mail Surveys,”Public Opinion Quarterly, 39 (Winter), 482–492.
10.
FordNeil M. (1967), “The Advance Letter in Mail Surveys,”Journal of Marketing Research, 4 (May), 202–204.
11.
FordNeil M. (1968), “Questionnaire Appearance and Response Rates in Mail Surveys,”Journal of Advertising Research, 8 (September), 43–45.
12.
FrankelMartin R., and FrankelLester R. (1977), “Some Recent Developments in Sample Survey Design,”Journal of Marketing Research, 14 (August), 280–293.
13.
HoustonMichael J., and FordNeil M. (1976), “Broadening the Scope of Methodological Research on Mail Surveys,”Journal of Marketing Research, 13 (November), 397–403.
14.
HoustonMichael J., and JeffersonR. W. (1975), “The Negative Effects of Personalization Patterns in Mail Surveys,”Journal of Marketing Research, 12 (February), 114–117.
15.
HoustonMichael J., and NevinJohn (1977), “The Effects of Source and Appeal on Mail Survey Response Patterns,”Journal of Marketing Research, 14 (August), 374–378.
16.
KanukLeslie, and BerensonConrad (1975), “Mail Surveys and Response Rates: A Literature Review,”Journal of Marketing Research, 12 (November), 440–453.
17.
KeonJohn (1980), “Measuring Total Survey Error: An Unbiased Estimate,” working paper, Frontiers in Marketing Series, New York University.
18.
LansingJohn B., GinsburgGerald P., and BraatenKaisa (1961), “An Investigation of Response Error,”Studies in Consumer Finances #2, Bureau of Economic and Business Research, University of Illinois.
19.
LeslieLarry (1972), “Are High Response Rates Essential to Valid Surveys?”Social Science Research, 1 (September), 323–334.
20.
MetzJoseph F. (1956), “Accuracy of Response Obtained in a Milk Consumption Study,” Paper #5, Methods of Research in Marketing, Cornell University, Agricultural Experiment Station.
21.
NeterJohn, and WaksbergJoseph (1965), Response Errors in Collection of Expenditures by Household Interviews: An Experimental Study, Bureau of the Census, Technical Paper No. 11, Washington, DC: U.S. Government Printing Office.
22.
NevinJohn R., and FordNeil M. (1976), “Effects of a Deadline and a Veiled Threat on Mail Survey Response,”Journal of Applied Psychology, 61 (February), 116–118.
23.
OgnibenePeter (1971), “Correcting Nonresponse Bias in Mail Questionnaires,”Journal of Marketing Research, 8 (May), 233–5.
24.
PaceRobert (1939), “Factors Influencing Questionnaire Returns from Former University Students,”Journal of Applied Psychology, 23 (June), 388–397.
25.
RajDes (1968), Sampling Theory, New York: McGraw-Hill Book Company.
26.
SudmanSeymour, and BradburnNorman M. (1974), Response Effects in Surveys, Chicago: Aldine Publishing.
27.
VeigaJohn F. (1974), “Getting the Mail Questionnaire Returned: Some Practical Research Considerations,”Journal of Applied Psychology, 59 (April), 217–218.
