Researchers examining the effects of programs, in this case a state-level pharmaceutical
assistance program for the elderly, sometimes must rely on multiple methods of data
collection. Two-stage data collection (e.g., a telephone interview followed by a mail
questionnaire) was used to obtain a full range of information. Older age groups were
found to participate less frequently in the telephone interview, while certain demographic
factors characterized mail questionnaire nonparticipants, all of which supports past
research. Results also show that those in the poorest health are less likely to participate in
the mail survey. Combining the two methods did not result in high attrition, suggesting
that innovation can be successfully employed. Knowledge of the bias associated with each
method will aid in targeting special groups.
Get full access to this article
View all access options for this article.
References
1.
Barton, J., C. Bain, C. Hennekens, B. Rosner, C. Belanger, A. Roth, and F.E. Speizer (1980) "Characteristics of respondents and nonrespondents to a mailed questionnaire." Amer. J. of Public Health70 (8): 832-825.
2.
Berk, M.L., G.R. Wilensky, and S.B. Cohen (1984) "Methodological issues in health surveys: an evaluatiuon of procedures used in the National Medical Care Expenditure Survey." Evaluation Rev.8 (3): 307-326.
3.
Bowman, P.J. (1983) "Significant involvement and functional relevance? Challenges to survey research." Social Work Research and Abstracts19 (4): 21-26.
4.
Deaux, E. and Callaghan, J.W. (1984) "Estimating statewide health-risk behavior: a comparison of telephone and key-informant survey approaches." Evaluation Rev.8 (4): 467-492.
5.
De Maio, R.J. (1980) "Refusals: who, where and why." Public Opinion Q.44:223-233.
6.
Dillman, D.A. (1978) Mail and Telephone Surveys: The Total Design Method . New York: John Wiley.
7.
Donald, M. (1960) "Implications of nonresponse for the interpretation of mail questionnaire data." Public Opinion Q.24: 99-114.
8.
Dunkleberg, W.C. and Day, G.S. (1973) "Nonresponse bias and callbacks in sample surveys ." J. of Marketing Research10: 160-168.
9.
Ferber, R. [ed.] (1978) Readings in Survey Research. Chicago: American Marketing Association.
10.
Frey, J.H. (1983) Survey Research by Telephone. Beverly Hills, CA: Sage.
11.
Gershen, J.A. and C.P. McCreary (1983) "Personality comparisons of responders and nonresponders to a mailed personality inventory." Psych. Reports52: 555-562.
12.
Goudy, W.J. (1976) "Nonresponse effects on relationships between variables ." Public Opinion Q.40: 360-369.
13.
Goudy, W.J. (1978) "Interim response to a mail questionnaire: impacts on variable relationships." Soc. Q.19 (Spring): 253-265.
14.
Hammitt, W.E. and C.D. McDonald (1982) "Response bias and the need for extension mail questionnaire follow-ups among selected recreation samples." J. of Leisure Research14 (3): 207-216.
15.
Heberlein, R.A. and R. Baumgartner (1978) "Factors affecting response rates to mailed questionnaires: a quantitative analysis of the published literature." Amer. Soc. Rev.43 (August): 447-462.
16.
Herzog, A.R., W.L. Rodgers, and R.A. Kulka (1983) "Interviewing older adults: a comparison of telephone and face-to-face modalities." Public Opinion Q.47: 405-418.
17.
Hirst, E. and R. Goeltz (1984) "Testing for nonresponse bias: evaluation of utility energy conservation programs." Evaluation Rev.8 (2): 269-278.
18.
Jobber, D. (1984) "Response bias in mail surveys: further evidence ." Psych. Reports54: 891-894.
19.
Kanuk, L. and C. Berenson (1978) "Mail surveys and response rates: a literature review," in R. Ferber (ed.) Readings in Survey Research. Chicago: American Marketing Association.
20.
Lockhart, D. C. [Ed.] (1984) Making Effective Use of Mailed Questionnaires. San Francisco : Jossey-Bass.
21.
Mark, M.M. and J.J. Romano (1982) "The freshman seminar program: experimental evaluation of an introduction to the liberal arts." Evaluation Rev.6 (6): 801-810.
22.
Nederhof, A.J. (1982) "Effects of preliminary contacts on volunteering in mail surveys." Perceptual and Motor Skills54: 1333-1334.
23.
O'Neil, M.J. (1979) "Estimating the nonresponse bias due to refusals in telephone surveys." Public Opinion Q.43: 218-232.
24.
Pavalko, R.M. and K.G. Lutterman (1973) "Characteristics of willing and reluctant respondents ." Pacific Soc. Rev.16 (4): 463-476.
25.
Rosenthal, R. and R.L. Rosnow (1975) The Volunteer Subject. New York : John Wiley.
26.
Saul, J. and M.G. Kushler (1983) Examining nonresponse bias in energy conservation payment evaluation. Presented at the 1983 Joint Meeting of the Evaluation Network and the Evaluation Research Society, October, Chicago.
27.
Sirles, E. (1984) "Who responds to follow-up studies?" Evaluation Rev.65 (6): 354-356.
28.
Smith, T.W. (1983) "The hidden 25 percent: analysis of nonresponse on the 1980 general social survey." Public Opinion Q.47: 386-404.
29.
Snow, R.E. (1986) "Program evaluation using a follow-up telephone survey: the effects of a prior letter." Evaluation Rev.10 (1): 85-94.
30.
Sosdian, C.P. and L.M. Sharp (1980) "Nonresponse in mail surveys: access failure or respondent resistance." Public Opinion Q.44: 396-402.
31.
Steeh, C.G. (1981) "Trends in nonresponse rates, 1952-1979." Public Opinion Q.45: 40-57.
32.
Stummpf, S.A. and H. Bedrosian (1980) "Response characteristics in a mail survey." Psych. Reports46: 863-869.
33.
Sudman, S. (1985) "Mail surveys of reluctant professionals." Evaluation Rev.9 (3): 349-360.
34.
Wellman, J.D., E.G. Hawk, J.W. Roggenbuck, and G.J. Buryoff (1980) "Mailed questionnaire surveys and the reluctant respondent: an empirical examination of differences between early and late respondents." J. of Leisure Research12: 164-172.
35.
Wiseman, F. and P. McDonald (1979) "Noncontact and refusal rates in consumer telephone surveys." J. of Marketing Research16 (November): 478-484.
