Low response rates are a common problem in surveys of family physicians leading to uncertainty about the validity of results. In this study, the authors examined the association between multiple reminders and nonresponse bias, survey estimates and costs in a survey of family physicians in Norway (N = 3,463). After three postal reminders and one telephone follow-up, the response rate was 65.9%. They analyzed differences in nine demographic and practice variables between respondents and nonrespondents, the effect of nonresponse bias on survey estimates, and the cost-effectiveness of each reminder. Statistically significant differences between respondents and nonrespondents were found for six variables. However, demographic and practice variables had little association with the main outcome variables, and the overall survey estimates changed little with additional reminders. In addition, the cost-effectiveness of the final reminders was poor.
Barclay, S., Todd, C., Finlay, I., Grande, G., & Wyatt, P. (2002). Not another questionnaire! Maximizing the response rate, predicting non-response and assessing non-response bias in postal questionnaires studies of GPs. Family Practice, 19, 105-111.
2.
Beebe, T.J., Locke, G.R., III, Barnes, S.A., Davern, M.E., & Anderson, K.J. (2007). Mixing web and mail methods in a survey of physicians. Health Services Research, 42, 1219-1234.
3.
Bergk, V., Gasse, C., Schnell, R., & Haefeli, W.E. (2005). Mail surveys: Obsolescent model or valuable instrument in general practice research? Swiss Medical Weekly, 135, 189-191.
4.
Bjertnaes, O.A., Garratt, A., & Nessa, J. (2007). The GPs' experiences questionnaire (GPEQ): Reliability and validity following a national survey to assess GPs' views of district psychiatric services. Family Practice, 24, 336-342.
5.
Brehaut, J.C., Graham, I.D., Visentin, L., & Stiell, I.G. (2006). Print format and sender recognition were related to survey completion rate. Journal of Clinical Epidemiology , 59, 635-641.
6.
Crane, L.A., Daley, M.F., Barrow, J., Babbel, C., Stokley, S., Dickinson, L.M., et al. (2008). Sentinel physician networks as a technique for rapid immunization policy surveys. Evaluation & the Health Professions, 31, xxx-xxx.
7.
Crow, R., Gage, H., Hampson, S., Hart, J., Kimber, A., Storey, L., et al. (2002). The measurement of satisfaction with healthcare: Implications for practice from a systematic review of the literature. Health Technology Assessment, 6, 1-250.
8.
Dillman, D.A. (1999). Mail and Internet surveys: The tailored design method. New York: John Wiley.
9.
Dommerud, T. (2003, December 2004). Fikk penger i svarpremie [Received money for responding]. Dagens Medisin. Retrieved August 18, 2007, from http://www.dagensmedisin.no/nyheter/2003/12/04/fikk-penger-i-svarpremie/
10.
Edwards, P., Roberts, I., Clarke, M., DiGuiseppi, C., Pratap, S., Wentz, R., et al. (2002). Increasing response rates to postal questionnaires: Systematic review. British Medical Journal, 324, 1183-1185.
11.
Field, T.S., Cadoret, C.A., & Brown, M.L. (2002). Surveying physicians: Do components of the “Total Design Approach” to optimizing survey response rate apply to physicians ? Medical Care, 40, 596-606.
12.
Guadagnoli, E., & Cunningham, S. (1989). The effects of nonresponse and late response on a survey of physician attitudes. Evaluation & the Health Professions, 12, 318-328.
13.
Hocking, J.S., Lim, M.S.C., Read, T., & Hellard, M. (2006). Postal surveys of physicians gave superior response rates over telephone interviews in a randomized trial. Journal of Clinical Epidemiology, 59, 521-524.
14.
Holte, T.O., Groven, G., Iversen, H., Bjertnaes, O.A., & Garratt, A. (2006). General practitioner's assessment of quality at the community mental health clinics: Development of questionnaire and data collection methods. (Report No. 7-2006). Oslo, Norway: Norwegian Knowledge Centre for the Health services.
15.
Jepson, C., Asch, D.A., Hershey, J.C., & Ubel, P.A. (2005). In a mailed physician survey, questionnaire length had a threshold effect on response rate. Journal ofClinical Epidemiology, 58, 103-105.
16.
Kaner, E.F., Haighton, C.A., & McAvoy, B.R. (1998). “So much post, so busy with practice— so, no time!”: A telephone survey of general practitioners' reasons for not participating in postal questionnaire surveysBritish Journal of General Practice, 48, 1067-1069.
17.
Kasprzyk, D., Montano, D.E., St. Lawrence,J.S., & Phillips, W.R. (2001). The effects of variations in mode of delivery and monetary incentives on physicians responses to a mailed survey assessing STD practice patternsEvaluation & the Health Professions, 24, 3-17.
18.
Kellerman, S.E., & Herold, J. (2001). Physician response to surveys: A review of the literature. American Journal of Preventive Medicine, 20, 61-67.
19.
Kvaerner, K.J. (2005). General practitioners' views on the cooperation with nursing homes. Tidsskrift for Den Norske Laegeforening , 125, 1016-1017.
20.
Leung, G.M., Johnston, J.M., Saing, H., Tin, K.Y.K., Wong, I.O.L., & Ho, L.-M. (2004). Prepayment was superior to postpayment cash incentives in a randomized postal survey among physicians. Journal of Clinical Epidemiology, 57, 777-784.
21.
McColl, E., Jacoby, A., Thomas, L., Soutter, J., Bamford, C., Steen, N., et al. (2001). Design and use of questionnaires: A review of best practice applicable to surveys of health service staff and patients . Health Technology Assessment, 5, 1-256.
22.
McFarlane, E., Olmsted, M.G., Murphy, J., & Hill, C.A. (2007). Nonresponse bias in a mail survey of physicians . Evaluation & the Health Professions, 30, 170.
23.
Sibbald, B., Addington-Hall, J., Brenneman, D., & Freeling, P. (1994). Telephone versus postal surveys of general practitioners: Methodological considerationsBritish Journal of General Practice , 44, 297-300.
24.
Sobal, J., & Ferentz, K.S. (1989). Comparing physicians responses to the first and second mailings of a questionnaire. Evaluation & the Health Professions, 12, 329-339.
25.
Statistics Norway. (1994). Standard classification of municipalities 1994 (Official Statistics of Norway No. C192) . Oslo/Kongsvinger, Norway: Author.
26.
Templeton, L., Deehan, A., Taylor, C., Drummond, C., & Strang, J. (1997). Surveying general practitioners: Does a low response rate matter? British Journal of General Practice, 47, 91-94.
