Effects of Incentives and Prenotification on Response Rates and Costs in a National Web Survey of Physicians

Abstract

Little is known about what strategies are cost-effective in increasing participation among physicians in surveys that are conducted exclusively via the web. To assess the effects of incentives and prenotification on response rates and costs, general internists (N = 3,550) were randomly selected from the American Medical Association (AMA) Masterfile and assigned to experimental groups that varied in the amount of a promised incentive (none, entry into a $200 lottery, $50, or $100) and prenotification (none, prenotification letter only, or prenotification letter containing a $2 preincentive). Results indicated that the response rates were highest in the groups promised $100 and $50, respectively. While the postal prenotification letter increased response rates, the inclusion of a small token $2 preincentive had no effect on participation. Further, unlike mail surveys of physicians, the $2 preincentive was not cost-effective. Among physicians, larger promised incentives of $50 or $100 are more effective than a nominal preincentive in increasing participation in a web-only survey. Consistent with prior research, there was little evidence of nonresponse bias among the experimental groups.

Keywords

physicians response rates web surveys incentives costs

Get full access to this article

View all access options for this article.

References

The American Association for Public Opinion Research. (2011). Standard definitions: Final dispositions of case codes and outcome rates for surveys (7th ed.). AAPOR. Accessed on April 11th, 2011 from http://aapor.org/Content/NavigationMenu/AboutAAPOR/StandardsampEthics/StandardDefinitions/StandardDefinitions2011.pdf).

Asch

D. A.

Christakis

N. A.

Ubel

P. A.

(1998). Conducting physician mail surveys on a limited budget: A randomized trail comparing $2 bill versus $5 bill incentives. Medical Care, 36, 95–99.

Asch

D. A.

Jedrziewski

M. K.

Christakis

N. A.

(1997). Response rates to mail surveys published in medical journals. Journal of Clinical Epidemiology, 50, 1129–1136.

Beebe

T. J.

Locke

G. R.

Barnes

S. A.

Davern

M. E.

Anderson

K. J.

(2007). Mixing web and mail methods in a survey of physicians. Health Services Research, 42, 1219–1234.

Braithwaite

Emery

de Lusignan

Sutton

(2003). Using the Internet to conduct surveys of health professionals: A valid alternative?. Family Practice, 20, 545–551.

Couper

M. P.

(2008). . In Designing effective web surveys Cambridge: Cambridge University Press.

Flanigan

T. S.

McFarlane

Cook

(2008). Conducting survey research among physicians and other medical professionals: A review of current literature. ASA Proceedings of the Section on Survey Research Methods, 4136–4147.

Golnik

Ireland

Borowsky

I. W.

(2009). Medical homes for children with autism: A physician survey. Pediatrics, 123, 966–971.

Keating

N. L.

Zaslavsky

A. M.

Goldstein

West

D. W.

Ayanian

J. Z.

(2008). Randomized trial of $20 versus $50 incentives to increase physician survey response rates. Medical Care, 46, 878–881.

10.

Kellerman

S. E.

Herold

(2001). Physician response to surveys: A review of the literature. American Journal of Preventive Medicine, 20, 61–67.

11.

Long

J. S.

Freese

(2006). In Regression models for categorical dependent variables using Stata 2nd ed. College Station, TX: Stata Press.

12.

Malin

J. L.

Rideout

Ganz

P. A.

(2000). Tracking managed care: The importance of a cash incentive for medical director response to a survey. American Journal of Managed Care, 6, 1209–1214.

13.

McLean

S. A.

Feldman

J. A.

(2001). The impact of changes in HCFA documentation requirements on academic emergency medicine: Results of a physician survey. Academic Emergency Medicine, 8, 880–885.

14.

McMahon

S. R.

Iwamoto

Massoudi

M. S.

Yusuf

H. R.

Stevenson

J. M.

Chu

S. Y.

Pickering

L. K.

(2003). Comparison of e-mail, fax, and postal surveys of pediatricians. Pediatrics, 111, e299–e303.

15.

Peugh

Sirovich

Applebaum

(2010, May). Getting a physician's attention: Results of an upfront incentive mail survey experiment. In Paper presented at the American Association for Public Opinion Research, Hollywood, FL.

16.

Potts

H. W. W.

Wyatt

J. C.

(2002). Survey of doctors' experience of patients using the Internet. Journal of Medical Internet Research, 4, e5.

17.

Rodriguez

H. P.

von Glahn

Rogers

W. H.

Chang

Fanjiang

Safran

D. G.

(2006). Evaluating patients' experiences with individual physicians: A randomized trial of mail, internet, and interactive voice response telephone administration of surveys. Medical Care, 44, 167–174.

18.

Schleyer

T. K. L.

Forrest

J. L.

(2000). Methods for the design and administration of web-based surveys. Journal of the American Medical Informatics Association, 7, 416–425.

19.

VanGeest

J. B.

Johnson

T. P.

Welch

V. L.

(2007). Methodologies for improving response rates in surveys of physicians: A systematic review. Evaluation & the Health Professions, 30, 303–321.

20.

Yusuf

T. E.

Baron

T. H.

(2006). Endoscopic transmural drainage of pancreatic pseudocysts: Results of a national and an international survey of ASGE members. Gastrointestinal Endoscopy, 63, 223–227.