Enhancing Surveys of Health Care Professionals

Abstract

Surveys involving health care providers are characterized by low and declining response rates (RRs), and researchers have utilized various strategies to increase survey RRs among health professionals. Based on 48 studies with 156 subgroups of within-study conditions, a multilevel meta-regression analysis was conducted to summarize the effects of different strategies employed in surveys of health professionals. An estimated overall survey RR among health professionals was 0.53 with a significant downward trend during the last half century. Of the variables that were examined, mode of data collection, incentives, and number of follow-up attempts were all found to be significantly related to RR. The mail survey mode was more effective in improving RR, compared to the online or web survey mode. Relative to the non-incentive subgroups, subgroups receiving monetary incentives were more likely to respond, while nonmonetary incentive groups were not significantly different from non-incentive groups. When number of follow-ups was considered, the one or two attempts of follow-up were found to be effective in increasing survey RR among health professionals. Having noted challenges associated with surveying health professionals, researchers must make every effort to improve access to their target population by implementing appropriate incentive- and design-based strategies demonstrated to improve participation rates.

Keywords

health professionals survey response rates research methods meta-analysis

Get full access to this article

View all access options for this article.

References

Akl

E. A.

Maroun

Klocke

R. A.

Montori

Schunemann

H. J.

(2005). Electronic mail was not better than postal mail for surveying residents and faculty. Journal of Clinical Epidemiology, 58, 425–429.

Asch

D. A.

(1996). Use of a coded postcard to maintain anonymity in a highly sensitive mail survey: Cost, response rates, and bias. Epidemiology, 7, 550–551.

Asch

D. A.

Christakis

N. A.

(1994). Different response rates in a trial of two envelop styles in mail survey research. Epidemiology, 5, 364–365.

Asch

D. A.

Christakis

N. A.

Ubel

P. A.

(1998). Conducting physician mail surveys on a limited budget: A randomized trial comparing $2 bill versus $5 bill incentives. Medical Care, 36, 95–99.

Asch

D. A.

Jedrziewski

M. K.

Christakis

N. A.

(1997). Response rates to mail surveys published in medical journals. Journal of Clinical Epidemiology, 50, 1129–1136.

Barriball

K. L.

While

A. E.

(1999). Non-response in survey research: A methodological discussion and development of an explanatory model. Journal of Advanced Nursing, 30, 677–686.

Becker

Cookston

Kulberg

(2000). Mailed survey follow-ups—Are postcard reminders more cost-effective than second questionnaires? Western Journal of Nursing Research, 22, 642–647.

Beebe

T. J.

Locke

III Barnes

S. A.

Davern

M. E.

Anderson

K. J.

(2007). Mixing web and mail methods in a survey of physicians. Health Services Research, 42, 1219–1234.

Berk

M. L.

(1985). Interviewing physicians: The effect of improved response rate. American Journal of Public Health, 75, 1338–1340.

10.

Berry

S. H.

Kanouse

D. E.

(1987). Physician response to a mailed survey: An experiment in timing of payment. Public Opinion Quarterly, 51, 102–114.

11.

Bhandari

Devereaux

P. J.

Swiontkowski

M. F.

Schemitsch

E. H.

Shankardass

Sprague

Guyatt

G. H.

(2003). A randomized trial of opinion leader endorsement in a survey of orthopaedic surgeons: Effect on primary response rate. International Journal of Epidemiology, 32, 634–636.

12.

Bonevski

Magin

Horton

Foster

Girgis

(2011). Response rates in GP surveys: Trialling two recruitment strategies. Australian Family Physician, 40, 427–430.

13.

Bostick

R. M.

Pirie

Luepker

R. V.

Kofron

P. M.

(1992). Using physician caller follow-ups to improve the response rate to a physician telephone survey: Its impact and implications. Evaluation and the Health Professions, 15, 420–433.

14.

Burns

K. E. A.

Duffett

Kho

M. E.

Meade

M. O.

Adhikari

N. K. J.

Sinuff

Cook

D. J.

(2008). A guide for the design and conduct of self-administered surveys of clinicians. Canadian Medical Association Journal, 179, 245–252.

15.

Camuňas

Alward

R. R.

Vecchione

(1990). Survey response rates to a professional association mail questionnaire. Journal of the New York State Nurses Association, 21, 7–9.

16.

Cartwright

Ward

A. W.

(1968). Variations in general practitioners’ response to postal questionnaires. British Journal of Preventive and Social Medicine, 22, 199–205.

17.

Cook

J. V.

Dickinson

H. O.

Eccles

M. P.

(2009). Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study. BMC Health Services Research, 9, 160.

18.

Cull

W. L.

O’Connor

K. G.

Sharp

Tang

S. S.

(2005). Response rates and response bias for 50 surveys of pediatricians. Health Services Research, 40, 213–226.

19.

Cummings

S. M.

Savitz

L. A.

Konrad

T. R.

(2001). Reported response rates to mailed physician questionnaires. Health Services Research, 35, 1347–1355.

20.

Curtis

E. A.

Redmond

R. A.

(2009). Survey postal questionnaire: Optimising response and dealing with non-response. Nursing Research, 16, 76–88.

21.

del Valle

Morgenstern

Rogstad

T. L.

Albright

Vickrey

B. G.

(1997). A randomized trial of the impact of certified mail on response rate to a physician survey, and a cost-effectiveness analysis. Evaluation and the Health Professions, 20, 389–406.

22.

Dillman

D. A.

Smyth

J. D.

Christian

L. M.

(2009). Internet, mail and mixed-mode surveys. The tailored design method. Hoboken, NJ: John Wiley.

23.

Donaldson

G. W.

Moinpour

C. M.

Bush

N. E.

Chapko

Jocom

Siadak

M.,

Sullivan

K. M.

(1999). Physician participation in research surveys: A randomized study of inducements to return mailed research questionnaires. Evaluation and the Health Professions, 22, 427–441.

24.

Dykema

Stevenson

Day

Sellers

S. L.

Bonham

V. L.

(2011). Effects of incentives and prenotification on response rates and costs in a national web survey of physicians. Evaluation and the Health Professions, 34, 434–447.

25.

Everett

S. A.

Price

J. H.

Bedell

A. W.

Telljohann

S. K.

(1997). The effect of a monetary incentive in increasing the return rate of a survey to family physicians. Evaluation and the Health Professions, 20, 207–214.

26.

Field

T. S.

Cadoret

C. A.

Brown

M. L.

Ford

Greene

S. M.

Hill

D.,

Zapka

J. M.

(2002). Surveying physicians: Do components of the “Total Design Approach” to optimizing survey response rates apply to physicians? Medical Care, 40, 596–606.

27.

Ford

Bammer

(2009). A research routine to assess bias introduced by low response rates in postal surveys. Nurse Researcher, 17, 44–53.

28.

Gattellari

Ward

J. E.

(2001). Will donations to their learned college increase surgeons’ participation in surveys? A randomized trial. Journal of Clinical Epidemiology, 54, 645–650.

29.

Gore-Felton

Koopman

Bridges

Thoresen

Spiegel

(2002). An example of maximizing survey return rates: Methodological issues for health professionals. Evaluation and the Health Professions, 25, 152–168.

30.

Grava-Gubins

Scott

(2008). Effects of various methodologic strategies: Survey response rates among Canadian physicians and physicians-in-training. Canadian Family Physician, 54, 1424–1430.

31.

Guise

Chambers

Valimaki

Makkonen

(2010). A mixed-mode approach to data collection: Combining web and paper questionnaires to examine nurses’ attitudes to mental illness. Journal of Advanced Nursing, 66, 1623–1632.

32.

Halpern

S. D.

Kohn

Dornbrand-Lo

Metkus

Asch

D. A.

Volpp

K. G.

(2011). Lottery-based versus fixed incentives to increase clinicians’ response to surveys. Health Services Research, 46, 1663–1674.

33.

Halpern

S. D.

Ubel

P. A.

Berlin

J. A.

Asch

D. A.

(2002). Randomized trial of $5 versus $10 monetary incentives, envelope size, and candy to increase physician response rates to mailed questionnaires. Medical Care, 40, 834–839.

34.

Hart

A. M.

Brennan

C. W.

Sym

Larson

(2009). The impact of personalized prenotification on response rates to an electronic survey. Western Journal of Nursing Research, 31, 17–23.

35.

Hawley

K. M.

Cook

J. R.

Jensen-Doss

(2009). Do noncontingent incentives increase survey response rates among mental health providers? A randomized trail comparison. Administration and Policy in Mental Health, 36, 343–348.

36.

Heywood

Mudge

Ring

Sanson-Fisher

(1995). Reducing systematic bias in studies of general practitioners: The use of a medical peer in the recruitment of general practitioners in research. Family Practice, 12, 227–231.

37.

Hill

C. A.

Fahrney

Wheeless

S. C.

Carson

C. P.

(2006). Survey response inducements for registered nurses. Western Journal of Nursing Research, 28, 322–334.

38.

James

K. M.

Ziegenfuss

J. Y.

Tilburt

J. C.

Harris

A. M.

Beebe

T. J.

(2011). Getting physicians to respond: The impact of incentive type and timing on physician survey response rates. Health Services Research, 46, 232–242.

39.

Johnson

T. P.

Wislar

J. S.

(2012). Response rates and nonresponse errors in surveys. Journal of the American Medical Association, 307, 1805–1806.

40.

Kanaan

R. A. A.

Wessely

S. C.

Armstrong

(2010). Differential effects of pre and post-payment on neurologists’ response rates to a postal survey. BMC Neurology, 10, 100.

41.

Keating

N. L.

Zaslavsky

A. M.

Goldstein

West

D. W.

Ayanian

J. Z.

(2008). Randomized trial of $20 versus $50 incentives to increase physician survey response rates. Medical Care, 46, 878–881.

42.

Kellerman

S. E.

Herold

(2001). Physician response to surveys: A review of the literature. American Journal of Preventive Medicine, 20, 61–67.

43.

Kephart

W. M.

Bressler

(1958). Increasing the responses to mail questionnaires. Public Opinion Quarterly, 22, 123–132.

44.

Klabunde

C. N.

Willis

G. B.

McLeod

C. C.

Dillman

D. A.

Johnson

T. P.

Greene

S. M.

Brown

M. L.

(2012). Improving the quality of surveys of physicians and medical groups: A research agenda. Evaluation and the Health Professions, 35, 477–506.

45.

Lusk

Delclos

G. L.

Burau

Drawhorn

D. D.

Aday

L. A.

(2007). Mail versus internet surveys: Determinants of method of response preferences among health professionals. Evaluation and the Health Professions, 30, 186–201.

46.

Malin

J. L.

Rideout

Ganz

P. A.

(2000). Tracking managed care: The importance of a cash incentive for medical director response to a survey. American Journal of Managed Care, 6, 1209–1214.

47.

Martins

Lederman

R. I.

Lowenstein

C. I.

Joffe

Neville

B. A.

Hastings

B. T.

Abel

G. A.

(2012). Increasing response rates from physicians in oncology research: A structured literature review and data from a recent physician survey. British Journal of Cancer, 106, 1021–1026.

48.

Matteson

K. A.

Anderson

B. L.

Pinto

S. B.

Lopes

Schulkin

Clark

M. A.

(2011). Surveying ourselves: Examining the use of a web-based approach for a physician survey. Evaluation and the Health Professions, 34, 448–463.

49.

McLaren

Shelley

(2000). Response rates of Victorian general practitioners to a mailed survey on miscarriage: Randomised trial of a prize and two forms of introduction to the research. Australian and New Zealand Journal of Public Health, 24, 360–364.

50.

McLeod

C. C.

Klabunde

C. N.

Willis

G. B.

Stark

(2013). Health care provider surveys in the United States, 2000-2010: A review. Evaluation and the Health Professions, 36, 106–126.

51.

McFarlane

Olmsted

M. G.

Murphy

Hill

C. A.

(2006). Nonresponse bias in a mail survey of physicians. Paper presented at the Annual Conference of the American Association for Public Opinion Research, Montreal, Canada.

52.

Myerson

(1993). Improving the response rates in primary care research. Some methods used in a survey on stress in general practice since the new contract (1990). Family Practice, 10, 342–346.

53.

Nicholls

Chapman

Shaw

Perkins

Sullivan

M. M.

Crutchfield

Reed

(2011). Increasing response rates in physician surveys: The limited utility of electronic options. Health Services Research, 46, 1675–1682.

54.

Olson

(2006). Survey participation, nonresponse bias, measurement error bias, and total bias. Public Opinion Quarterly, 70, 737–758.

55.

Olson

Schneiderman

Armstrong

R. V.

(1993). Increasing physician survey response rates without biasing survey results. Proceedings of the Section on Survey Research Methods of the American Statistical Association, Alexandria, VA, pp. 1036–1041.

56.

Parsons

J. A.

Warnecke

R. B.

Czaja

R. F.

Barnsley

Kaluzny

(1994). Factors associated with response rates in a national survey of primary care physicians. Evaluation Review, 18, 756–766.

57.

Paul

C. L.

Walsh

R. A.

Tzelepis

(2005). A monetary incentive increases postal survey response rates for pharmacists. Journal of Epidemiology and Community Health, 59, 1099–1101.

58.

Puleo

Zapka

White

M. J.

Mouchawar

Somkin

Taplin

(2002). Caffeine, cajoling, and other strategies to maximize clinician survey response rates. Evaluation and the Health Professions, 25, 169–184.

59.

Raudenbush

S. W.

Bryk

A. S.

(2002). Hierarchical linear models (2nd ed.). Thousand Oaks, CA: Sage.

60.

Raudenbush

S. W.

Bryk

A. S.

Cheong

A. S.

Fai

Y. F.

Congdon

R. T.

du Toit

(2011). HLM 7: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International.

61.

Recklitis

C. J.

Campbell

E. G.

Kutner

J. S.

Bober

S. L.

(2009). Money talks: Non-monetary incentive and Internet administration fail to increase response rates to a physician survey. Journal of Clinical Epidemiology, 62, 224–226.

62.

Scott

Jeon

S. H.

Joyce

C. M.

Humphreys

J. S.

Kalb

Witt

Leahy

(2011). A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors. BMC Medical Research Methodology, 11, 26.

63.

Singer

Couper

M. P.

(2008). Do incentives exert undue influence on survey participation? Experimental evidence. Journal of Empirical Research on Human Research Ethics, 3, 49–56.

64.

Temple-Smith

Mulvey

Doyle

(1998). Maximizing response rates in a survey of general practitioners: Lessons from a Victorian survey on sexually transmissible diseases. Australian Family Physician, 27, S15–S18.

65.

Templeton

Deehan

Taylor

Drummond

Strang

(1997). Surveying general practitioners: Does a low response rate matter? British Journal of General Practice, 47, 91–94.

66.

Thorpe

Ryan

McLean

S. L.

Burt

Stewart

Brown

J. B.

Reid

G. J.

Harris

(2008). How to obtain excellent response rates when surveying physicians. Family Practice, 26, 65–68.

67.

Ulrich

C. M.

Danis

Koziol

Garrett-Mayer

Hubbard

Grady

(2005). Does it pay to play? A randomized trial of prepaid financial incentives and lottery incentives in surveys of nonphysician healthcare professionals. Nursing Research, 54, 178–183.

68.

Ulrich

C. M.

Grady

(2004). Financial incentives and response rates in nursing research. Nursing Research, 53, 73–74.

69.

VanGeest

J. B.

Johnson

T. P.

(2011). Surveying nurses: Identifying strategies to improve participation. Evaluation and the Health Professions, 34, 487–511.

70.

VanGeest

J. B.

Johnson

T. P.

Welch

V. L.

(2007). Methodologies for improving response rates in surveys of physicians: A systematic review. Evaluation and the Health Professions, 30, 303–321.

71.

VanGeest

J. B.

Wynia

M. K.

Cummins

D. S.

Wilson

I. B.

(2001). Effects of different monetary incentives on the return rate of a national survey of physicians. Medical Care, 39, 197–201.

72.

Viera

A. J.

Edwards

(2012). Does an offer for a free on-line continuing medical education (CME) activity increase physician survey response rate? A randomized trial. BMC Research Notes, 5, 129.

73.

VonRiesen

R. D.

(1979). Postcard reminders versus replacement questionnaires and mail survey response rates from a professional population. Journal of Business Research, 7, 1–7.

74.

Wilson

P. M.

Petticrew

Calnan

Nazareth

(2010). Effects of a financial incentive on health researchers’ response to an online survey: A randomized controlled trial. Journal of Medical Internet Research, 12, e13. doi:10.2196/jmir.1251

75.

Ziegenfuss

J. Y.

Burmeister

James

K. M.

Haas

Tilburt

J. C.

Beebe

T. J.

(2012). Getting physicians to open the survey: Little evidence that an envelope teaser increases response rates. BMC Medical Research Methodology, 12, 41. doi:10.1186/1471-2288-12-41