Sage Journals: Discover world-class research

Abstract

Surveys of health professionals typically have low response rates, which have decreased in recent years. We report on the methods used, participation rates, and study time for 11 national questionnaire studies of dentists conducted from 2014–2022. Participation rates decreased (87%–25%). Concurrent with this decrease was a decrease in the intensity with which the practitioners were recruited. Participation rates were higher when postal mail invitation and paper options were used (84% vs. 58%, p < .001). Completion rates were nearly twice as high in studies that recruited in waves than those that did not (61% vs. 35%, p = .003). Study time varied from 2.6 to 28.4 weeks. Study time was longest when postal mail and completion on paper were used (26.0 vs. 11.3 weeks, p = .01). Among studies using only online methods, study time was longer when invitations were staggered than when all invitations went out in one bolus (means 12.0 and 5.2, p = .04). Study time was positively correlated with participation rates (Spearman r = .80, p = .005). General dentists participated at an average of 12% higher rates than specialists. Recruitment methodology, such as recruiting in waves or stages, should be considered when designing surveys.

Keywords

survey methods participation rates response rates online surveys health professions

Get full access to this article

View all access options for this article.

References

Abdelazeem

Hamdallah

Rizk

M. A.

Abbas

K. S.

El-Shahat

N. A.

Manasrah

Mostafa

M. R.

Eltobgy

(2023). Does usage of monetary incentive impact the involvement in surveys? A systematic review and meta-analysis of 46 randomized controlled trials. PLoS One, 18(1), Article e0279128. https://doi.org/10.1371/journal.pone.0279128

American Dental Association (ADA) . (2024). Clinical Evaluators (ACE) Panel reports. ADA. https://www.ada.org/resources/research/science-and-research-institute/ada-clinical-evaluators-ace-reports

Asch

D. A.

Jedrziewski

M. K.

Christakis

N. A.

(1997). Response rates to mail surveys published in medical journals. Journal of Clinical Epidemiology, 50(10), 1129–1136. https://doi.org/10.1016/s0895-4356(97)00126-1

Audibert

Glass

Johnson

T. P.

(2020). Method and transparency of online physician surveys: An overview. Survey Methods: Insights From the Field. https://surveyinsights.org/?p=12496DOI:10.13094/SMIF-2020-00001

Barnhart

B. J.

Reddy

S. G.

Arnold

G. K.

(2021). Remind Me again: Physician response to web surveys: The effect of email reminders across 11 opinion survey efforts at the American board of internal medicine from 2017 to 2019. Evaluation & the Health Professions, 44(3), 245–259. https://doi.org/10.1177/01632787211019445

Barnhart

B. J.

Reddy

S. G.

Vandergrift

J. L.

(2023). Which outreach modes improve response rates to physician surveys? Lessons from an experiment at the American board of internal medicine. Evaluation & the Health Professions, 46(1), 48–53. https://doi.org/10.1177/01632787221143151

Beebe

T. J.

Locke

G. R. , 3rd

Barnes

S. A.

Davern

M. E.

Anderson

K. J.

(2007). Mixing web and mail methods in a survey of physicians. Health Services Research, 42(3 Pt 1), 1219–1234. https://doi.org/10.1111/j.1475-6773.2006.00652.x

Bjertnaes

O. A.

Garratt

Botten

(2008). Nonresponse bias and cost-effectiveness in a Norwegian survey of family physicians. Evaluation & the Health Professions, 31(1), 65–80. https://doi.org/10.1177/0163278707311874

Bostick

R. M.

Pirie

Luepker

R. V.

Kofron

P. M.

(1992). Using physician caller follow-ups to improve the response rate to a physician telephone survey:its impact and its implications. Evaluation & the Health Professions, 15(4), 420–433. https://doi.org/10.1177/016327879201500405

10.

Braithwaite

Emery

De Lusignan

Sutton

(2003). Using the internet to conduct surveys of health professionals: A valid alternative? Family Practice, 20(5), 545–551. https://doi.org/10.1093/fampra/cmg509

11.

Brtnikova

Crane

L. A.

Allison

M. A.

Hurley

L. P.

Beaty

B. L.

Kempe

(2018). A method for achieving high response rates in national surveys of U.S. primary care physicians. PLoS One, 13(8), Article e0202755. https://doi.org/10.1371/journal.pone.0202755

12.

Cho

Y. I.

Johnson

T. P.

Vangeest

J. B.

(2013). Enhancing surveys of health care professionals: A meta-analysis of techniques to improve response. Evaluation & the Health Professions, 36(3), 382–407. https://doi.org/10.1177/0163278713496425

13.

Cook

J. V.

Dickinson

H. O.

Eccles

M. P.

(2009). Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study. BMC Health Services Research, 9, 160. https://doi.org/10.1186/1472-6963-9-160

14.

Cull

W. L.

O’Connor

K. G.

Sharp

Tang

S. F.

(2005). Response rates and response bias for 50 surveys of pediatricians. Health Serv Res, 40(1), 213–226. https://doi.org/10.1111/j.1475-6773.2005.00350.x

15.

Cummings

S. M.

Savitz

L. A.

Konrad

T. R.

(2001). Reported response rates to mailed physician questionnaires. Health Serv Res, 35(6), 1347–1355.

16.

de Koning

Egiz

Kotecha

Ciuculete

A. C.

Ooi

S. Z. Y.

Bankole

N. D. A.

Erhabor

Higginbotham

Khan

Dalle

D. U.

Sichimba

Bandyopadhyay

Kanmounye

U. S.

(2021). Survey fatigue during the COVID-19 pandemic: An analysis of neurosurgery survey response rates. Frontiers in surgery, 8, Article 690680. https://doi.org/10.3389/fsurg.2021.690680

17.

Delnevo

C. D.

Abatemarco

D. J.

Steinberg

M. B.

(2004). Physician response rates to a mail survey by specialty and timing of incentive. American Journal of Preventive Medicine, 26(3), 234–236. https://doi.org/10.1016/j.amepre.2003.12.013

18.

Delnevo

C. D.

Singh

(2021). The effect of a web-push survey on physician survey responses rates: A randomized experiment. Survey practice, 14(1), 1–9. https://doi.org/10.29115/sp-2021-0001

19.

Dillman

D. A.

Smyth

J. D.

Christian

L. M.

(2009). Internet, mail and mixed-mode surveys. The tailored design method. John Wiley.

20.

Dykema

Jones

N. R.

Piché

Stevenson

(2013). Surveying clinicians by web: Current issues in design and administration. Evaluation & the Health Professions, 36(3), 352–381. https://doi.org/10.1177/0163278713496630

21.

Dykema

Stevenson

Day

Sellers

S. L.

Bonham

V. L.

(2011). Effects of incentives and prenotification on response rates and costs in a national web survey of physicians. Evaluation & the Health Professions, 34(4), 434–447. https://doi.org/10.1177/0163278711406113

22.

Field

T. S.

Cadoret

C. A.

Brown

M. L.

Ford

Greene

S. M.

Hill

Hornbrook

M. C.

Meenan

R. T.

White

M. J.

Zapka

J. M.

(2002). Surveying physicians: Do components of the “total design approach” to optimizing survey response rates apply to physicians? Medical Care, 40(7), 596–605. https://doi.org/10.1097/00005650-200207000-00006

23.

Fiset

Milgrom

Tarnai

(1994). Dentists’ response to financial incentives in a mail survey of malpractice liability experience. Journal of Public Health Dentistry, 54(2), 68–72. https://doi.org/10.1111/j.1752-7325.1994.tb01184.x

24.

Flanigan

McFarlane

Cook

S. K.

(2008). Conducting survey research among physicians and other medical professionals - a review of current literature. American Statistical Association.

25.

Funkhouser

Vellala

Baltuck

Cacciato

Durand

McEdward

Sowell

Theisen

S. E.

Gilbert

G. H.

National Dental PBRN Collaborative Group . (2017). Survey methods to optimize response rate in the national dental practice-based research network. Evaluation & the Health Professions, 40(3), 332–358. https://doi.org/10.1177/0163278715625738

26.

Galea

Tracy

(2007). Participation rates in epidemiologic studies. Annals of Epidemiology, 17(9), 643–653. https://doi.org/10.1016/j.annepidem.2007.03.013

27.

Gilbert

G. H.

Fellows

J. L.

Allareddy

Cochran

D. L.

Cunha-Cruz

Gordan

V. V.

McBurnie

M. A.

Meyerowitz

Mungia

Rindal

D. B.

National Dental PBRN Collaborative Group . (2022). Structure, function, and productivity from the national dental practice-based research network. Journal of clinical and translational science, 6(1), Article e87. https://doi.org/10.1017/cts.2022.421

28.

Gilbert

G. H.

Williams

O. D.

Korelitz

J. J.

Fellows

J. L.

Gordan

V. V.

Makhija

S. K.

Meyerowitz

Oates

T. W.

Rindal

D. B.

Benjamin

P. L.

Foy

P. J.

National Dental PBRN Collaborative Group . (2013). Purpose, structure, and function of the United States national dental practice-based research network. Journal of Dentistry, 41(11), 1051–1059. https://doi.org/10.1016/j.jdent.2013.04.002

29.

Grava-Gubins

Scott

(2008). Effects of various methodologic strategies: Survey response rates among Canadian physicians and physicians-in-training. Canadian family physician Medecin de famille canadien, 54(10), 1424–1430.

30.

Gupta

Ward

D’Este

(1997). Differential effectiveness of telephone prompts by medical and nonmedical staff in increasing survey response rates: A randomised trial. Australian & New Zealand Journal of Public Health, 21(1), 98–99. https://doi.org/10.1111/j.1467-842x.1997.tb01662.x

31.

Hardigan

P. C.

Succar

C. T.

Fleisher

J. M.

(2012). An analysis of response rate and economic costs between mail and web-based surveys among practicing dentists: A randomized trial. Journal of Community Health, 37(2), 383–394. https://doi.org/10.1007/s10900-011-9455-6

32.

Harrap

Taylor

Russell

Scott

(2023). A randomised controlled trial of email versus mailed invitation letter in a national longitudinal survey of physicians. PLoS One, 18(8), Article e0289628. https://doi.org/10.1371/journal.pone.0289628

33.

Jepson

Asch

D. A.

Hershey

J. C.

Ubel

P. A.

(2005). In a mailed physician survey, questionnaire length had a threshold effect on response rate. Journal of Clinical Epidemiology, 58(1), 103–105. https://doi.org/10.1016/j.jclinepi.2004.06.004

34.

Johnson

T. P.

Wislar

J. S.

(2012). Response rates and nonresponse errors in surveys. JAMA, 307(17), 1805–1806. https://doi.org/10.1001/jama.2012.3532

35.

Keating

N. L.

Zaslavsky

A. M.

Goldstein

West

D. W.

Ayanian

J. Z.

(2008). Randomized trial of $20 versus $50 incentives to increase physician survey response rates. Medical Care, 46(8), 878–881. https://doi.org/10.1097/MLR.0b013e318178eb1d

36.

Kellerman

S. E.

Herold

(2001). Physician response to surveys. A review of the literature. American Journal of Preventive Medicine, 20(1), 61–67. https://doi.org/10.1016/s0749-3797(00)00258-0

37.

Klabunde

C. N.

Willis

G. B.

McLeod

C. C.

Dillman

D. A.

Johnson

T. P.

Greene

S. M.

Brown

M. L.

(2012). Improving the quality of surveys of physicians and medical groups: A research agenda. Evaluation & the Health Professions, 35(4), 477–506. https://doi.org/10.1177/0163278712458283

38.

Krieger

LeBlanc

Waterman

P. D.

Reisner

S. L.

Testa

Chen

J. T.

(2023). Decreasing survey response rates in the time of COVID-19: Implications for analyses of population health and health inequities. American Journal of Public Health, 113(6), 667–670. https://doi.org/10.2105/ajph.2023.307267

39.

Leung

G. M.

L. M.

Chan

M. F.

M Johnston

J. M.

Wong

F. K.

(2002). The effects of cash and lottery incentives on mailed surveys to physicians: A randomized trial. Journal of Clinical Epidemiology, 55(8), 801–807. https://doi.org/10.1016/s0895-4356(02)00442-0

40.

Makhija

S. K.

Gilbert

G. H.

Rindal

D. B.

Benjamin

P. L.

Richman

J. S.

Pihlstrom

D. J.

DPBRN Collaborative Group . (2009). Dentists in practice-based research networks have much in common with dentists at large: Evidence from the dental practice-based research network. General Dentistry, 57(3), 270–275. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2819020/pdf/nihms168942.pdf

41.

Martins

Lederman

R. I.

Lowenstein

C. L.

Joffe

Neville

B. A.

Hastings

B. T.

Abel

G. A.

(2012). Increasing response rates from physicians in oncology research: A structured literature review and data from a recent physician survey. British Journal of Cancer, 106(6), 1021–1026. https://doi.org/10.1038/bjc.2012.28

42.

McCauley

J. L.

Leite

R. S.

Gordan

V. V.

Fillingim

R. B.

Gilbert

G. H.

Meyerowitz

Cochran

Rindal

D. B.

Brady

K. T.

National Dental Practice-Based Research Network Collaborative Group . (2018). Opioid prescribing and risk mitigation implementation in the management of acute pain: Results from the National Dental Practice-Based Research Network. Journal of the American Dental Association (1939), 149(5), 353–362. https://doi.org/10.1016/j.adaj.2017.11.031

43.

McCracken

M. S.

Louis

D. R.

Litaker

M. S.

Minyé

H. M.

Mungia

Gordan

V. V.

Marshall

D. G.

Gilbert

G. H.

National Dental Practice-Based Research Network Collaborative Group . (2016). Treatment recommendations for single-unit crowns: Findings from the national dental practice-based research network. Journal of the American Dental Association (1939), 147(11), 882–890. https://doi.org/10.1016/j.adaj.2016.06.012

44.

McFarlane

Olmsted

M. G.

Murphy

Hill

C. A.

(2007). Nonresponse bias in a mail survey of physicians. Evaluation & the Health Professions, 30(2), 170–185. https://doi.org/10.1177/0163278707300632

45.

McKernan

S. C.

Reynolds

J. C.

McInroy

Damiano

P. C.

(2022). Randomized experiment on the effect of incentives and mailing strategy on response rates in a mail survey of dentists. Journal of Public Health Dentistry, 82(4), 484–490. https://doi.org/10.1111/jphd.12510

46.

McLeod

C. C.

Klabunde

C. N.

Willis

G. B.

Stark

(2013). Health care provider surveys in the United States, 2000-2010: A review. Evaluation & the Health Professions, 36(1), 106–126. https://doi.org/10.1177/0163278712474001

47.

Melkers

Hicks

Isett

K. R.

Kopycka-Kedzierawski

D. T.

Gilbert

G. H.

Rosenblum

Burton

Mungia

Melkers

M. J.

Ford

National Dental PBRN Collaborative Group . (2019). Preferences for peer-reviewed versus other publication sources: A survey of general dentists in the national dental PBRN. Implementation Science: IS, 14(1), 19. https://doi.org/10.1186/s13012-019-0854-x

48.

Menachemi

Hikmet

Stutzman

Brooks

R. G.

(2006). Investigating response bias in an information technology survey of physicians. Journal of Medical Systems, 30(4), 277–282. https://doi.org/10.1007/s10916-005-9009-5

49.

Mungia

Funkhouser

Buchberg Trejo

M. K.

Cohen

Reyes

S. C.

Cochran

D. L.

Makhija

S. K.

Meyerowitz

Rindal

B. D.

Gordan

V. V.

Fellows

J. L.

McCargar

J. D.

McMahon

P. A.

Gilbert

G. H.

National Dental PBRN Collaborative & Group . (2018). Practitioner participation in national dental practice-based research network (PBRN) studies: 12-Year results. The Journal of the American Board of Family Medicine: JABFM, 31(6), 844–856. https://doi.org/10.3122/jabfm.2018.06.180019

50.

Nakai

Milgrom

Yoshida

Ishihara

Shimono

(2005). Evaluation of the total design method in a survey of Japanese dentists. BMC Medical Research Methodology, 5, 27. https://doi.org/10.1186/1471-2288-5-27

51.

Osborn

Ward

Boyle

(1996). Effectiveness of telephone prompts when surveying general practitioners: A randomised trial. Australian Family Physician, 25(Suppl 1), S41–S43.

52.

Pit

S. W.

Pyakurel

(2014). The effectiveness of recruitment strategies on general practitioner’s survey response rates - a systematic review. BMC Medical Research Methodology, 14(1), 76. https://doi.org/10.1186/1471-2288-14-76

53.

Rogelberg

Stanton

(2007). Introduction: Understanding and dealing with organizational survey nonresponse. Organizational Research Methods, 10(2), 195–209. https://doi.org/10.1177/1094428106294693

54.

Sammut

Griscti

Norman

I. J.

(2021). Strategies to improve response rates to web surveys: A literature review. International Journal of Nursing Studies, 123(1), Article 104058. https://doi.org/10.1016/j.ijnurstu.2021.104058

55.

Sathian

Asim

Banerjee

Pizarro

A. B.

Roy

van Teijlingen

E. R.

do Nascimento

I. J. B.

Alhamad

H. K.

(2020). Impact of COVID-19 on clinical trials and clinical research: A systematic review. Nepal Journal of Epidemiology, 10(3), 878–887. https://doi.org/10.3126/nje.v10i3.31622

56.

Schleyer

T. K.

Forrest

J. L.

(2000). Methods for the design and administration of web-based surveys. Journal of the American Medical Informatics Association: JAMIA, 7(4), 416–425. https://doi.org/10.1136/jamia.2000.0070416

57.

Schoenman

J. A.

Berk

M. L.

Feldman

J. J.

Singer

(2003). Impact of differential response rates on the quality of data collected in the CTS physician survey. Evaluation & the Health Professions, 26(1), 23–42. https://doi.org/10.1177/0163278702250077

58.

Scott

Jeon

S. H.

Joyce

C. M.

Humphreys

J. S.

Kalb

Witt

Leahy

(2011). A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors. BMC Medical Research Methodology, 11(1), 126. https://doi.org/10.1186/1471-2288-11-126

59.

Stedman

Connelly

Heberlein

Decker

D. J.

Allred

S. B.

(2019). The end of the (research) world as we know it? Understanding and coping with declining response rates to mail surveys. Society & Natural Resources, 32(10), 1139–1154. https://doi.org/10.1080/08941920.2019.1587127

60.

Sudman

(1985). Mail surveys of reluctant professionals. Evaluation Review, 9(3), 349–360. https://doi.org/10.1177/0193841X8500900306

61.

Taylor

Scott

(2019). Do physicians prefer to complete online or mail surveys? Findings from a national longitudinal survey. Evaluation & the Health Professions, 42(1), 41–70. https://doi.org/10.1177/0163278718807744

62.

Toledo

Aerny

Soldevila

Baricot

Godoy

Castilla

García-Gutierrez

Torner

Astray

Mayoral

J. M.

Tamames

González-Candelas

Martín

Díaz

Domíguez

CIBERESP Working Group for the Survey on Influenza Vaccination in Primary Health Care Workers . (2015). Managing an online survey about influenza vaccination in primary healthcare workers. International Journal of Environmental Research and Public Health, 12(1), 541–553. https://doi.org/10.3390/ijerph120100541

63.

VanGeest

J. B.

Johnson

T. P.

Welch

V. L.

(2007). Methodologies for improving response rates in surveys of physicians: A systematic review. Evaluation & the Health Professions, 30(4), 303–321. https://doi.org/10.1177/0163278707307899

64.

Ward

Wain

(1994). Increasing response rates of gynaecologists to a survey: a randomised trial of telephone prompts. Aust J Public Health, 18(3), 332–334. https://doi.org/10.1111/j.1753-6405.1994.tb00254.x

65.

Wiant

Geisen

Creel

Willis

Freedman

de Moor

Klabunde

(2018). Risks and rewards of using prepaid vs. postpaid incentive checks on a survey of physicians. BMC Med Res Methodol, 18(1), 104. https://doi.org/10.1186/s12874-018-0565-z

66.

Wilson

P. M.

Petticrew

Calnan

Nazareth

(2010). Effects of a financial incentive on health researchers’ response to an online survey: a randomized controlled trial. J Med Internet Res, 12(2), e13. https://doi.org/10.2196/jmir.1251

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.15 MB

Participation Rates in 11 National Dental Practice-Based Research Network Surveys 2014-2022

Abstract

Keywords

Get full access to this article

References

Supplementary Material