Recent research has shown mixed-mode surveys are advantageous for organizations to use in collecting data. Previous research explored web/mail mode effects for four-contact waves. This study explores the effect of web/mail mixed-mode systems over a series of contacts on the customer satisfaction data from the Florida Cooperative Extension Service during 2012–2013. The experimental design involved a group of clients who provided e-mail and mail contact information randomly assigned to two mixed-mode treatment groups and a mail-only control. Demographic and service utilization data were compared to assess response rates and nonresponse bias. Logistic regression showed the treatment groups had similar response rates and nonresponse bias. The fifth contact was statistically significant in increasing response rates but did not reduce nonresponse bias. Future research should continue exploring optimizing the number of contacts in mixed-mode survey methodology.
BainesA. D.PartinM. R.DavernM.RockwoodT. H.. 2007. Mixed-mode administration reduced bias and enhanced post stratification adjustments in a health behavior survey. Journal of Clinical Epidemiology60:1246–55.
3.
BiemerP. P.ChristS. L.. 2008. Weighting survey data. In International handbook of survey methodology, edited by de LeeuwD.HoxJ. J.DillmanD. D., 317–41. New York: Lawrence Erlbaum.
4.
CookC.HeathF.ThompsonR. L.. 2000. A meta-analysis of response rates in web- or Internet-based surveys. Educational and Psychological Measurement60:821–36.
5.
de BernardoD. H.CurtisA.. 2012. Using online and paper surveys: The effectiveness of mixed-mode methodology for populations over 50. Research on Aging35:220–40.
6.
de LeeuwE. D.2005. To mix or not to mix data collection modes in surveys. Journal of Official Statistics21:233–55.
7.
DillmanD. A.PhelpsG.TortoraR.SwiftK.KohrellJ.BerckJ.MesserB. L.. 2009. Response rate and measurement differences in mixed-mode surveys using mail, telephone, Interactive Voice Response (IVR) and the Internet. Social Science Research38:1–18.
8.
DillmanD. A.SmythJ. D.ChristianL. M.. 2014. Internet, phone, mail, and mixed-mode surveys: The tailored design method, 4th ed. Hoboken, NJ: John Wiley.
9.
DixonJ.2005. Comparison of item and unit nonresponse in household surveys. Washington, DC: Bureau of Labor Statistics. http://www.bls.gov/ore/pdf/st050080.pdf (accessed July 2, 2014).
10.
DykemaJ.StevensonJ.KleinL.KimY.DayB.. 2013. Effects of e-mailed versus mailed invitations and incentives on response rates, data quality, and costs in a web survey of university faculty. Social Science Computer Review31:359–70.
11.
FanW.YanZ.. 2010. Factors affecting response rates of the web survey: A systematic review. Computers in Human Behavior26:132–39.
12.
GrovesR. M.2006. Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly70:646–75.
HolmbergA.LorencB.WernerP.. 2010. Contact strategies to improve participation via the web in a mixed-mode mail and web survey. Journal of Official Statistics26:465–80.
15.
IsraelG. D.2010. Using web-hosted surveys to obtain responses from extension clients: A cautionary tale. Journal of Extension48:4. http://www.joe.org/joe/2010august/a8.php (accessed June 16, 2014).
16.
IsraelG. D.2013a. Combining mail and e-mail contacts to facilitate participation in mixed-mode surveys. Social Science Computer Review31:346–58.
17.
IsraelG. D.2013b. Using mixed-mode contacts in client surveys: Getting more bang for your buck. Journal of Extension51:3. http://www.joe.org/joe/2013june/a1.php (accessed June 16, 2014).
LesserV. M.YangD. K.NewtonL. D.. 2011. Assessing hunters’ opinions based on a mail and a mixed-mode survey. Human Dimensions of Wildlife16:164–73.
23.
ManfredaK. L.BosnjakM.BerzelakJ.HaasI.VehovarV.. 2008. Web surveys versus other survey modes. International Journal of Market Research50:79–104.
24.
MasonR.LesserV.TraugottM.. 2002. Effect of item nonresponse on nonresponse error and inference. In Survey nonresponse, edited by GrovesR.DillmanD.EltingeJ.LittleR., 149–62. New York: Wiley.
25.
MedwayR. L.FultonJ.. 2012. When more gets you less: A meta-analysis of the effect of concurrent web options on mail survey response rates. Public Opinion Quarterly76:733–46.
26.
MesserB. L.DillmanD. A.. 2011. Surveying the general public over the Internet using address-based sampling and mail contact procedures. Public Opinion Quarterly75:429–57.
PorterS. R.WhitcombM. E.. 2007. Mixed-mode contacts in web surveys: Paper is not necessary better. Public Opinion Quarterly71:635–48.
31.
Qualtrics. 2015. Qualtrics software, Version Insight Platform. www.qualtrics.com.
32.
SchaferJoseph L.GrahamJohn W.. 2002. Missing data: Our view of the state of the art. Psychological Methods7:147–77.
33.
SeeversB.GrahamD.. 2012. Education through cooperative extension, 3rd ed. Fayetteville: University of Arkansas.
34.
ShihT. H.FanX.. 2008. Comparing response rates from web and mail surveys: A meta-analysis. Field Methods20:249–71.
35.
SmythJ. D.DillmanD. A.ChristianL. M.O’NeillA. C.. 2010. Using the Internet to survey small towns and communities: Limitations and possibilities in the early 21st century. American Behavioral Scientist53:1423–48.
36.
SternMichael J.BilgenI.DillmanD. A.. 2014. The state of survey methodology: Challenges, dilemmas, and new frontiers in the era of the tailored design. Field Methods24:284–301.
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
