Personalized SMS,Survey Participation and Data quality

Abstract

French

A number of papers have found that personalization of salutations in e-mail communications may lead to higher response rates. Given their widespread use, Short Text Messages (SMS) may also be useful contact modes in surveys. Using experimental data from an online survey on Italian graduates, this work intends to evaluate the impact of personalized SMS salutations on response and measurement error. We find evidence that personalization has a positive impact on response rates and some indication that it may lead to better survey data. Limitations and implications of the study are also discussed.

Keywords

Web Surveys Short Text Messages (SMS)Response Rates Personalization Measurement Error

Get full access to this article

View all access options for this article.

References

Blau

(1964) Exchange and Power in Social Life. New York (NY): Wiley.

Brick

Williams

(2013) Explaining Rising Nonresponse Rates in Cross-sectional Surveys. ANNALS of the American Academy of Political and Social Science 645(1): 36–59.

Dal Grande

Chittleborough

Campostrini

Dollard

Taylor

(2016) Pre-Survey Text Messages (SMS) Improve Participation Rate in an Australian Mobile Telephone Survey - An Experimental Study. PLOS one 11(2).

Dillman

(1978) Mail and Telephone Surveys. The Total Design Method. New York (NY): John Wiley.

Dillman

(2000) Mail and Internet Surveys - The Tailored Design Method (2nd ed.). New York (NY): Wiley.

Dillman

Reips

U-D

Matzat

(2010) Advice in Surveying the General Public over the Internet. International Journal of Internet Science 5(1): 1–4.

Dillman

Smith

Christian

(2014) Internet, Phone, Mail, and Mixed-mode Surveys - The Tailored Design Method (4th ed.). New York (NY): Wiley.

European Commission (2016a) Use of Internet Services by Citizens in the EU. Brussels, European Commission Digital Scoreboard. Available at: https://ec.europa.eu/digital-single-market/en/download-scoreboard-reports (accessed 29 January 2017).

European Commission (2016b) Special Eurobarometer 438. E-Communications and the Digital Single Market. Brussels, European Commission. Available at: http://ec.europa.eu/COMMFrontOffice/publicopinion/index.cfm/Survey/getSurveyDetail/instruments/SPECIAL/surveyKy/2062 (accessed 10 January 2017).

10.

Fowler

(1984) Survey Research Methods. Newbury Park (CA): Sage Publications.

11.

Fowler

(1991) Reducing Interviewer-related Error through Interviewer Training, Supervision, and Other Means. In: Biemer

Groves

Lyberg

Mathiowetz

Sudman

(eds) Measurement Errors in Surveys. Hoboken (NJ): Wiley, 259–78.

12.

Fowler

Mangione

(1990) Standardized Survey Interviewing - Minimizing Interviewer-related Error (Vol. 18). Newbury Park (CA): Sage.

13.

Heerwegh

(2005) Effects of Personal Salutations in E-mail Invitations to Participate in a Web Survey. Public Opinion Quarterly 69(4): 588–98.

14.

Heerwegh

Vanhove

Matthijs

Loosveldt

(2005) The Effect of Personalization on Response Rates and Data Quality in Web Surveys. International Journal of Social Research Methodology - Theory and Practice 8(2), 85–99.

15.

Heerwegh

Loosveldt

(2006) An Experimental Study on the Effects of Personalization, Survey Length Statements, Progress Indicators, and Survey Sponsor Logos in Web Surveys. Journal of Official Statistics 22(2): 191–210.

16.

Hoe

Grunwald

(2015) The Role of Automated SMS Text Messaging in Survey Research. Survey Practice 8(6), http://www.surveypractice.org/index.php/SurveyPractice/article/view/319/pdf_44.

17.

Homans

(1961) Social Behavior - Its Elementary Forms. New York (NY): Harcourt, Brace & World.

18.

Johnson

(2016) Collecting Data from mHealth Users via SMS Surveys - A Case Study in Kenya. Survey Practice 9(1), http://www.surveypractice.org/index.php/SurveyPractice/article/view/318/pdf_52.

19.

Joinson

Reips

U-D

(2007) Personalized Salutation, Power of Sender and Response Rates to Web-based Surveys. Computers in Human Behavior 23(3): 1372–83.

20.

Joinson

Woodley

Reips

U-D

(2007) Personalization, Authentication and Self-disclosure in Self-administered Internet Surveys. Computers in Human Behavior 23(1): 275–85.

21.

Krosnick

(1991) Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys. Applied Cognitive Psychology 5: 213–36.

22.

Kunz

Fuchs

(2012) Improving RDD Cell Phone Samples. Evaluation of Different Pre-call Validation Methods. Journal of Official Statistics 28(3): 373–94.

23.

Lozar Manfreda

Bosnjak

Berzelak

Haas

Vehovar

(2008) Web Surveys versus Other Survey Modes - A Meta-analysis Comparing Response Rates. International Journal of Market Research 50(1): 79–104.

24.

Lugtig

Toepoel

(2016) The Use of PCs, Smartphones and Tablets in a Probability Based Panel Survey. Effects on Survey Measurement Error. Social Science Computer Review 34(1): 78–94.

25.

Malhotra

Miller

Wedeking

(2014) The Relationship between Nonresponse Strategies and Measurement Error: Comparing Online Panel Surveys to Traditional Surveys. In: Callegaro

Baker

Bethlehem

Göritz

Krosnick

Lavrakas

(eds) Online Panel Research. A Data Quality Perspective. Chichester (UK): Wiley, 313–36.

26.

Mbuagbaw

Mursleen

Lytvyn

Smieja

Dolovich

Thabane

(2015) Mobile Phone Text Messaging Interventions for HIV and Other Chronic Diseases - An Overview of Systematic Reviews and Framework for Evidence Transfer. BMC Health Services Research 15(33), https://www.ncbi.nlm.nih.gov/pubmed/25609559.

27.

Mueller

Straatmann

Hattrup

Jochum

(2014) Effects of Personalized versus Generic Implementation of an Intra-organizational Online Survey on Psychological Anonymity and Response Behavior - A Field Experiment. Journal of Business and Psychology 29: 169–81.

28.

Muñoz-Leiva

Sánchez-Fernández

Montoro-Ríos

Ibáñez-Zapata

(2010) Improving the Response Rate and Quality in Web-based Surveys through the Personalization and Frequency of Reminder Mailings. Quality & Quantity 44(5): 1037–52.

29.

National Research Council (2013) Nonresponse in Social Science Surveys - A Research Agenda. Washington (DC): National Academies Press.

30.

Pearson

Levine

(2003) Salutations and Response Rates to Online Surveys. In: Banks

Currall

Francis

Gerrad

Khan

Macer

Rigg

Ross

Taylor

Westlake

(eds) The Impact of Technology on the Survey Process. Proceedings of the Fourth International Conference on Survey and Statistical Computing. Chesham (Bucks): Association for Survey Computing, 351–62.

31.

Porter

Whitcomb

(2003) The Impact of Contact Type on Web Survey Response Rates. Public Opinion Quarterly 67(4): 579–88.

32.

Sala

Decataldo

Respi

(2015) Il disegno della ricerca. In: Tognetti

(ed) Voglio fare l’assistente sociale. Formazione e occupazione dei laureati in Servizio sociale in tempi di crisi e discontinuità. Milano: FrancoAngeli, 95–115.

33.

Sánchez-Fernández

Muñoz-Leiva

Montoro-Ríos

(2012) Improving Retention Rate and Response Quality in Web-based Surveys. Computers in Human Behavior 28(2): 507–14.

34.

Sauermann

Roach

(2013) Increasing Web Survey Response Rates in Innovation Research - An Experimental Study of Static and Dynamic Contact Design Features. Research Policy 42(1): 273–86.

35.

Short

Rebar

Vandelanotte

(2015) Do Personalised E-mail Invitations Increase the Response Rates of Breast Cancer Survivors Invited to Participate in a Web-based Behaviour Change Intervention? A Quasi-randomised 2-arm Controlled Trial. BMC Medical Research Methodology 15(66), https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4545569/.

36.

Sinclair

O’Toole

Malawaraarachchi

Leder

(2012) Comparison of Response Rates and Cost-effectiveness for a Community-based Survey - Postal, Internet and Telephone Modes with Generic or Personalised Recruitment Approaches. BMC Medical Research Methodology 12(132), https://www.ncbi.nlm.nih.gov/pubmed/22938205.

37.

Steeh

Buskirk

Callegaro

(2007) Using Text Messages in US Mobile Phone Surveys. Field Methods 19(1): 59–75.

38.

Thibaut

Kelley

(1959) The Social Psychology of Groups. New York (NY): Wiley.

39.

Tourangeau

Rips

Rasinski

(2000) Psychology of Survey Response. Cambridge (UK): Cambridge University Press.

40.

Wengrzik

Bosnjak

Lozar Manfreda

(2016) Are Web Surveys Still Inferior? An Updated and Extended Meta-Analysis Comparing Response Rates. Paper presented at the 9th International Conference on Social Science Methodology (RC33), Leicester (UK), 11–16 September 2016.

41.

West

Ghimire

Axinn

(2015) Evaluating a Modular Design Approach to Collecting Survey Data Using Text Messages. Survey Research Methods 9(2): 111–23.

Personalized SMS,Survey Participation and Data quality – The Italian Case

Abstract

Keywords

Get full access to this article

References