What Happens if You Offer a Mobile Option to Your Web Panel? Evidence From a Probability-Based Panel of Internet Users

Abstract

This article reports from a pilot study that was conducted in a probability-based online panel in the Netherlands. Two parallel surveys were conducted: one in the traditional questionnaire layout of the panel and the other optimized for mobile completion with new software that uses a responsive design (optimizes the layout for the device chosen). The latter questionnaire was optimized for mobile completion, and respondents could choose whether they wanted to complete the survey on their mobile phone or on a regular desktop. Results show that a substantive number of respondents (57%) used their mobile phone for survey completion. No differences were found between mobile and desktop users with regard to break offs, item nonresponse, time to complete the survey, or response effects such as length of answers to an open-ended question and the number of responses in a check-all-that-apply question. A considerable number of respondents gave permission to record their GPS coordinates, which are helpful in defining where the survey was taken. Income, household size, and household composition were found to predict mobile completion. In addition, younger respondents, who typically form a hard-to-reach group, show higher mobile completion rates.

Keywords

mobile phone survey panel survey measurement effects nonresponse effects

Get full access to this article

View all access options for this article.

References

Bosnjak

Metzger

(2010). Understanding the willingness to participate in mobile surveys: Exploring the role of hedonic, affective, and self-expressive factors. Social Science Computer Review, 28, 350–370.

Bosnjak

Poggio

Becker

K. R.

Funke

Wachenfeld

Fischer

(2013). Online survey participation via mobile devices. Paper presented at AAPOR, 2013, Boston, MA. Retrieved July 29, 2013, from http://www.psyconsult.de/bosnjak/pages/publications/conference-contributions.php

Callegaro

Disogra

(2008). Computing response metrics for online panels. Public Opinion Quarterly, 72, 1008–1032.

Couper

M. P.

(2011). The future of modes of data collection. Public Opinion Quarterly, 75, 889–908.

Couper

M. P.

(2013). Surveys on mobile devices: Opportunities and challenges. Paper presented at the workshop ‘Web Surveys for the General Population: How, Why, and When? London. Retrieved July 29,2013, from http://www.natcen.ac.uk/genpopweb/documents/Mick-Couper.pdf

De Bruijne

Wijnant

(2013). Comparing survey results obtained via mobile devices and computers. Social Science Computer Review. doi:10.1177/0894439313483976

Emerce. (2011). Retrieved July 29, 2013, from http://www.emerce.nl/research/mobiel-emails-lezen-2011-verdubbeld

Eurostat. (2012). Internet use in households and by individuals in 2012. Statistics in focus, 50.

Fuchs

Busse

(2009). The coverage bias of mobile web surveys across European countries. International Journal of Internet Science, 4, 21–33.

10.

Lynn

Kaminska

(2012). The impact of mobile phones on survey measurement error. Public Opinion Quarterly. doi:10.1093/poq/nfs046

11.

Mavletova

(2013). Data quality in PC and mobile web surveys. Social Science Computer Review. doi:10.1177/0894439313485201

12.

Peytchev

Hill

C. A.

(2010). Experiments in mobile web survey design: Similarities to other modes and unique considerations. Social Science Computer Review, 28, 319–335.

13.

Peytchev

Neely

(2013). RDD telephone surveys. Toward a single-frame cell-phone design. Public Opinion Quarterly , 77, 283–304.

14.

Stapleton

(2011). The Smart (Phone) Way to collect survey data. Paper presented at the AAPOR Conference, Phoenix, AZ.

15.

Statistics Netherlands. (2013). Statline database. Retrieved July 29, 2013, from www.cbs.statline.nl

16.

Vehovar

Verzelak

Lozar Manfreda

(2010). Mobile phones in an environment of competing survey modes: Applying metric for evaluation of costs and errors. Social Science Computer Review, 28, 303–318.