Sage Journals: Discover world-class research

Abstract

With nearly 50% of U.S. mobile phone subscribers using smartphones, survey researchers are beginning to explore their use as a data collection tool. The Got Healthy Apps Study (GHAS) conducted a randomized experiment to compare mode effects for a survey completed via iPhone mobile browser and online via desktop/laptop computer web browser. Mode effects were assessed for three types of outcomes: randomization/recruitment, survey process/completion, and survey items. In short, the distribution of survey completion times and the distribution of the number of apps owned were significantly different across survey mode after accounting for block group. Other key mode effects outcomes (including open-ended items, slider bar questions, and missing item rates) showed no significant differences across survey mode. Some interesting qualitative findings suggest that iPhone respondents enter more characters and omit fewer items than originally thought.

Keywords

smartphones survey research mode effects apps

Get full access to this article

View all access options for this article.

References

Baker

Curtice

Sparrow

. 2003. Internet poll trial: Research report. http://www.icmresearch.com/white-papers/internet-poll-trial.pdf (accessed December 1, 2012).

Bosnjak

Metzger

Gräf

. 2010. Understanding the willingness to participate in mobile surveys: Exploring the role of utilitarian, affective, hedonic, social, self-expressive, and trust-related factors. Social Science Computer Review 28:350–70.

Brick

J. M.

Brick

P. D.

Dipko

Presser

. 2007. Cell phone survey feasibility in the U.S.: Sampling and calling cell numbers versus landline numbers. Public Opinion Quarterly 71:23–39.

Buskirk

T. D.

Andrus

. 2012. Smart surveys for smartphone: Exploring various approaches for conducting online mobile surveys via smartphones. Survey Practice 5. http://surveypractice.wordpress.com/2012/02/21/smart-surveys-for-smart-phones/ (accessed May 10, 2012).

Buskirk

Andrus

C. H.

Gaynor

Gorrel

. 2011. An app a day could keep the doctor away: Comparing mode effects for a iPhone survey related to health app use. Paper presented at AAPOR, Phoenix, AZ, May 17.

Callegaro

2010. Do you know which device your respondent has used to take your online survey? Survey Practice 3. http://surveypractice.wordpress.com/2010/12/08/device-respondent-has-used/ (accessed on May 10, 2012).

Centers for Disease Control and Prevention. 2011. Behavioral risk factor surveillance system questionnaire. http://www.cdc.gov/brfss/questionnaires/pdf-ques/2011brfss.pdf (accessed April 10, 2012).

Couper

M. P.

2010. Visual design in online surveys: Learning for the mobile world. Presented at the Mobile Research Conference 2010, London. http://www.esomar.org/web/research_papers/Mobile-Cell-Phone-Research_2054_Best-practices-in-mobile-research.php (accessed May 12, 2012).

Couper

M. P.

Conrad

F. G.

Tourangeau

. 2007. Visual context effects in web surveys. Public Opinion Quarterly 71:623–34.

10.

Dmitrienko

Molenberghs

Offen

Chuang-Stein

. 2005. Analysis of clinical trials using SAS: A practical guide. Cary, NC: SAS Institute Inc.

11.

Duffy

Smith

Terhanian

Bremer

. 2005. Comparing data from online and face-to-face surveys. International Journal of Market Research 47:615–39.

12.

Elteren

P. H. van.

1960. On the combination of independent two-sample tests of Wilcoxon. Bulletin of the International Statistical Institute 37:351–61.

13.

Fitts

P. M.

1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47:381–91.

14.

Galesic

Bosnjak

. 2009. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly 73:349–60.

15.

Goldberg

Faridan

Alterovitz

. 2007. A new derivation and dataset for Fitts’ law of human motion. Journal of Latex Class Files 6:1–14.

16.

Jones

Marsden

Mohd-Nasir

Boone

Buchanan

. 1999. Improving web interaction on small displays. Computer Networks—the International Journal of Computer and Telecommunications Networking 31:1129–37.

17.

Kish

1987. Statistical design for research. New York: Wiley.

18.

Lehmann

E. L.

D’Abrera

H. J. M.

. 2006. Nonparametrics: Statistical methods based on ranks. New York: Springer.

19.

Link

M. W.

Buskirk

T. D.

. 2012. The role of new technologies in powering, augmenting, or replacing traditional surveys. Shortcourse presented at the American Association of Public Opinion Research, Orlando, FL, May 18, 2012.

20.

Nielsen Wire. 2012. Smartphones account for half of all mobile phones, dominate new phone purchases in the US. http://blog.nielsen.com/nielsenwire/online_mobile/smartphones-account-for-half-of-all-mobile-phones-dominate-new-phone-purchases-in-the-us/ (accessed April 20, 2012).

21.

Nurss

J. R.

El-Kebbi

I. M.

Gallina

D. L.

Ziemer

D. C.

. 1997. Diabetes in urban African Americans: Functional health literacy of municipal hospital outpatients with diabetes. The Diabetes Educator 23:563–68.

22.

Parush

Yuviler-Gavish

. 2004. Web navigation structures in cellular phones: The depth/breadth trade-off issue. International Journal of Human-Computer Studies 60:753–70.

23.

Peytchev

Hill

C. A.

. 2010. Experiments in mobile web survey design. Social Science Computer Review 28:319–35.

24.

Rainie

Zickuhr

Purcell

Madden

Brenner

. 2012. The rise of e-reading. http://libraries.pewinternet.org/files/legacy-pdf/Theriseofe-reading4.5.12.pdf (accessed April 21, 2012).

25.

Sax

L. J.

Gilmartin

S. K.

Bryant

A. N.

. 2003. Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education 44:409–32.

26.

Smith

2011. Smartphone adoption and usage. http://www.pewinternet.org/reports/2011/Samartphones.aspx (accessed May 10, 2012).

27.

Smith

W. G.

2008. “Does gender influence online survey participation? A record-linkage analysis of university faculty online survey response behavior.” Dissertation from San Jose State University, San Jose, CA. http://eric.ed.gov/?id=ED501717 (accessed May 10, 2012).

28.

Steeh

Buskirk

T. D.

Callegaro

. 2007. Using text messages in U.S. mobile phone surveys. Field Methods 19:59–75.

29.

Sweeney

Crestani

. 2006. Effective search results summary size and device screen size: Is there a relationship? Information Processing & Management 42:1056–74.

30.

U.S. Preventative Services Task Force. 2009. Aspirin for the prevention of cardiovascular disease. http://www.uspreventiveservicestaskforce.org/uspstf/uspsasmi.htm (accessed May 7, 2011).

31.

Vicente

Reis

Santos

. 2009. Using mobile phones for survey research. International Journal of Market Research 51:613–33.

32.

Williams

M. V.

Parker

R. M.

Baker

D. W.

Parikh

N. S.

Pitkin

Coates

W. C.

Nurss

J. R.

. 1995. Inadequate functional health literacy among patients at two public hospitals. JAMA: The Journal of the American Medical Association 274:1677–82.

33.

Zahariev

Ferneyhough

Ryan

Bishop

. 2009. Best practices in mobile research. Presented at the ESOMAR online research, ESOMAR, Chicago, IL, October 26. http://www.esomar.org/web/research_papers/Mobile-Cell-Phone-Research_2054_Best-practices-in-mobile-research.php (accessed May 12, 2012).

Making Mobile Browser Surveys Smarter

Abstract

Keywords

Get full access to this article

References