Facebook Digital Traces for Survey Research: Assessing the Efficiency and Effectiveness of a Facebook Ad–Based Procedure for Recruiting Online Survey Respondents in Niche and Difficult-to-Reach Populations

Abstract

Survey-based studies are increasingly experimenting with strategies that employ digital footprints left by users on social media as entry points for recruiting participants and complementary data sources. In this perspective, the Facebook advertising platform provides unique opportunities and challenges through its marketing tools that target advertisements based on users’ demographics, behaviors, and interests. This article presents a procedure that employed the most recent developments in Facebook marketing tools to evaluate the efficiency and effectiveness of an innovative method for recruiting niche and traditionally hard-to-reach respondents. Although the multiple innovations introduced in the method hinder a proper comparison with previous studies, the survey provides evidence concerning the efficacy of the procedure and offers scholars a set of implementations to design future comparable Facebook ad–based surveys. Challenges, opportunities, and results for effectiveness are discussed in light of a previous survey on Italian adults carried out with a panel-based computer-assisted web interviewing method.

Keywords

web survey Facebook digital footprints conspiracy theories

Get full access to this article

View all access options for this article.

References

American Association for Public Opinion Research. (2016). Evaluating survey quality in today’s complex environment. Retrieved from https://www.aapor.org/Education-Resources/Reports/Evaluating-Survey-Quality.aspx

Arcia

(2014). Facebook advertisements for inexpensive participant recruitment among women in early pregnancy. Health Education & Behavior, 41, 237–241.

Asur

Huberman

(2010). Predicting the future with social media. In Proceedings—2010 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2010. doi:10.1109/WI-IAT.2010.63

Batterham

P. J.

(2014). Recruitment of mental health survey participants using internet advertising: Content, characteristics and cost effectiveness. International Journal of Methods in Psychiatric Research, 23, 184–191.

Bessi

Petroni

Del Vicario

Zollo

Anagnostopoulos

Scala

… Quattrociocchi

(2016). Homophily and polarization in the age of misinformation. The European Physical Journal Special Topics, 225, 2047–2059.

Brickman Bhutta

(2012). Not by the book. Facebook as a sampling frame. Sociological Methods & Research, 41, 57–88.

Broockman

D. E.

Green

D. P.

(2014). Do online advertisements increase political candidates’ name recognition or favorability? Evidence from randomized field experiments. Political Behavior, 36, 263–289.

Bruns

(2018). Facebook shuts the gate after the horse has bolted, and hurts real research in the process. Internet Policy Review. Retrieved from https://policyreview.info/articles/news/facebook-shuts-gate-after-horse-has-bolted-and-hurts-real-research-process/786

Chu

J. L.

Snider

C. E.

(2013). Use of a social networking web site for recruiting Canadian youth for medical research. Journal of Adolescent Health, 52, 792–794.

10.

Comunello

Mulargia

Parisi

(2017). Non guardarmi, non ti sento. Processi di sense giving nella controversia sui vaccini infantili tra gli utenti di Facebook [Don’t look at me, I can’t hear you. Exploring sense-giving processes related to the childhood vaccine controversy among Italian Facebook users]. Problemi dell’Informazione, 3, 431–458.

11.

Facebook. (2018a). Choose your audience. Retrieved from https://www.facebook.com/business/products/ads/ad-targeting#core_audiences

12.

Facebook. (2018b). Facebook Q1 2018 earnings presentation. Retrieved from https://s21.q4cdn.com/399680738/files/doc_financials/2018/Q1/Q1-2018-Earnings-Presentation-(1).pdf

13.

Fenner

Garland

S. M.

Moore

E. E.

Jayasinghe

Fletcher

Tabrizi

S. N.

… Wark

J. D.

(2012). Web-based recruiting for health research using a social networking site: An exploratory study. Journal of Medical Internet Research, 14. doi:10.2196/jmir.1978

14.

Fricker

R. D.

(2008). Sampling methods for web and e-mail surveys. In Fielding

N. G.

Lee

R. M.

Blank

(Eds.), The SAGE handbook of online research methods (pp. 195–216). London, England: Sage.

15.

Giglietto

Iannelli

Rossi

Valeriani

(2016, December). Fakes, news and the election: A new taxonomy for the study of misleading information within the hybrid media system. Paper presented at the Conference AssoComPol 2016, Urbino, Italy. Retrieved from https://ssrn.com/abstract=2878774

16.

Harris

Loxton

Wigginton

Lucke

(2015). Recruiting online: Lessons from a longitudinal survey of contraception and pregnancy intentions of young Australian women. American Journal of Epidemiology, 181. doi:10.1093/aje/kwv006

17.

Head

B. F.

Dean

Flanigan

Swicegood

Keating

M. D.

(2016). Advertising for cognitive interviews: A comparison of Facebook, Craigslist, and snowball recruiting. Social Science Computer Review, 34, 360–377.

18.

Hollander

Wolfe

D. A.

(1973). Nonparametric Statistical Methods. New York, NY: John Wiley.

19.

Jack

(2017). Lexicon of lies: Terms for problematic information. Data & Society. Retrieved from https://datasociety.net/output/lexicon-of-lies/

20.

Jäger

(2017). The potential of online sampling for studying political activists around the world and across time. Political Analysis, 25, 329–343.

21.

Jungherr

Jürgens

Schoen

(2012). Why the pirate party won the German election of 2009 or the trouble with predictions. Social Science Computer Review, 30, 229–234.

22.

Kapp

J. M.

Peters

Oliver

D. P.

(2013). Research recruitment using Facebook advertising. Big potential, big challenges. Journal of Cancer Education, 28, 134–137.

23.

King

D. B.

O’Rourke

DeLongis

(2014). Social media recruitment and online data collection: A beginner’s guide and best practices for accessing low-prevalence and hard-to-reach populations. Canadian Psychology/Psychologie canadienne, 55, 240–249.

24.

Kosinski

Matz

Gosling

Popov

Stillwell

(2015). Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines. American Psychologist, 70, 543–556.

25.

Lohse

(2013). Facebook is an effective strategy to recruit low-income women to online nutrition education. Journal of Nutrition Education and Behavior, 45, 69–76.

26.

Lord

Brevard

Budman

(2011). Connecting to young adults: An online social network survey of beliefs and attitudes associated with prescription opioid misuse among college students. Substance Use Misuse, 46, 66–76.

27.

Mancosu

M. M.

Vassallo

Vezzoni

(2017). Believing in conspiracy theories: Evidence from an exploratory analysis of Italian survey data. South European Society and Politics, 22, 327–344.

28.

Pötzschke

Braun

(2017). Migrant sampling using Facebook advertisements: A case study of Polish migrants in four European countries. Social Science Computer Review, 35, 633–653.

29.

Ramo

D. E.

Prochaska

J. J.

(2012). Broad reach and targeted recruitment using Facebook for an online survey of young adult substance use. Journal of Medical Internet Research, 14, e28.

30.

Revilla

Ochoa

(2018). Alternative methods for selecting web survey samples. International Journal of Market Research. doi:10.1177/1470785318765537

31.

Ryan

T. J.

(2012). What makes us click? Demonstrating incentives for angry discourse with digital-age field experiments. Journal of Politics, 74, 1138–1152.

32.

Ryan

T. J.

Brader

(2017). Gaffe Appeal. A field experiment on partisan selective exposure to election messages. Political Science Research and Methods, 5, 667–687.

33.

Samuels

Zucco

(2014). The power of partisanship in Brazil: Evidence from survey experiments. American Journal of Political Science, 58, 212–225.

34.

Shah

D. V.

Cappella

J. N.

Neuman

W. R.

(2015). Big data, digital media, and computational social science: Possibilities and perils. The ANNALS of the American Academy of Political and Social Science, 659, 6–13.

35.

Stern

M. J.

Bilgen

McClain

Hunscher

(2016). Effective sampling from social media sites and search engines for web surveys: Demographic and data quality differences in surveys of Google and Facebook users. Social Science Computer Review, 35, 713–732.

36.

Sunstein

C. R.

Vermeule

(2009). Symposium on conspiracy theories conspiracy theories: Causes and cures. The Journal of Political Philosophy, 17, 202–227.

37.

Tomczak

(2014). The need to report effect size estimates revisited. An overview of some recommended measures of effect size. Trends in Sport Sciences, 1, 19–25.

38.

Vaccari

Valeriani

(2015). Follow the leader! Direct and indirect flows of political communication during the 2013 general election campaign. New Media & Society, 17, 1025–1042.

39.

Whitaker

Stevelink

Fear

(2017). The use of Facebook in recruiting participants for health research purposes: A systematic review. Journal of Medical Internet Research, 19, e290.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.12 MB