This web-based study recruited kidney transplant recipients from Facebook using three recruiting methods over a 5-week period. Participants completed 125 survey items via REDCap (Research Electronic Data Capture) survey. Facebook recruitment generated 153 eligible participants who completed surveys. The average survey response time was 15.07 min (SD = 6.12; range: 4-43), with a low missing item rate (<5%). Facebook’s standard ads were most effective for recruiting subjects (n = 78, 51%), followed by three targeted Facebook kidney transplant support groups (n = 52, 34%) and a pay-to-promote study page (n = 12, 7.8%). The average cost paid for each valid survey was US$2.19 through standard Facebook ads and US$2.92 from the study page. The cost for online survey completion is economically feasible even for those with limited funds. Issues related to online surveys including extreme survey response times and participant misrepresentation were reported in this study.
AdamL. M.MancaD. P.BellR. C. (2016). Can Facebook be used for research? Experiences using Facebook to recruit pregnant women for a randomized controlled trial. Journal of Medical Internet Research, 18(9), e250. doi:10.2196/jmir.6404
2.
AkardT. F.WrayS.GilmerM. (2015). Facebook ads recruit parents of children with cancer for an online survey of web-based research preferences. Cancer Nursing, 38, 155-161.
3.
AlshaikhF.RamzanF.RawafS.MajeedA. (2014). Social network sites as a mode to collect health data: A systematic review. Journal of Medical Internet Research, 16(7), e171. doi:10.2196/jmir.3050
4.
AmonK. L.CampbellA. J.HawkeC.SteinbeckK. (2014). Facebook as a recruitment tool for adolescent health research: A systematic review. Academic Pediatrics, 14, 439-447.
5.
AndrewsD.NonneckeB.PreeceJ. (2007). Conducting research on the Internet: Online survey design, development and implementation guidelines. International Journal of Human-Computer Interaction, 16, 185-210.
6.
AntounC.CouperM. P.ConradF. G. (2017). Effects of mobile versus PC web on survey response quality: A crossover experiment in a probability web panel. Public Opinion Quarterly, 81(S1), 280-306.
7.
BrittainK.KampK. J. P.SalaysayZ. (2018). Colorectal cancer awareness for women via Facebook: A pilot study. Gastroenterology Nursing, 41, 14-18.
8.
Carter-HarrisL.EllisR. B.WarrickA.RawlS. (2016). Beyond traditional newspaper advertisement: Leveraging Facebook-targeted advertisement to recruit long-term smokers for research. Journal of Medical Internet Research, 18(6), e117.
9.
ChadbanS. (2008). New-onset diabetes after transplantation—Should it be a factor in choosing an immunosuppressant regimen for kidney transplant recipients. Nephrology Dialysis Transplantation, 23, 1816-1818.
10.
Chisholm-BurnsM. A.EricksonS. R.SpiveyC. A.GruessnerR. W.KaplanB. (2011). Concurrent validity of kidney transplant questionnaire in US renal transplant recipients. Patient Preference and Adherence, 5, 517-522.
11.
ChoiI.MilneD. N.GlozierN.PetersD.HarveyS. B.CalvoR. A. (2017). Using different Facebook advertisements to recruit men for an online mental health study: Engagement and selection bias. Internet Interventions, 8, 27-34.
12.
CopeD. G. (2014). Using electronic surveys in nursing research. Oncology Nursing Forum, 41, 681-682.
13.
DillmanD. A.SmythJ. D.ChristianL. M. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method. Hoboken, NJ: John Wiley.
14.
EpsteinR. M.FranksP.FiscellaK.ShieldsC. G.MeldrumS. C.KravitzR. L.DubersteinP. R. (2005). Measuring patient-centered communication in patient-physician consultations: Theoretical and practical issues. Social Science & Medicine, 61, 1516-1528.
15.
EvangelistaL. S.LeeJ. A.MooreA. A.MotieM.GhasemzadehH.SarrafzadehM.MangioneC. M. (2015). Examining the effects of remote monitoring systems on activation, self-care, and quality of life in older patients with chronic heart failure. Journal of Cardiovascular Nursing, 30, 51-57.
16.
EysenbachG. (2004). Improving the quality of Web surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES). Journal of Medical Internet Research, 6(3), e34.
17.
FengC.WangH.LuN.ChenT.HeH.LuY.TuX. M. (2014). Log-transformation and its implications for data analysis. Shanghai Archives of Psychiatry, 26, 105-109.
18.
FunkhouserE.VellalaK.BaltuckC.CacciatoR.DurandE.McEdwardD., . . . National Dental PBRN Collaborative Group. (2017). Survey methods to optimize response rate in the national dental practice-based research network. Evaluation & the Health Professions, 40, 332-358.
19.
GalesicM. (2006). Dropouts on the web: Effects of interest and burden experienced during an online survey. Journal of Official Statistics, 22, 313-328.
20.
Goldfarb-RumyantzevA. S.SandhuG. S.BairdB.BarenbaumA.YoonJ. H.DimitriN.. . . ShihabF. (2012). Effect of education on racial disparities in access to kidney transplantation. Clinical Transplantation, 26, 74-81.
21.
GordonE. J.BergeronA.McNattG.FriedewaldJ.AbecassisM. M.WolfM. S. (2012). Are informed consent forms for organ transplantation and donation too difficult to read?Clinical Transplantation, 26, 275-283.
22.
GuilloryJ.WiantK. F.FarrellyM.FiaccoL.AlamI.HoffmanL.. . . AlexanderT. N. (2018). Recruiting hard-to-reach populations for survey research: Using Facebook and Instagram advertisements and in-person intercept in LGBT bars and nightclubs to recruit LGBT young adults. Journal of Medical Internet Research, 20(6), e197. doi:10.2196/jmir.9461
23.
HatcherL. (2013). Advanced statistics in research: Reading, understanding, and writing up data analysis results. Saginaw, MI: Shadow Finch Media.
24.
HibbardJ. H.MahoneyE. R.StockardJ.TuslerM. (2005). Development and testing of a short form of the patient activation measure. Health Services Research, 40, 1918-1930.
25.
HuangJ. L.CurranP. G.KeeneyJ.PoposkiE. M.DeShonR. P. (2012). Detecting and deterring insufficient effort responding to surveys. Journal of Business and Psychology, 27, 99-114.
26.
JamiesonN. J.HansonC. S.JosephsonM. A.GordonE. J.CraigJ. C.HalleckF.. . . TongA. (2016). Motivations, challenges, and attitudes to self-management in kidney transplant recipients: A systematic review of qualitative studies. American Journal of Kidney Diseases, 67, 461-478.
27.
JohnsonM. L.ZimmermanL.WelchJ. L.HertzogM.PozehlB.PlumbT. (2016). Patient activation with knowledge, self-management and confidence in chronic kidney disease. Journal of Renal Care, 42, 15-22.
28.
JonesR.LacroixL. J.PorcherE. (2017). Facebook advertising to recruit young, urban women into an HIV prevention clinical trial. AIDS and Behavior, 21, 3141-3153.
KandulaS.Zeng-TreitlerQ. (2008). Creating a gold standard for the readability measurement of health texts. AMIA Annual Symposium Proceedings, 2008, 353-357.
31.
KayrouzR.DearB. F.KarinE.TitovN. (2016). Facebook as an effective recruitment strategy for mental health research of hard to reach populations. Internet Interventions, 4, 1-10.
32.
KeuschF. (2015). Why do people participate in Web surveys? Applying survey participation theory to Internet survey data collection. Management Review Quarterly, 65, 183-216.
33.
KosinskiM.MatzS. C.GoslingS. D.PopovV.StillwellD. (2015). Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines. American Psychologist, 70, 543-556.
34.
LaguillesJ. S.WilliamsE. A.SaundersD. B. (2011). Can lottery incentives boost web survey response rates? Findings from four experiments. Research in Higher Education, 52, 537-553.
35.
LaupacisA.PusN.MuirheadN.WongC.FergusonB.KeownP. (1993). Disease-specific questionnaire for patients with a renal transplant. Nephron, 64, 226-231.
LohseB.WamboldtP. (2013). Purposive Facebook recruitment endows cost-effective nutrition education program evaluation. JMIR Research Protocols, 2(2), e27.
38.
LorigK. R.SobelD. S.RitterP. L.LaurentD.HobbsM. (2001). Effect of a self-management program on patients with chronic disease. Effective Clinical Practice, 4, 256-262.
39.
LowJ. K.WilliamsA.ManiasE.CrawfordK. (2014). Interventions to improve medication adherence in adult kidney transplant recipients: A systematic review. Nephrology Dialysis Transplantation, 30, 752-761.
40.
ManiaciM. R.RoggeR. D. (2014). Caring about carelessness: Participant inattention and its effects on research. Journal of Research in Personality, 48, 61-83.
41.
MawT. T. (2014). How to maximize outcomes and minimize graft failure. The Immunology Report, 11, 21-28.
McInnesN.HaglundB. J. (2011). Readability of online health information: Implications for health literacy. Informatics for Health and Social Care, 36, 173-189.
44.
McPeakeJ.BatesonM.O’NeillA. (2014). Electronic surveys: How to maximise success. Nurse Researcher, 21(3), 24-26.
45.
McRobertC. J.HillJ. C.SmaleT.HayE. M.van der WindtD. A. (2018). A multi-modal recruitment strategy using social media and internet-mediated methods to recruit a multidisciplinary, international sample of clinicians to an online research study. PLoS ONE, 13(7), e0200184.
46.
MeadeA. W.CraigS. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17, 437-455.
47.
MochonD.JohnsonK.SchwartzJ.ArielyD. (2017). What are likes worth? A Facebook page field experiment. Journal of Marketing Research, 54, 306-317.
48.
NashE. L.GilroyD.SrikusalanukulW.AbhayaratnaW. P.StantonT.MitchellG.. . . SharmanJ. E. (2017). Facebook advertising for participant recruitment into a blood pressure clinical trial. Journal of Hypertension, 35, 2527-2531.
49.
OsborneJ. (2005). Notes on the use of data transformations. Practical Assessment, Research and Evaluation, 9, 42-50.
50.
OxtobyJ.KingR.SheridanJ.ObstP. (2016). Psychometric analysis of the Multidimensional State Boredom Scale and its condensed versions. Assessment, 25, 826-840. doi:10.1177/1073191116662910
51.
PallantJ. (2013). SPSS survival manual: A step by step guide to data analysis using IBM SPSS. London, England: McGraw-Hill Education.
52.
PedersenE. R.KurzJ. (2016). Using Facebook for health-related research study recruitment and program delivery. Current Opinion in Psychology, 9, 38-43.
53.
PedersenE. R.NaranjoD.MarshallG. N. (2017). Recruitment and retention of young adult veteran drinkers using Facebook. PLoS ONE, 12(3), e0172972.
54.
PolitD. F. (2010). Statistics and data analysis for nursing research (2nd ed.). London, England: Pearson Education.
55.
PorterS. R.WhitcombM. E.WeitzerW. H. (2004). Multiple surveys of students and survey fatigue. New Directions for Institutional Research, 2004(121), 63-73.
56.
PreyJ. E.QianM.RestainoS.HibbardJ.BakkenS.SchnallR.. . . CreberR. M. (2016). Reliability and validity of the patient activation measure in hospitalized patients. Patient Education and Counseling, 99, 2026-2033.
57.
RamoD. E.RodriguezT. M.ChavezK.SommerM. J.ProchaskaJ. J. (2014). Facebook recruitment of young adult smokers for a cessation trial: Methods, metrics, and lessons learned. Internet Interventions, 1, 58-64.
58.
ReeseP. P.BloomR. D.Trofe-ClarkJ.MussellA.LeidyD.LevskyS.. . . FeldmanH. I. (2017). Automated reminders and physician notification to promote immunosuppression adherence among kidney transplant recipients: A randomized trial. American Journal of Kidney Diseases, 69, 400-409.
59.
RevillaM.OchoaC. (2015). What are the links in a Web survey among response time, quality, and auto-evaluation of the efforts done?Social Science Computer Review, 33, 97-114.
60.
RiehmK. E.KwakkenbosL.CarrierM. E.BartlettS. J.MalcarneV. L.MouthonL.. . . ThombsB. D. (2016). Validation of the Self-Efficacy for Managing Chronic Disease Scale: A scleroderma patient-centered intervention network cohort study. Arthritis Care & Research, 68, 1195-1200.
61.
RifeS. C.CateK. L.KosinskiM.StillwellD. (2016). Participant recruitment and data collection through Facebook: The role of personality factors. International Journal of Social Research Methodology, 19, 69-83.
62.
RolstadS.AdlerJ.RydénA. (2011). Response burden and questionnaire length: Is shorter better? A review and meta-analysis. Value in Health, 14, 1101-1108.
63.
RostamiZ.TavallaiiS. A.JahaniY.EinollahiB. (2011). Assessment of quality of life in a single-center transplantation population using the Kidney Transplant Questionnaire-25 questionnaire. Transplantation Proceedings, 43, 590-591.
64.
SahaK.WeberI.BirnbaumM. L.De ChoudhuryM. (2017). Characterizing awareness of schizophrenia among Facebook users by leveraging Facebook advertisement estimates. Journal of Medical Internet Research, 19(5), e156.
65.
SanghaO.StuckiG.LiangM. H.FosselA. H.KatzJ. N. (2003). The Self-Administered Comorbidity Questionnaire: A new method to assess comorbidity for clinical and health services research. Arthritis Care & Research, 49, 156-163.
66.
SchlosserS.MaysA. (2018). Mobile and dirty: Does using mobile devices affect the data quality and the response process of online surveys?Social Science Computer Review, 36, 212-230.
67.
ShepherdR. P. (2016). Men, women, and Web 2.0 writing: Gender difference in Facebook composing. Computers and Composition, 39, 14-26.
68.
SikkensE.van SanM.SieckelinckS.BoeijeH.de WinterM. (2017). Participant recruitment through social media: Lessons learned from a qualitative radicalization study using Facebook. Field Methods, 29, 130-139.
69.
SmithA.AndersonM. (2018, March1). Social media use in 2018: A majority of Americans use Facebook and YouTube, but young adults are especially heavy users of Snapchat and Instagram. Retrieved from http://www.pewinternet.org/2018/03/01/social-media-use-in-2018/
70.
StolzmannK.MeterkoM.MillerC. J.BelangerL.SeibertM. N.BauerM. S. (2018). Survey response rate and quality in a mental health clinic population: Results from a randomized survey comparison. The Journal of Behavioral Health Services & Research, 1-12. https://doi.org/10.1007/s11414-018-9617-8
71.
TabachnickB. G.FidellL. S. (2013). Using multivariate statistics (6th ed.). Boston, MA: Pearson.
72.
TayebiA.RaiesifarA.EbadiA. B. A. S.EynollahiB.RafiyanZ.KeyvanlooF. (2010). Review the renal transplantation patients’ quality of life by using Kidney Transplantation Questionnaire (KTQ-25). Journal of Critical Care Nursing, 3, 125-128.
73.
TayyebiA.RaiesifarA.MehriS. N.EbadiA.EinolahiB.PashandiS. (2012). Measuring health related Quality of Life (HRQoL) in renal transplant patients: Psychometric properties and cross-cultural adaptation of Kidney Transplant Questionnaire (KTQ-25) in Persian. Nephro-Urology Monthly, 4, 617-621.
74.
ThorntonL. K.HarrisK.BakerA. L.JohnsonM.Kay-LambkinF. J. (2016). Recruiting for addiction research via Facebook. Drug and Alcohol Review, 35, 494-502.
75.
TukeyJ. W. (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
76.
Van MolC. (2017). Improving web survey efficiency: The impact of an extra reminder and reminder content on web survey response. International Journal of Social Research Methodology, 20, 317-327.
77.
WalshT. M.VolskoT. A. (2008). Readability assessment of internet-based consumer health information. Respiratory Care, 53, 1310-1315.
78.
WangW.van LintC. L.BrinkmanW. P.RövekampT. J.van DijkS.van der BoogP. J.NeerincxM. A. (2017). Renal transplant patient acceptance of a self-management support system. BMC Medical Informatics and Decision Making, 17(1), Article 58.
79.
WardM. K.MeadeA. W. (2018). Applying social psychology to prevent careless responding during online surveys. Applied Psychology, 67, 231-263.
80.
WatsonV.BeckerF.de Bekker-GrobE. (2017). Discrete choice experiment response rates: A meta-analysis. Health Economics, 26, 810-817.
81.
WeinerM. D.PunielloO. T.SiracusaP. C.CrowleyJ. E. (2017). Recruiting hard-to-reach populations: The utility of Facebook for recruiting qualitative in-depth interviewees. Survey Practice, 10, 1-13.
WhitakerC.StevelinkS.FearN. (2017). The use of Facebook in recruiting participants for health research purposes: A systematic review. Journal of Medical Internet Research, 19(8), e290.
84.
ZiegenfussJ. Y.NiederhauserB. D.KallmesD.BeebeT. J. (2013). An assessment of incentive versus survey length trade-offs in a Web survey of radiologists. Journal of Medical Internet Research, 15(3), e49.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
