Maximizing Response Rates to Ads for Free At-Home HIV Testing on a Men-for-Men Geosocial Sexual Networking App: Lessons Learned and Implications for Researchers and Providers

Abstract

Internet-based recruitment can be effective in reaching large numbers of geographically diverse individuals. Geosocial sexual networking apps on smartphones have emerged as the modal way in which men who have sex with men (MSM) meet sex partners, and as venues for sexual health research. We report on the performance of three types of ads—text-only, text with male figure (no face), and text with male figure (with face)—used on a geosocial sexual networking app to advertise free at-home HIV testing and to enroll in an online study. We ran five 2-week-long ads on a popular MSM geosocial app between fall 2017 and spring 2018 (~2.19 million impressions). Ads were evaluated in terms of the click-through rate (CTR = advertisement clicks/advertisement impressions), conversion rates (CR = number of enrolled participants/ad-generated clicks), cost per enrolled participant, and demographic composition of survey respondents. We enrolled n = 4,023 individuals, n = 2,430 of whom completed HIV testing—$6.21 spent on advertising per participant enrolled and $10.29 spent for everyone who completed HIV testing. Cost per enrolled participant was associated with the content of the ad used—ads featuring male figures (with or without a face shown) were more cost efficient than ads featuring text alone. These ads also outperformed text-only ads across a range of metrics, including responsiveness among younger MSM as well as MSM of color. Advertising materials that combine text with images may have greater appeal among priority populations.

Keywords

advertising gay and bisexual men HIV prevention HIV risk recruitment

Get full access to this article

View all access options for this article.

References

Arcia

(2014). Facebook advertisements for inexpensive participant recruitment among women in early pregnancy. Health Education & Behavior, 41, 237-241.

Bakker

Heskes

Neijt

Kappen

(2004). Improving Cox survival analysis with a neural-Bayesian approach. Statistics in Medicine, 23, 2989-3012. doi:10.1002/sim.1904

Batterham

P. J.

(2014). Recruitment of mental health survey participants using Internet advertising: Content, characteristics and cost effectiveness. International Journal of Methods in Psychiatric Research, 23, 184-191.

Bennett

(2007). Advertising message strategies for encouraging young White working class males to consider entering British universities. Journal of Business Research, 60, 932-941.

Billig

Tajfel

(1973). Social categorization and similarity in intergroup behaviour. European Journal of Social Psychology, 3, 27-52.

Birnbaum

M. L.

Garrett

Baumel

Scovel

Rizvi

A. F.

Muscat

Kane

J. M.

(2017). Using digital media advertising in early psychosis intervention. Psychiatric Services, 68, 1144-1149.

Centers for Disease Control and Prevention. (2016a). Diagnoses of HIV infection among adolescents and young adults in the United States and 6 dependent areas 2010-2014. HIV Surveillance Supplemental Report, 21(3), 1-58. Retrieved from http://www.cdc.gov/hiv/pdf/library/reports/surveillance/cdc-hiv-surveillance-supplemental-report-vol-21-3.pdf

Centers for Disease Control and Prevention. (2016b). Half of Black gay men and a quarter of Latino gay men projected to be diagnosed within their lifetime. Retrieved from http://www.cdc.gov/nchhstp/newsroom/2016/croi-press-release-risk.html

Centers for Disease Control and Prevention. (2016c). HIV among gay and bisexual men. Retrieved from http://www.cdc.gov/hiv/group/msm/

10.

Centers for Disease Control and Prevention. (2017). HIV surveillance report, 2016. Retrieved from http://www.cdc.gov/hiv/library/reports/hiv-surveillance.html

11.

Chiasson

M. A.

Parsons

J. T.

Tesoriero

J. M.

Carballo-Dieguez

Hirshfield

Remien

R. H.

(2006). HIV behavioral research online. Journal of Urban Health, 83, 73-85.

12.

Chowdhury

R. M.

Olsen

G. D.

Pracejus

J. W.

(2011). How many pictures should your print ad have? Journal of Business Research, 64, 3-6.

13.

Datingsitereviews.com. (2019, August). Grindr information, statistics, facts and history. Retrieved from https://www.buzzfeednews.com/article/skarlan/here-are-the-worlds-most-popular-hook-up-apps-for-gay-dudes

14.

D’Souza

Zyngier

Robinson

Schlotterlein

Sullivan-Mort

(2011). Health belief model: Evaluating marketing promotion in a public vaccination program. Journal of Nonprofit & Public Sector Marketing, 23, 134-157.

15.

Duerksen

S. C.

Mikail

Tom

Patton

Lopez

Amador

. . .Sadler

G. R.

(2005). Health disparities and advertising content of women’s magazines: A cross-sectional study. BMC Public Health, 5, 85.

16.

Duncan

D. T.

Park

S. H.

Hambrick

H. R.

Dangerfield

D. T.

II. Goedel

W. C.

Brewer

. . . Hickson

D. A.

(2018). Characterizing geosocial-networking app use among young black men who have sex with men: A multi-city cross-sectional survey in the Southern United States. JMIR mHealth and uHealth, 6, e10316.

17.

Fenner

Garland

S. M.

Moore

E. E.

Jayasinghe

Fletcher

Tabrizi

S. N.

. . .Wark

J. D.

(2012). Web-based recruiting for health research using a social networking site: An exploratory study. Journal of Medical Internet Research, 14, e20.

18.

Godbold Kean

Prividera

L. C.

(2007). Communicating about race and health: A content analysis of print advertisements in African American and general readership magazines. Health Communication, 21, 289-297.

19.

Goedel

W. C.

Duncan

D. T.

(2015). Geosocial-networking app usage patterns of gay, bisexual, and other men who have sex with men: Survey among users of Grindr, a mobile dating app. JMIR Public Health and Surveillance, 1(1), e4.

20.

Goedel

W. C.

Halkitis

P. N.

Greene

R. E.

Hickson

D. A.

Duncan

D. T.

(2016). HIV risk behaviors, perceptions, and testing and preexposure prophylaxis (PrEP) awareness/use in Grindr-using men who have sex with men in Atlanta, Georgia. Journal of the Association of Nurses in AIDS Care, 27, 133-142.

21.

Graham

A. L.

Milner

Saul

J. E.

Pfaff

(2008). Online advertising as a public health and recruitment tool: Comparison of different media campaigns to increase demand for smoking cessation interventions. Journal of Medical Internet Research, 10, e50.

22.

Grov

Breslow

A. S.

Newcomb

M. E.

Rosenberger

J. G.

Bauermeister

J. A.

(2014). Gay and bisexual men’s use of the Internet: Research from the 1990s through 2013. Annual Review of Sex Research, 51, 390-409.

23.

Grov

Bux

D. A.

Parsons

J. T.

Morgenstern

(2009). Recruiting hard-to-reach drug-using men who have sex with men into an intervention study: Lessons learned and implications for applied research. Substance Use & Misuse, 44, 1855-1871.

24.

Grov

Cain

Whitfield

T. H. F.

Rendina

H. J.

Pawson

Ventuneac

Parsons

J. T.

(2016). Recruiting a US national sample of HIV-negative gay and bisexual men to complete at-home self-administered HIV/STI testing and surveys: Challenges and opportunities. Sexuality Research and Social Policy, 13, 1-21.

25.

Grov

Rendina

H. J.

Breslow

A. S.

Ventuneac

Adelson

Parsons

J. T.

(2014). Characteristics of men who have sex with men (MSM) who attend sex parties: Results from a national online sample in the USA. Sexually Transmitted Infections, 90, 26-32.

26.

Grov

Rendina

H. J.

Ventuneac

Parsons

J. T.

(2013). HIV risk in group sexual encounters: An event-level analysis from a national online survey of MSM in the US. Journal of Sexual Medicine, 10, 2285-2294.

27.

Grov

Westmoreland

D. A.

Carneiro

P. B.

Stief

MacCrate

Mirzayi

. . .Nash

(2019). Recruiting vulnerable populations to participate in HIV prevention research: Findings from the Together 5000 cohort study. Annals of Epidemiology, 35, 4-11.

28.

Holloway

I. W.

Rice

Gibbs

Winetrobe

Dunlap

Rhoades

(2014). Acceptability of smartphone application-based HIV prevention among young men who have sex with men. AIDS and Behavior, 18, 285-296.

29.

Jacques

J. T.

Perry

Kristensson

P. O.

(2015). Differentiation of online text-based advertising and the effect on users’ click behavior. Computers in Human Behavior, 50, 535-543.

30.

Khosropour

C. M.

Johnson

B. A.

Ricca

A. V.

Sullivan

P. S.

(2013). Enhancing retention of an Internet-based cohort study of men who have sex with men (MSM) via text messaging: Randomized controlled trial. Journal of Medical Internet Research, 15, e194.

31.

Khosropour

C. M.

Sullivan

P. S.

(2011). Predictors of retention in an online follow-up study of men who have sex with men. Journal of Medical Internet Research, 13, e47.

32.

Lelutiu-Weinberger

Pachankis

J. E.

Gamarel

K. E.

Surace

Golub

S. A.

Parsons

J. T.

(2015). Feasibility, acceptability, and preliminary efficacy of a live-chat social media intervention to reduce HIV risk among young men who have sex with men. AIDS and Behavior, 19, 1214-1227.

33.

Magnini

V. P.

Kim

(2016). The influences of restaurant menu font style, background color, and physical weight on consumers’ perceptions. International Journal of Hospitality Management, 53, 42-48.

34.

Mastin

Andsager

J. L.

Choi

Lee

(2007). Health disparities and direct-to-consumer prescription drug advertising: A content analysis of targeted magazine genres, 1992-2002. Health Communication, 22, 49-58.

35.

Moran

M. B.

Sussman

(2014). Translating the link between social identity and health behavior into effective health communication strategies: An experimental application using antismoking advertisements. Health Communication, 29, 1057-1066.

36.

Mustanski

B. S.

(2001). Getting wired: Exploiting the Internet for the collection of valid sexuality data. Journal of Sex Research, 38, 292-301.

37.

Nash

Stief

MacCrate

Mirzayi

Patel

V. V.

Hoover

. . .Grov

(2019). A web-based study of HIV prevention in the era of pre-exposure prophylaxis among vulnerable HIV-negative gay and bisexual men, transmen, and transwomen who have sex with men: Protocol for an observational cohort study. JMIR Research Protocols, 8, e13715. doi:10.2196/13715

38.

Parsons

J. T.

Vial

A. C.

Starks

T. J.

Golub

S. A.

(2013). Recruiting drug using men who have sex with men in behavioral intervention trials: A comparison of internet and field-based strategies. AIDS and Behavior, 17, 688-699.

39.

Pochun

Brennan

Parker

(2018). Advertising effects? An elemental experiment. Australasian Marketing Journal, 26, 338-349. doi:10.1016/j.ausmj.2018.09.002

40.

Polus

(2016). It’s high seasons for online dating: Plot your moves carefully. Retrieved from https://www.washingtonpost.com/news/soloish/wp/2016/01/01/its-high-season-for-online-dating-plot-your-moves-carefully/?utm_term=.8d6239f9189a

41.

Rendina

H. J.

Breslow

A. S.

Grov

Ventuneac

Starks

T. J.

Parsons

J. T.

(2014). Interest in couples-based voluntary HIV counseling and testing in a national U.S. sample of gay and bisexual men: The role of demographic and HIV risk factors. Archives of Sexual Behavior, 43, 149-159.

42.

Ricca

A. V.

Hall

E. W.

Khosropour

C. M.

Sullivan

P. S.

(2016). Factors associated with returning at-home specimen collection kits for HIV testing among Internet-using men who have sex with men. Journal of the International Association of Providers of AIDS Care, 15, 463-469.

43.

Sanders

Robinson

Taylor

S. C.

Post

S. D.

Goldfarb

Shi

. . .Augustson

E. M.

(2018). Using a media campaign to increase engagement with a mobile-based youth smoking cessation program. American Journal of Health Promotion, 32, 1273-1279.

44.

Sharma

Sullivan

P. S.

Khosropour

C. M.

(2011). Willingness to take a free home HIV test and associated factors among Internet-using men who have sex with men. Journal of the International Association of Physicians in AIDS Care, 10, 357-364.

45.

Silver

(2018). The revolution Steve Jobs resisted: Apple’s App Store marks 10 years of third-party innovation [Web article]. Retrieved from https://appleinsider.com/articles/18/07/10/the-revolution-steve-jobs-resisted-apples-app-store-marks-10-years-of-third-party-innovation

46.

Sineath

R. C.

Finneran

Sullivan

P. S.

Sanchez

Smith

D. K.

Griensven

F. V.

. . .Stephenson

(2013). Knowledge of and interest in using preexposure prophylaxis for HIV prevention among men who have sex with men in Thailand. Journal of the International Association of Providers of AIDS Care, 12, 227-231.

47.

Smith

R. A.

(1991). The effects of visual and verbal advertising information on consumers’ inferences. Journal of Advertising, 20(4), 13-24.

48.

Strasser

A. A.

Tang

K. Z.

Romer

Jepson

Cappella

J. N.

(2012). Graphic warning labels in cigarette advertisements: Recall and viewing patterns. American Journal of Preventive Medicine, 43, 41-47.

49.

Sullivan

P. S.

Khosropour

C. M.

Luisi

Amsden

Coggia

Wingood

G. M.

DiClemente

R. J.

(2011). Bias in online recruitment and retention of racial and ethnic minority men who have sex with men. Journal of Medical Internet Research, 13, e38.

50.

Sun

C. J.

Sutfin

Bachmann

L. H.

Stowers

Rhodes

S. D.

(2018). Comparing men who have sex with men and transgender women who use Grindr, other similar social and sexual networking apps, or no social and sexual networking apps: Implications for recruitment and health promotion. Journal of AIDS & Clinical Research, 9(2), 757. doi:10.4172/2155-6113.1000757

51.

Tajfel

(1982). Social psychology of intergroup relations. Annual Review of Psychology, 33, 1-39.

52.

Tajfel

Billig

M. G.

Bundy

R. P.

Flament

(1971). Social categorization and intergroup behaviour. European Journal of Social Psychology, 1, 149-178.

53.

Topolovec-Vranic

Natarajan

(2016). The use of social media in recruitment for medical research studies: a scoping review. Journal of Medical Internet Research, 18, e286.

54.

Vial

A. C.

Starks

T. J.

Parsons

J. T.

(2014). Finding and recruiting the highest risk HIV-negative men who have sex with men. AIDS Education and Prevention, 26, 56-67.

55.

Vial

A. C.

Starks

T. J.

Parsons

J. T.

(2015). Relative efficiency of field and online strategies in the recruitment of HIV-positive men who have sex with men. AIDS Education and Prevention, 27, 103-111.

56.

Vinjamuri

(2015, December 11). Diversity in advertising is good marketing. Forbes. Retrieved from https://www.forbes.com/sites/davidvinjamuri/2015/12/11/diversityinadsisgoodmarketing/#450f80514248

57.

Winetrobe

Rice

Bauermeister

Petering

Holloway

I. W.

(2014). Associations of unprotected anal intercourse with Grindr-met partners among Grindr-using young men who have sex with men in Los Angeles. AIDS Care, 26, 1303-1308.

58.

Yancey

A. K.

Ortega

A. N.

Kumanyika

S. K.

(2006). Effective recruitment and retention of minority research participants. Annual Review of Public Health, 27, 1-28.

59.

Zou

Fan

(2017). Characteristics of men who have sex with men who use smartphone geosocial networking applications and implications for HIV interventions: A systematic review and meta-analysis. Archives of Sexual Behavior, 46, 885-894.