Sage Journals: Discover world-class research

Abstract

In a rapidly changing public health crisis such as COVID-19, researchers need innovative approaches that can effectively link qualitative approaches and computational methods. In this article, computational and qualitative methods are used to analyze survey data collected in March 2020 (n = 2,270) to explore the content of persuasive messages and their relationship with self-reported health behavior—that is, social distancing. Results suggest that persuasive messages, based on participants’ perspectives, vary by gender and race and are associated with self-reported health behavior. This article illustrates how qualitative analysis and structural topic modeling can be used in synergy in a public health study to understand the public’s perception and behavior related to science issues. Implications for health communication and future research are discussed.

Keywords

computational social science mixed methods research public health research qualitative method science communication

Get full access to this article

View all access options for this article.

References

Alaszewski

(2005). Risk communication: Identifying the importance of social context. Health, Risk & Society, 7(2), 101-105. https://doi.org/10.1080/13698570500148905.

Andrew

(2020, March 24). Some people just won’t stay home during a pandemic: Six reasons may explain why. CNN. https://www.cnn.com/2020/03/24/health/social-distancing-wellness-trnd/index.html

Bai

Yao

Wei

Tian

Jin

D.-Y.

Chen

Wang

(2020). Presumed asymptomatic carrier transmission of COVID-19. Journal of the American Medical Association, 323(14), 1406-1407. https://doi.org/10.1001/jama.2020.2565

Baidoobonso

Bauer

G. R.

Speechley

K. N.

Lawson

BLACCH Study Team (2013). HIV risk perception and distribution of HIV risk among African, Caribbean and other Black people in a Canadian city: Mixed methods results from the BLACCH study. BMC Public Health, 13, Article 184. https://doi.org/10.1186/1471-2458-13-184

Baumer

E. P. S.

Mimno

Guha

Quan

Gay

G. K.

(2017). Comparing grounded theory and topic modeling: Extreme divergence or unlikely convergence? Journal of the Association for Information Science and Technology, 68(6), 1397-1410. https://doi.org/10.1002/asi.23786

Bazeley

(2012). Integrative analysis strategies for mixed data sources. American Behavioral Scientist, 56(6), 814-828. https://doi.org/10.1177/0002764211426330

Blei

D. M.

A. Y.

Jordan

M. I.

(2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3(4-5), 993-1022.

Braun

Clarke

(2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa

Brewer

Hunter

(2006). Foundations of multimethod research: Synthesizing styles (2nd ed.). Sage. https://doi.org/10.4135/9781412984294

10.

Brewer

N. T.

Chapman

G. B.

Gibbons

F. X.

Gerrard

McCaul

K. D.

Weinstein

N. D.

(2007). Meta-analysis of the relationship between risk perception and health behavior: The example of vaccination. Health Psychology, 26(2), 136-145. https://doi.org/10.1037/0278-6133.26.2.136

11.

Bryman

(2006). Integrating quantitative and qualitative research: How is it done? Qualitative Research, 6(1), 97-113. https://doi.org/10.1177/1468794106058877

12.

Caleo

Duncombe

Jephcott

Lokuge

Mills

Looijen

Theoharaki

Kremer

Kleijer

Squire

Lamin

Stringer

Weiss

H. A.

Culli

Di Tanna

G. L.

Greig

(2018). The factors affecting household transmission dynamics and community compliance with Ebola control measures: A mixed-methods study in a rural village in Sierra Leone. BMC Public Health, 18(1), Article 248. https://doi.org/10.1186/s12889-018-5158-6

13.

Campbell

M. R.

Brauer

(2020). Social marketing campaigns to address social problems. In Gurung

R. A. R.

(Ed.), The Routledge research encyclopedia of psychology applied to everyday life (pp. 608-629). Routledge.

14.

Centers for Disease Control and Prevention. (2018). CERC: Messages and audiences. https://emergency.cdc.gov/cerc/ppt/CERC_Messages_and_Audiences.pdf?fbclid=IwAR0a_eKfiSUIu7EJetxitNyubvqpu3-Q3YXYW6wD0cjdJhgWBSW6QV-v-_k

15.

Centers for Disease Control and Prevention. (2020). Social distancing. https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/social-distancing.html

16.

Centers for Disease Control and Prevention. (2021, February 5). Provisional death counts for coronavirus disease (COVID-19). https://www.cdc.gov/nchs/nvss/vsrr/covid19/index.htm

17.

Champion

Skinner

C. S.

(2008). The health belief model. In Glanz

Rimer

B. K.

Viswanath

(Eds.), Health behavior and health education: Theory, research, and practice (4th ed., pp. 45-65). Jossey-Bass.

18.

Chen

(2021). How deliberative designs empower citizens’ voices: A case study on Ghana’s deliberative poll on agriculture and the environment. Public Understanding of Science, 30(2), 179-195. https://doi.org/10.1177/0963662520966742

19.

Chen

Bao

Shao

Yang

Wirz

Brossard

Brauer

Diprete Brown

(2020). How public perceptions of social distancing evolved over a critical time period: Communication lessons learnt from the American state of Wisconsin. Journal of Science Communication, 19(5), Article 11. https://doi.org/10.22323/2.19050211

20.

Clipman

S. J.

Wesolowski

A. P.

Gibson

D. G.

Agarwal

Lambrou

A. S.

Kirk

G. D.

Labrique

A. B.

Mehta

S. H.

Solomon

S. S.

(2020). Rapid real-time tracking of non-pharmaceutical interventions and their association with SARS-CoV-2 positivity: The COVID-19 Pandemic Pulse Study. Clinical Infectious Diseases. Advance online publication. https://doi.org/10.1093/cid/ciaa1313

21.

Coroiu

Moran

Campbell

Geller

A. C.

(2020). Barriers and facilitators of adherence to social distancing recommendations during COVID-19 among a large international sample of adults. PLoS ONE, 15(10), e0239795. https://doi.org/10.1371/journal.pone.0239795

22.

Cummins

(2020, July 2). A likely culprit in Covid-19 surges: People hell-bent on ignoring social distancing orders. Vox. https://www.vox.com/the-highlight/2020/3/24/21191184/coronavirus-social-distancing-pandemic-spring-breakkeep-calm-carry-on

23.

Dietz

(2013). Bringing values and deliberation to science communication. Proceedings of the National Academy of Sciences of the United States of America, 110(Suppl. 3), 14081-14087. https://doi.org/10.1073/pnas.1212740110

24.

Duff

(2003). The importance of culture and context: Rethinking risk and risk management in young drug using populations. Health, Risk & Society, 5(3), 285-299. https://doi.org/10.1080/13698570310001606987

25.

Evans

M. S.

(2014). A computational approach to qualitative analysis in large textual datasets. PLOS ONE, 9(2), e87908. https://doi.org/10.1371/journal.pone.0087908

26.

Ferrer

R. A.

Klein

W. M.

(2015). Risk perceptions and health behavior. Current Opinion in Psychology, 5(October), 85-89. https://doi.org/10.1016/j.copsyc.2015.03.012

27.

Fetters

M. D.

Curry

L. A.

Creswell

J. W.

(2013). Achieving integration in mixed methods designs: Principles and practices. Health Services Research, 48(6, Pt 2), 2134-2156. https://doi.org/10.1111/1475-6773.12117

28.

Fetters

M. D.

Freshwater

(2015). The 1 + 1 = 3 integration challenge. Journal of Mixed Methods Research, 9(2), 115-117. https://doi.org/10.1177/1558689815581222

29.

Fetters

M. D.

Molina-Azorin

J. F.

(2017). The Journal of Mixed Methods Research starts a new decade: The mixed methods research integration trilogy and its dimensions. Journal of Mixed Methods Research, 11(3), 291-307. https://doi.org/10.1177/1558689817714066

30.

Fishkin

J. S.

(2018). Democracy when the people are thinking: Revitalizing our politics through public deliberation. Oxford University Press.

31.

Ghinai

(2020). Community transmission of SARS-CoV-2 at two family gatherings: Chicago, Illinois, February–March 2020. Morbidity and Mortality Weekly Report, 69(15), 446-450. https://doi.org/10.15585/mmwr.mm6915e1

32.

Glanz

Carey

Holder

Watkins

Valentino-DeVries

Rojas

Leatherby

(2020, April 2). Where America didn’t stay home even as the virus spread. The New York Times. https://www.nytimes.com/interactive/2020/04/02/us/coronavirus-social-distancing.html

33.

Greene

J. C.

Caracelli

V. J.

Graham

W. F.

(1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274. https://doi.org/10.3102/01623737011003255

34.

Grimmer

Roberts

M. E.

Stewart

B. M.

(2021). Text as data: A new framework for machine learning and the social sciences. Princeton University Press.

35.

Grimmer

Stewart

B. M.

(2013). Text as data: The promise and pitfalls of automatic content analysis methods for political texts. Political Analysis, 21(3), 267-297. https://doi.org/10.1093/pan/mps028

36.

Guetterman

T. C.

Fetters

M. D.

Creswell

J. W.

(2015). Integrating quantitative and qualitative results in health science mixed methods research through joint displays. Annals of Family Medicine, 13(6), 554-561. https://doi.org/10.1370/afm.1865

37.

Günther

Quandt

(2016). Word counts and topic models: Automated text analysis methods for digital journalism research. Digital Journalism, 4(1), 75-88. https://doi.org/10.1080/21670811.2015.1093270

38.

Isoaho

Gritsenko

Mäkelä

(2021). Topic modeling and text analysis for qualitative policy research. Policy Studies Journal, 49(1), 300-324. https://doi.org/10.1111/psj.12343

39.

Janz

N. K.

Becker

M. H.

(1984). The health belief model: A decade later. Health Education Quarterly, 11(1), 1-47. https://doi.org/10.1177/109019818401100101

40.

Kreuter

Farrell

Olevitch

Brennan

(2000). Tailoring health messages: Customizing communication with computer technology (LEA’s Communication Series.). Lawrence Erlbaum. https://doi.org/10.4324/9781410603319

41.

Lee

N. R.

Kotler

(2019). Social marketing: Behavior chance for social good (6th ed.). Sage.

42.

Leech

N. L.

Onwuegbuzie

A. J.

(2009). A typology of mixed methods research designs. Quality & Quantity, 43(2), 265-275. https://doi.org/10.1007/s11135-007-9105-3

43.

Lewis

S. C.

Zamith

Hermida

(2013). Content analysis in an era of Big Data: A hybrid approach to computational and manual methods. Journal of Broadcasting & Electronic Media, 57(1), 34-52. https://doi.org/10.1080/08838151.2012.761702

44.

Lewnard

J. A.

N. C.

(2020). Scientific and ethical basis for social-distancing interventions against COVID-19. Lancet: Infectious Diseases, 20(6), 631-633. https://doi.org/10.1016/S1473-3099(20)30190-0

45.

Mills

M. C.

Salisbury

(2020). The challenges of distributing COVID-19 vaccinations. EClinicalMedicine, 31, 100674. https://doi.org/10.1016/j.eclinm.2020.100674

46.

National Academies of Sciences, Engineering, and Medicine. (2020). Encouraging adoption of protective behaviors to mitigate the spread of COVID-19: Strategies for behavior change. National Academies Press. https://doi.org/10.17226/25881

47.

Nicholls

Culpepper

P. D.

(2021). Computational identification of media frames: Strengths, weaknesses, and opportunities. Political Communication, 38(1-2), 159-181. https://doi.org/10.1080/10584609.2020.1812777

48.

O’Connor

P. J.

Martin

Weeks

C. S.

Ong

(2014). Factors that influence young people’s mental health help-seeking behaviour: A study based on the health belief model. Journal of Advanced Nursing, 70(11), 2577-2587. https://doi.org/10.1111/jan.12423

49.

Onwuegbuzie

A. J.

Frels

R. K.

(2016). Seven steps to a comprehensive literature review: A multimodal and cultural approach. Sage.

50.

Ophir

Walter

Marchant

E. R.

(2020). A collaborative way of knowing: Bridging computational communication research and grounded theory ethnography. Journal of Communication, 70(3), 447-472. https://doi.org/10.1093/joc/jqaa013

51.

Patrick

Stanbrook

M. B.

Laupacis

(2020). Social distancing to combat COVID-19: We are all on the front line. CMAJ: Canadian Medical Association Journal (Journal de l’Association Medicale Canadienne), 192(19), E516-E517. https://doi.org/10.1503/cmaj.200606

52.

Plow

Moore

S. M.

Sajatovic

Katzan

(2017). A mixed methods study of multiple health behaviors among individuals with stroke. PeerJ: Life & Environment, 5, e3210. https://doi.org/10.7717/peerj.3210

53.

Rafei

(2020). Changing global scenario and public health for the next millennium: Keynote address. Journal of Health & Population in Developing Countries, 3(1), 8-12. https://doi.org/10.12927/whp..17521

54.

Raisio

(2010). The public as policy expert: Deliberative democracy in the context of Finnish health care reforms and policies. Journal of Public Deliberation, 6(2), Article 6. https://doi.org/10.16997/jdd.111

55.

Rittel

H. W. J.

Webber

M. M.

(1973). Dilemmas in a general theory of planning. Policy Sciences, 4(2), 155-169. https://doi.org/10.1007/BF01405730

56.

Roberts

M. E.

Stewart

B. M.

Tingley

(2019). stm: An R package for structural topic models. Journal of Statistical Software, 91(1), 1-40. https://doi.org/10.18637/jss.v091.i02

57.

Roberts

M. E.

Stewart

B. M.

Tingley

Lucas

Leder-Luis

Gadarian

S. K.

Albertson

Rand

D. G.

(2014). Structural topic models for open-ended survey responses. American Journal of Political Science, 58(4), 1064-1082. https://doi.org/10.1111/ajps.12103

58.

Rosenstock

I. M.

(1974). The health belief model and preventive health behavior. Health Education Monographs, 2(4), 354-386. https://doi.org/10.1177/109019817400200405

59.

Saldaña

(2016). The coding manual for qualitative researchers (3rd ed.). Sage.

60.

Scheufele

D. A.

Krause

N. M.

Freiling

Brossard

(2020, April 17). How not to lose the COVID-19 communication war. Issues in Science and Technology. https://issues.org/covid-19-communication-war/

61.

Schmid

K. L.

Rivers

S. E.

Latimer

A. E.

Salovey

(2008). Targeting or tailoring? Marketing Health Services, 28(1), 32-37.

62.

Sheeran

Abraham

(1996). The health belief model. In Conner

Norman

(Eds.), Predicting health behaviour: Research and practice with social cognition models (pp. 23-61). Open University Press.

63.

Tashakkori

Creswell

J. W.

(2007). Editorial: Exploring the nature of research questions in mixed methods research. Journal of Mixed Methods Research, 1(3), 207-211. https://doi.org/10.1177/1558689807302814

64.

Tashakkori

Teddlie

(2010). Putting the human back in “human research methodology”: The researcher in mixed methods research. Journal of Mixed Methods Research, 4(4), 271-277. https://doi.org/10.1177/1558689810382532

65.

Teddlie

Tashakkori

(2009). Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences. Sage.

66.

Thomas

D. R.

(2006). A general inductive approach for analyzing qualitative evaluation data. American Journal of Evaluation, 27(2), 237-246. https://doi.org/10.1177/1098214005283748

67.

Venkatesh

Brown

S. A.

Bala

(2013). Bridging the qualitative–quantitative divide: Guidelines for conducting mixed methods research in information systems. MIS Quarterly, 37(1), 21-54. https://doi.org/10.25300/MISQ/2013/37.1.02

68.

Vogl

(2019). Integrating and consolidating data in mixed methods data analysis: Examples from focus group data with children. Journal of Mixed Methods Research, 13(4), 536-554. https://doi.org/10.1177/1558689818796364

69.

Wallach

H. M.

Murray

Salakhutdinov

Mimno

(2009, June). Evaluation methods for topic models. In Danyluk

Bottou

Littman

(Eds.), ICML ’09: Proceedings of the 26th Annual International Conference on Machine Learning (pp. 1105-1112). Association for Computing Machinery. https://doi.org/10.1145/1553374.1553515

70.

Wee

L. E.

Conceicao

E. P.

Sim

X. Y. J.

Aung

M. K.

Tan

K. Y.

Wong

H. M.

Wijaya

Tan

B. H.

Ling

M. L.

Venkatachalam

(2020). Minimising intra-hospital transmission of COVID-19: The role of social distancing. Journal of Hospital Infection, 105(2), 113-115. https://doi.org/10.1016/j.jhin.2020.04.016

71.

Wilder-Smith

Freedman

D. O.

(2020). Isolation, quarantine, social distancing and community containment: Pivotal role for old-style public health measures in the novel coronavirus (2019-nCoV) outbreak. Journal of Travel Medicine, 27(2). https://doi.org/10.1093/jtm/taaa020

72.

World Health Organization. (2020a, March 11). Coronavirus disease 2019 (COVID-19) situation report-51. https://www.who.int/publications/m/item/situation-report—51

73.

World Health Organization. (2020b). Tracking public health and social measures: A global dataset. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/phsm

74.

Wright

P. J.

Randall

A. K.

Hayes

J. G.

(2012). Predicting the condom assertiveness of collegiate females in the United States from the expanded health belief model. International Journal of Sexual Health, 24(2), 137-153. https://doi.org/10.1080/19317611.2012.661396

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.23 MB

A Mixed Methods Study of Public Perception of Social Distancing: Integrating Qualitative and Computational Analyses for Text Data

Abstract

Keywords

Get full access to this article

References

Supplementary Material