Sage Journals: Discover world-class research

Abstract

Objectives:

This study was conducted to assess an intervention that was created by a community–academic partnership to address COVID-19 health inequities. We evaluated a community-engaged bidirectional pandemic crisis and emergency risk communication (CERC) framework with immigrant and refugee populations during the COVID-19 pandemic.

Methods:

A 17-year community-engaged research partnership adopted a CERC framework in March 2020 to address COVID-19 prevention, testing, and socioeconomic impacts with immigrant and refugee groups in southeast Minnesota. The partnership used bidirectional communication between communication leaders and their social networks to refine messages, leverage resources, and advise policy makers. We conducted a mixed-methods evaluation for intervention acceptability, feasibility, reach, adaptation, and sustainability through multisource data, including email communications, work group notes, semistructured interviews, and focus groups.

Results:

The intervention reached at least 39 000 people in 9 months. It was implemented as intended and perceived efficacy was high. Frequent communication between community and academic partners allowed the team to respond rapidly to concerns and facilitated connection of community members to resources. Framework implementation also led to systems and policy changes to meet the needs of immigrant and refugee populations.

Conclusions:

Community-engaged CERC is feasible and sustainable and can reduce COVID-19 disparities through shared creation and dissemination of public health messages, enhanced connection to existing resources, and incorporation of community perspectives in regional pandemic mitigation policies.

Keywords

risk communication immigrant and refugee health community-based participatory research community-engaged research COVID-19

Crisis and emergency risk communication (CERC) frameworks encourage public participation in pandemic prevention and containment,^1,2 but effective implementation depends, in part, on reaching populations with a history of health disparities and limited access to culturally and linguistically tailored health information. Racial and ethnic minority groups have been disproportionately impacted by COVID-19^3,4 and are susceptible to experiencing communication gaps,⁵ compounded by cultural discordance and mistrust of health institutions.⁶ These community perspectives have not been well represented in the development and implementation of COVID-19 CERC, leading to reduced agency of communities to address mitigation strategies, thereby contributing to health disparities.^7,8 These barriers indicate that a high level of community engagement is needed to reach populations in times of crisis.¹ Community-engaged CERC has the potential to reduce COVID-19 disparities through shared creation and dissemination of health messages, enhanced connection to existing resources, and incorporation of community voices in pandemic mitigation policies.⁹

The Centers for Disease Control and Prevention (CDC) has not collected demographic data on citizenship or place of birth for COVID-19 incidence and outcomes, which prevents analysis of national data for pandemic impact on immigrant populations. However, regional studies have demonstrated that immigrant groups experienced disproportionate impacts from COVID-19, including lower testing rates, higher test positivity rates, and higher incidence rates than non-immigrant groups.^10,11 Studies from other high-income countries have demonstrated high mortality attributed to COVID-19 among immigrant groups.^12,13 Refugees to high-income countries have experienced amplified barriers to health care, economic support, education, and social support during the pandemic.¹⁴ Taken as a whole, immigrant groups in the United States are disproportionately susceptible to COVID-19 and its complications because of limited English proficiency, low access to health care, fear of legal repercussions, employment in sectors where remote working is not possible, and crowded living conditions.¹⁵ Likewise, immigrant groups are susceptible to economic fallout from the pandemic, including loss of employment, lower access to unemployment benefits, and food and housing insecurity.¹⁵ Finally, some immigrant groups face the compounding impact of xenophobia¹⁶ and raids on immigrant communities.¹⁷

Community-engaged research (CEnR) partnerships are uniquely positioned to operationalize pandemic CERC among groups at risk for health disparities, including immigrants and refugees. CEnR partnerships, characterized by collaboration between community members and researchers through all phases of research, are increasingly ubiquitous in the United States.¹⁸ They have organizational and technical capacity for interfacing with target populations in a research and evaluation context.¹⁹

This study includes the description of a 17-year CEnR partnership adopting a bidirectional CERC framework in March 2020 to address COVID-19 prevention, testing, and socioeconomic impact in immigrant and refugee groups in Olmsted County, Minnesota, where 14% of the population is documented as non–US-born.²⁰ Bidirectional communication between communication leaders and their social networks was used to refine messages, leverage resources, and advise policy makers. We previously described our experience with the first 14 days of the intervention in March 2020, during which messages were delivered by 24 communication leaders in 6 languages across 9 virtual platforms to 9882 immigrants and refugees within their networks.²¹ Here, we present an in-depth, mixed-methods evaluation of the intervention after 9 months of implementation, focusing on acceptability, reach, perceived efficacy, and sustainability.

Methods

CEnR Partnership Narrative

In 2004, a community–academic partnership developed between Mayo Clinic and an adult education center that primarily serves people of color, most of whom are new immigrants and refugees. This partnership matured by formalizing operating norms, adopting community-based participatory research principles, and adding partners from multiple sectors.²² Rochester Healthy Community Partnership (RHCP) developed an effective community-based research infrastructure that has facilitated extensive research training for community partners.^23,24 RHCP adapted an empirically derived community-based participatory research conceptual model through in-depth evaluation.²⁵ Community and academic partners jointly conduct every phase of research, disseminate results, implement sustainability plans together, and coauthor scientific products (eg, articles, presentations, policy briefs).^26-28

At the start of the COVID-19 pandemic, RHCP community partners observed that credible COVID-19 information was not reaching immigrant communities. In March 2020, RHCP formed a community-based COVID-19 work group and adopted the CDC CERC framework for co-creation of an intervention targeting African and Hispanic immigrant populations. The work group consisted of 24 communication leaders representing 6 ethnic and community partner groups (Somali, Anuak, Cambodian, Hispanic, Ethiopian, and South Sudanese), academic partners, and county and city officials. All intervention components were informed directly by community priorities, and RHCP community partners co-created the intervention framework and evaluation strategy. Initially, communication leaders volunteered their time with RHCP. As funding was secured for the initiative, communication leaders were compensated for their time.

Intervention Framework

The intervention included communication and health assessment strategies driven by bidirectional CEnR (Figure 1). Communication strategies centered on COVID-19 message maps,²⁹ jointly developed by RHCP community and academic partners across 3 constructs: COVID-19 prevention and containment, SARS-CoV-2 testing, and social and economic impacts of COVID-19. Communication leaders were recruited by RHCP community partners to deliver messages. COVID-19 messages were delivered by bilingual communication leaders in their social networks. Because of physical distancing, messages were mostly delivered virtually. Communication leaders used the channels most appropriate for their communities (eg, voice calls, text messaging, social media). Recipients were encouraged to amplify messages to their social networks. Communication leaders solicited feedback on health and socioeconomic concerns through the same platforms. Communication leaders and RHCP partners had regular teleconferences (daily, then biweekly, now weekly) for 3 purposes. First, communication leaders shared their progress on emerging best practices. Second, message refinement and generation of new messages was achieved in response to community feedback and rapidly changing facts. Third, questions were answered in real time by infectious disease experts (academic partners) or community resource experts (community partners). Feedback was used to inform regional decision makers.

Figure 1.

Bidirectional COVID-19 crisis and emergency risk communication framework. Adapted from Wieland et al.²¹

Program Evaluation

To assess the forces that shaped intervention implementation, we conducted a mixed-methods evaluation of acceptability, feasibility, reach, adaptation, and sustainability. The evaluation interval was March 2020–January 2021 (9 months).

Data Sources

Emails

Email communication between members of the RHCP COVID-19 work group was accessed on the email platform used by academic, public health, and community partners to provide information about community resources and related information and updates. As of January 2021, 63 RHCP partners were on the email platform. Email content included new and revised COVID-19 co-created messages, questions and concerns about COVID-19 or work group processes (representing questions from social network members), and information about new and evolving community resources. All emails from March 2020 through January 2021 were collated for analysis.

RHCP COVID-19 work group meeting notes

During work group meetings, communication leaders shared their progress in disseminating messages, as well as concerns and questions curated from their social networks. Problem solving occurred in real time. Meetings were recorded and notes were taken.

Reflection interviews

Guided virtual reflections³⁰ with communication leaders were used to understand the intervention process as it unfolded. Reflections started as weekly interviews and later evolved into biweekly meetings that documented events across the life cycle of the intervention efforts, capturing information on context and unfolding processes for dissemination, adaptation, and improvement ideas. The reflection interview guide was developed based on relevant evaluation (adaptation, feasibility, acceptability, and sustainability) and CEnR constructs^18,31 (motivations, partnership and engagement, empowerment and participation). Communication leaders were asked about key factors that facilitated or impeded the implementation and delivery process. Twenty communication leader reflection interviews were conducted: Somali (n = 5), South Sudanese (n = 3), Hispanic (n = 4), Cambodian (n = 5), and Ethiopian (n = 3). All reflections were audio recorded and notes were taken.

Postimplementation focus groups

To assess the perceived effectiveness and sustainability of the intervention from the communication leaders’ point of view, 3 focus groups representing 6 language groups were conducted. A focus group guidebook included questions on evidence of success, perceived efficacy and feasibility, sustainability, and opportunities for scalability, following previous study methods.^32,33 Focus groups were recorded, transcribed, and reviewed.

Communication leader tracking sheets

Each communication leader completed a weekly tracking sheet, which included structured and open-text fields to document intervention reach and engagement activities using various mediums and communication mechanisms. All tracking sheets were collated into a spreadsheet for analysis.

Program sustainability was explored throughout the intervention from all data sources listed previously to understand sustainability and scalability concepts in the community-engaged COVID-19 CERC framework for tailored intervention.

Data Analysis

We analyzed qualitative data using a rapid analysis approach,^34-36 whereby we summarized each data source using a template of domains and then generated matrices from the summaries. For data domains, we generated matrices from summaries of emails, reflection interviews, and meetings. Themes and directions for further intervention refinement were identified and categorized into key activities of communication leaders, community response and concerns, strategies that were working, new strategies to be adapted, and recommendations from the work group. Tracking sheets were collated; reach and engagement were quantified by language groups and communication mediums using descriptive statistics.

A final stage of confirmatory analysis was established by a participatory interpretation approach via 3 consecutive “data walk” (an interactive way for community partners to engage with research findings)^37,38 presentations with academic partners and communication leaders. Results from multiple data domains were presented within the framework of process evaluation adapted from Moore and colleagues³⁹ to achieve a robust analysis and understanding of intervention efforts, implementation processes, and mechanisms of impact (Figure 2). Data walks were presented according to each data domain (work group meetings, reflection interviews, emails, and tracking), which allowed the study team to consider all aspects and implications and to adjust intervention efforts while making recommendations intentional and enriching the CEnR process. A list of observations and suggestions was compiled to refine and reframe data for subsequent data walks. As a result, study findings encompassed the evolution of work group efforts as the pandemic progressed, as well as framework dissemination and the relational engagement and empowerment that were otherwise challenging to quantify.

Figure 2.

Process evaluation for assessing community-engaged research partnerships for crisis and emergency risk communication (CERC) to immigrant and refugee populations during the COVID-19 pandemic. Adapted from Moore et al.³⁹ Abbreviation: CDC, Centers for Disease Control and Prevention.

Results

Findings and outcomes resulted from more than 400 emails, summaries of 32 recorded work group meetings, 20 reflection interviews, and 3 postimplementation focus groups.

Acceptability, Feasibility, and Perceived Efficacy

Communication leaders had overall positive perceptions about the RHCP COVID-19 intervention. They indicated that RHCP was a trusted and credible information source of COVID-19 information. Community members became well informed on COVID-19 and learned how to take precautionary measures to protect themselves and their community. Continued engagement in work group meetings, which received a wide range of representation from the community, attendance from public health experts, city and county officials, and neighboring county officials, occurred over time.

The intervention was implemented as intended. Feasibility was supported by documentation of strategies for implementation, which were mapped to the CDC CERC framework and reported previously. Community concerns addressed through real-time access to RHCP partners and government officials included unemployment issues, economic burdens, and strategies to reach particularly hard-to-reach populations (eg, elderly members of the community who resided alone). Addressing these concerns enhanced the community’s information-seeking behaviors as community members looked to their community leaders and RHCP for assistance on COVID-19–related information.

Reach and Engagement

During a 6-month period, COVID-19 messages were delivered by 24 communication leaders in 7 languages (Somali, Anuak, Khmer, Amharic, Arabic, Spanish, and English) to 6 ethnic groups’ (Somali, Hispanic, Cambodian, Anuak, South Sudanese, and Ethiopian) social and individual networks using various mechanisms and mediums (Table 1). The intervention delivered to targeted populations reached 39 875 people. Communication leaders said that messages delivered in their native languages reached a wide range of audience members who would otherwise not have received information. Interview data showed that social media reach (estimated number of people who were exposed to messages) was higher than engagement (estimated number of people who acted on the content) (Table 1). Communication leaders reported that social media engagement was not an accurate reflection of how community members engaged with the intervention, as many community members did not engage on social media platforms. However, communication leaders reported that community members frequently acknowledged (via text message, telephone call, etc.) seeing the messages and acting on a resource or suggestion from the message.

Table 1.

Reach and engagement of a bidirectional COVID-19 crisis and emergency risk communication intervention among immigrants and refugees, by language group, Minnesota, March 2020–January 2021

Communication medium	Reach^a and engagement^b	Language
Communication medium	Reach^a and engagement^b	Anuak	Khmer	Amharic	Spanish	Somali	Arabic	English	Total
Email^d	Reach	—^c	—^c	—^c	217	19	—^c	603	839
Facebook	Reach	200	4695	998	11 169	3724	10 200	681	31 667
Facebook	Engagement	80	70	456	942	161	629	418	2756
Group Facebook	Reach	—^c	—^c	—^c	2255	—^c	—^c	—^c	2255
Group Facebook	Engagement	—^c	—^c	—^c	124	—^c	—^c	—^c	124
Messenger	Reach	—^c	—^c	—^c	101	—^c	—^c	—^c	101
Messenger	Engagement	—^c	—^c	—^c	68	—^c	—^c	—^c	68
In person	Reach	—^c	40	—^c	—^c	418	—^c	—^c	458
In person	Engagement	—^c	—^c	—^c	—^c	—^c	—^c	—^c	0
Instagram	Reach	—^c	—^c	—^c	252	119	—^c	—^c	371
Instagram	Engagement	—^c	—^c	—^c	20	7	—^c	—^c	27
Telephone call	Reach	15	—^c	6	28	1791	2	—^c	1842
Telephone call	Engagement^c	—^c	—^c	—^c	—^c	—^c	—^c	—^c	0
Text message	Reach	—^c	—^c	—^c	88	81	57	—^c	226
Text message	Engagement	—^c	—^c	—^c	20	—^c	3	—^c	23
Viber	Reach	—^c	—^c	228	—^c	—^c	—^c	160	388
Viber	Engagement	—^c	—^c	190	—^c	—^c	—^c	90	280
Zoom	Reach	—^c	—^c	—^c	21	—^c	—^c	—^c	21
Zoom	Engagement	—^c	—^c	—^c	5	—^c	—^c	—^c	5
WhatsApp	Reach	—^c	45	—^c	269	1210	183	—^c	1707
WhatsApp	Engagement	—^c	—^c	—^c	18	10	—^c	—^c	28
Total	Reach	—^c	—^c	—^c	—^c	—^c	—^c	—^c	39 875
Total	Engagement	—^c	—^c	—^c	—^c	—^c	—^c	—^c	3311

Number of unique people who saw any content on the communication medium.

Number of actions (eg, likes, loves, comments, responses, shares, video views, post clicks) that people completed on communication mediums.

Not applicable.

Engagement was not a measurable construct for emails.

Interviews and focus group data demonstrated that elements of engagement and growth were seen for individual communication leaders by spending time forging relationships with other communication leaders as they reached out to each other for support to address community concerns. Communication leaders became more engaged, motivated, and empowered to provide consultations in their communities knowing they had direct access to peers and health experts.

Adaptation

Interviews and focus group data showed that reflection interviews, emails, and work group meetings provided real-time feedback to refine messaging, streamline processes, and curate community concerns. Feedback resulted in changes to intervention processes and improvements in provision of essential services (food, housing, health). Communication leaders learned through the process how to reach their communities and networks using different mediums and messaging styles. Although social media platforms worked for some, others noted that direct conversations, face-to-face communication, and telephone calls had more impact.

Sustainability

During a 9-month period, sustainability was facilitated by commitment to partnership history and bidirectional communication between communication leaders and academic partners, as well as by the development of work groups that focused on evolving needs. These work groups included a message creation work group; RHCP COVID-19 social media group to supplement communication leader dissemination at the level of individual social networks; RHCP COVID-19 coalition that focused on outreach to adolescents and young adults; and a work group to connect COVID-19–positive patients to an RHCP-partnered community-based organization for assessment and provision of essential services. Communication leaders attested that they now feel prepared for future pandemics (Table 2).

Table 2.

Outcomes and exemplar quotes from a bidirectional COVID-19 crisis and emergency risk communication intervention among immigrants and refugees in Minnesota, March 2020–January 2021

Outcome category and description	Exemplar quotes from communication leaders
Acceptability and feasibility
Acceptability and feasibility were facilitated by trust and credibility that have been built with RHCP over time, which facilitated a rapid pandemic response.	I know for sure from the groups that I share information that they have a—they really trust RHCP. They trust that the information that we are giving is information that comes from science. It’s not just something that we are inventing. It’s something serious. When we provide the information to our community members, being partnered with RHCP and the information is coming from them increases the credibility of the information and also that, like, they feel confident in the information we’re giving them. So what I know, in my community, the people working on Somali Task Force . . . and other people, they trust us and they understand whether we tell them it’s true and that is why they stand with us. . . . We have good receptivity and trust between our community. RHCP has displayed needed leadership during this time. If RHCP did not come up with the idea of bringing us together and reaching out to the different groups, we would not have known how to reach out to our communities and disseminate the information. Once RHCP put together the package, it made it easy. Anytime you put forward strategies and they work it is wonderful. . . . Without the strategies, none of the leaders would have this success.
Reach and engagement
Communication leaders felt empowered to reach out broadly to their social networks because of several factors: 1. Co-created COVID-19 messages were accurate, timely, and tailored to language and culture. 2. Questions that emerged from their social networks would be answered within 1 week at work group meetings. More urgent questions could be answered sooner through the work group. 3. Communication leaders felt supported by each other. They developed a broad community approach that cut across cultures. Suggestions from communication leaders and their network members were often translated into public health practice in the community.	So it was good that we had this platform and these connections and this information because I was not feeling empowered to give that information myself. But getting the information from some scientists and some experts, I think it was important for me to start from something. Well, I hear from people that they were able to use the information that we have in the fliers, such as phone numbers and addresses to know where . . . testing is done. So and even one connector said, “I told . . . the people that I connect to, if anybody gets sick, I know who to contact to help you.” And then, to me, it is a great experience I got from RHCP to make a connection with the community, [now] I’m involved with the diversity council because of RHCP and then also with several organizations. I am learning a lot because [I first started from] RHCP, the door opened for me, and then I did that all. I have people privately message me, “Hey, I have COVID and I’m nursing, what do I do?” I message [name of medical expert on taskforce] and [I get their] expert advice. . . . So my impression is I think we’re well-prepared than any other community because I have friends in Twin Cities, and they’re still struggling to find resources, but we’re well set in many ways—information, finance, anything. The information from the task force is really doing a wonderful job for all the communities as well as Sudanese. They are learning a lot, too, from their friends who are Somalian because the Somalian are well-informed . . . they share the information, which really worked really well for us. Knowing that they’re applying the information that you give them . . . they don’t have to come to you all the time, but you listed those phone numbers and they’re—they know where to go. I’ve had people saying, “Hey, I didn’t know about that extra food stamp that I could have applied for my kids. After you posted, I did that and I told someone.”
Adaptation
The RHCP COVID-19 work group met frequently, which facilitated real-time adaptation of the intervention, including changes to messages based on concerns shared with the work group as well as development of community systems to support immigrant and refugee communities during the pandemic.	I may not know everything, but I may know where to find the answers. That’s something that we have learned [as] tools so we can teach ourselves and teach others. And once I found out about RHCP, slowly I transitioned to RHCP [work] group, and we created—we formed our own. [Questions like] “Can I get coronavirus a second time?” That shows that the community has already experienced this and are moving forward and the concern is what is going to happen after. At first it was said that the older people were most vulnerable, but the young are noticing that their friends are getting sick. Unfortunately, they do not have health insurance and did not know they could get tested. [Communication leaders] let them know where to go that would be free. There are reports of companies [name of company] minimizing the number of cases in order to keep the industry going. Positive people pass virus to the rest of the family because they live in a 2-bed[room] apartment with 6 to 7 people and they do not have an area to quarantine in the house. Positive person was willing to move but social worker called and there were no hotels willing to accept him, so he cannot be taken from home. . . . People are not picking up their phones when they are trying to be reached for follow-up. It has also been hard to find shelter because the hotel that was going to house people backed out.
Sustainability
RHCP served as a source of strength for communication leaders and enhanced community ownership of the intervention to address community concerns.	What we have gained is that even in our differences, that we had come up with the right attitude that we are helping those who are in need. . . . Our mission and the document [new work group roles] that I was sharing came out [of the COVID-19 taskforce] that we are in a sisterhood or brotherhood of immigrants, that we need to help each other. Without the COVID-19 [taskforce] many people [won’t] understand what to do, where to go, when they have fever or want testing, what to do [when] they are sick. . . . So now . . . they have knowledge, and they know what they’re doing, and they know where they’re going, and they know who will contact them when they need help.

Abbreviation: RHCP, Rochester Healthy Community Partnership.

RHCP served as a source of strength for communication leaders, enabling community ownership of the intervention. The intervention facilitated a sense of empowerment in addressing community concerns. Opportunities to improve sustainability included the following:

Consistent funding to support communication leaders’ work and recruit more communication leaders.

A simplified tracking system with less time burden for communication leaders.

Defined roles and expectations for communication leaders and community partners early in the process.

Creation of a system/database that captures and documents community concerns, solutions, and resources in real time.

Building on existing RHCP trusting relationships to expand outreach efforts via other networks to avoid overlapping community efforts.

Discussion

This mixed-methods program evaluation described the feasibility, acceptability, reach, perceived efficacy, and 9-month sustainability of a community-engaged bidirectional CERC intervention with immigrant and refugee populations during the COVID-19 pandemic. Because sociocultural factors, personal control, trust in institutions, and multisource misinformation all shape reception of CERC messaging,⁴⁰ we also documented adaptations to the intervention that occurred in real time to account for the rapidly changing externalities throughout the pandemic. This study addresses a gap in the literature about ways community partnerships may plan for and implement pandemic CERC. The study also focused on CERC with immigrant and refugee populations that have been disproportionately impacted by the COVID-19 pandemic and face unique barriers to pandemic messaging and collaboration with health institutions.

The results of interviews and focus groups demonstrated high acceptability and perceived efficacy of the intervention framework. RHCP partners adopted a CERC framework, co-created messages with community partners and health experts, and modified messages regularly, which led communication leaders to feel supported in disseminating accurate messages to their networks. Frequent communication between community and academic partners allowed the team to respond rapidly to concerns and obstacles. The bidirectional communication facilitated connection of community members to resources through group-based troubleshooting. For example, the need for masks, food, and information about accessing unemployment benefits was addressed by community experts. Finally, bidirectional communication led to systems and policy changes to meet the needs of immigrant and refugee populations. For example, expressed community concerns influenced regional SARS-CoV-2 testing (and, later, vaccination) policies for patients with limited English proficiency. Likewise, a regional system was created that linked patients with limited English proficiency who received a positive test result for SARS-CoV-2 to a community-based organization that works with immigrant groups collaborating with county officials on provision of essential services. In these ways, our study provides details about how previously described best practices for pandemic CERC (from the 2009 influenza pandemic) may be applied with populations at risk for health disparities.⁴¹

This study demonstrated 9 months of intervention sustainability, which has now exceeded 12 months. Sustainability of interventions beyond grant funding is challenging.^19,42 Barriers to sustainability include time demands, limited resources, and maintaining morale and energy for CEnR.⁴² However, a strong and enduring partnership can be an important facilitator for sustainability of CEnR interventions.⁴³ Integration of interventions into existing programs, partnership capacity building, and community ownership of interventions are also important facilitators for sustainability.¹⁹ The intervention in our study was built on the foundation of an experienced CEnR partnership.^25,26,44 Frequent communication between communication leaders and academic partners, and the broader community acceptance of RHCP as a reliable source of health information, helped to sustain the intervention. One communication leader noted, “Without the COVID-19 [work group] many people [won’t] understand what to do, where to go when they have fever or wanted testing, what to do [when] they are sick. . . . So now . . . they have knowledge, and they know what they’re doing, and they know where they’re going, and they know who will contact them when they need help.”

CEnR partnerships focused on achieving health equity goals are increasingly common.¹⁸ Our study showed that they are uniquely poised to respond to pandemic communication needs through ready access to disease content expertise from academic partners and community expertise from community partners that includes community capacity for evaluation and data collection. Processes and products from this bidirectional CERC framework may be adapted by other CEnR partnerships to meet local needs. As examples, the framework has been adapted by partnerships in Minnesota, Florida, and Mississippi.⁴⁵ Future directions include the development of a toolkit for community-engaged CERC for pandemic preparedness with populations at risk for health inequities.

Limitations

This study had several limitations. First, dissemination of messages beyond the initial distribution from communication leaders was not quantified. Therefore, the full intervention reach could not be assessed across social networks (message amplification). Second, the number of people reached by communication leaders may have been overestimated if people received messages from more than 1 communication leader via overlapping networks. On the other hand, the tracking sheets substantially underestimated true reach and engagement because of low completion rates by communication leaders. Third, we did not assess risk-related behaviors and outcomes, which limits quantitative conclusions about intervention impact. Finally, CEnR partnership work is highly contextual; as such, this process may not be generalizable to some partnerships.

Conclusion

Community-engaged CERC is feasible, sustainable, and effective in reducing COVID-19 disparities through shared creation and dissemination of public health messages, enhanced connection to existing resources, and incorporation of community voices in regional pandemic mitigation policies.

Footnotes

Acknowledgements

The authors thank the RHCP partners who contributed to the organization, implementation, and dissemination of this work.

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This publication was supported by Clinical and Translational Science Awards grant no. UL1 TR000135 from the National Center for Advancing Translational Science and the Mayo Clinic Center for Health Equity and Community Engagement Research. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the National Institutes of Health. The funding bodies had no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the article; and in the decision to submit the article for publication.

ORCID iD

Mark L. Wieland, MD, MPH

References

Reynolds

Lutfy

. Crisis and Emergency Risk Communication Manual. Centers for Disease Control and Prevention; 2018. Accessed September 7, 2021. https://emergency.cdc.gov/cerc/manual/index.asp

World Health Organization. Risk Communication and Community Engagement (RCCE) Action Plan Guidance: COVID-19 Preparedness and Response. 2020. Accessed April 13, 2020. https://www.who.int/publications-detail/risk-communication-and-community-engagement-(rcce)-action-plan-guidance

Williamson

Walker

Bhaskaran

, et al. OpenSAFELY: factors associated with COVID-19 death in 17 million patients. Nature. 2020;584(7821):430-436. doi:10.1038/s41586-020-2521-4

Centers for Disease Control and Prevention. COVID-19 in racial and ethnic minority groups. 2020. Accessed July 13, 2020. https://www.cdc.gov/coronavirus/2019-ncov/need-extra-precautions/racial-ethnic-minorities.html

Blumenshine

Reingold

Egerter

Mockenhaupt

Braveman

Marks

. Pandemic influenza planning in the United States from a health disparities perspective. Emerg Infect Dis. 2008;14(5):709-715. doi:10.3201/eid1405.071301

Bergstresser

. Health communication, public mistrust, and the politics of “rationality.” Am J Bioeth. 2015;15(4):57-59. doi:10.1080/15265161.2015.1009570

Gollust

Nagler

Franklin Fowler

. The emergence of COVID-19 in the US: a public health and political communication crisis. J Health Polit Policy Law. 2020;45(6):967-981. doi:10.1215/03616878-8641506

Ataguba

. Social determinants of health: the role of effective communication in the COVID-19 pandemic in developing countries. Glob Health Action. 2020;13(1):1788263. doi:10.1080/16549716.2020.1788263

Berger

Evans

Phelan

Silverman

. COVID-19: control measures must be equitable and inclusive. BMJ. 2020;368:m1141.

10.

Kim

Lan

Nkyekyer

, et al. Assessment of disparities in COVID-19 testing and infection across language groups in Seattle, Washington. JAMA Netw Open. 2020;3(9):e2021213. doi:10.1001/jamanetworkopen.2020.21213

11.

Hanson

Hains

Schwaderer

Starr

. Variation in COVID-19 diagnosis by zip code and race and ethnicity in Indiana. Front Public Health. 2020;8:593861. doi:10.3389/fpubh.2020.593861

12.

Drefahl

Wallace

Mussino

, et al. A population-based cohort study of socio-demographic risk factors for COVID-19 deaths in Sweden. Nat Commun. 2020;11(1):5097. doi:10.1038/s41467-020-18926-3

13.

Scarpetta

Dumont

J-C

Liebig

. What is the impact of the COVID-19 pandemic on immigrants and their children? Organisation for Economic Co-operation and Development. 2020. Accessed April 5, 2021. https://read.oecd-ilibrary.org/view/?ref=137_137245-8saheqv0k3&title=What-is-the-impact-of-the-COVID-19-pandemic-on-immigrants-and-their-children%3F

14.

Edmonds

Flahault

. Refugees in Canada during the first wave of the COVID-19 pandemic. Int J Environ Res Public Health. 2021;18(3):947. doi:10.3390/ijerph18030947

15.

Clark

Fredricks

Woc-Colburn

Bottazzi

Weatherhead

. Disproportionate impact of the COVID-19 pandemic on immigrant communities in the United States. PLoS Negl Trop Dis. 2020;14(7):e0008484. doi:10.1371/journal.pntd.0008484

16.

Cholera

Falusi

Linton

. Sheltering in place in a xenophobic climate: COVID-19 and children in immigrant families. Pediatrics. 2020;146(1):20201094. doi:10.1542/peds.2020-1094

17.

Lopez

Holmes

. Raids on immigrant communities during the pandemic threaten the country’s public health. Am J Public Health. 2020;110(7):958-959. doi:10.2105/AJPH.2020.305704

18.

Ortiz

Nash

Shea

, et al. Partnerships, processes, and outcomes: a health equity–focused scoping meta-review of community-engaged scholarship. Annu Rev Public Health. 2020;41:177-199. doi:10.1146/annurev-publhealth-040119-094220

19.

Wallerstein

Duran

. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(suppl 1):S40-S46. doi:10.2105/AJPH.2009.184036

20.

US Census. QuickFacts: Rochester City, Minnesota. Accessed October 20, 2021. https://www.census.gov/quickfacts/fact/table/rochestercityminnesota,US/PST045219

21.

Wieland

Asiedu

Lantz

, et al. Leveraging community engaged research partnerships for crisis and emergency risk communication to vulnerable populations in the COVID-19 pandemic. J Clin Transl Sci. 2020;5(1):e6. doi:10.1017/cts.2020.47

22.

Hussey

Hughes

. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182-191. doi:10.1016/j.cct.2006.05.007

23.

Hawley

Wieland

Weis

Sia

. Perceived impact of human subjects protection training on community partners in community-based participatory research. Prog Community Health Partnersh. 2014;8(2):241-248. doi:10.1353/cpr.2014.0023

24.

Amico

Wieland

Weis

Sullivan

Nigon

Sia

. Capacity building through focus group training in community-based participatory research. Educ Health (Abingdon). 2011;24(3):638.

25.

Reese

Hanza

Abbenyi

, et al. The development of a collaborative self-evaluation process for community-based participatory research partnerships using the community-based participatory research conceptual model and other adaptable tools. Prog Community Health Partnersh. 2019;13(3):225-235. doi:10.1353/cpr.2019.0050

26.

Wieland

Hanza

MMM

Weis

, et al. Healthy immigrant families: randomized controlled trial of a family-based nutrition and physical activity intervention. Am J Health Promot. 2018;32(2):473-484. doi:10.1177/0890117117733342

27.

Wieland

Weis

Olney

, et al. Screening for tuberculosis at an adult education center: results of a community-based participatory process. Am J Public Health. 2011;101(7):1264-1267. doi:10.2105/AJPH.2010.300024

28.

Wieland

Njeru

Hanza

, et al. Pilot feasibility study of a digital storytelling intervention for immigrant and refugee adults with diabetes. Diabetes Educ. 2017;43(4):349-359. doi:10.1177/0145721717713317

29.

Covello

. Risk communication and message mapping: a new tool for communicating effectively in public health emergencies and disasters. J Emerg Manag. 2006;4(3):25-40. doi:10.5055/jem.2006.0030

30.

Finley

Huynh

Farmer

, et al. Periodic reflections: a method of guided discussions for documenting implementation phenomena. BMC Med Res Methodol. 2018;18(1):153. doi:10.1186/s12874-018-0610-y

31.

Centers for Disease Control and Prevention. Principles of Community Engagement. NIH pub. no. 11-7782. National Institutes of Health; 2011.

32.

Laur

Bell

Valaitis

Ray

Keller

. The Sustain and Spread Framework: strategies for sustaining and spreading nutrition care improvements in acute care based on thematic analysis from the More-2-Eat study. BMC Health Serv Res. 2018;18(1):930. doi:10.1186/s12913-018-3748-8

33.

Moucheraud

Sarma

TTT

, et al. Can complex programs be sustained? A mixed methods sustainability evaluation of a national infant and young child feeding program in Bangladesh and Vietnam. BMC Public Health. 2020;20(1):1361. doi:10.1186/s12889-020-09438-2

34.

Gale

Erhardt

, et al. Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implement Sci. 2019;14(1):11. doi:10.1186/s13012-019-0853-y

35.

Koenig

Abraham

Zamora

, et al. Pre-implementation strategies to adapt and implement a veteran peer coaching intervention to improve mental health treatment engagement among rural veterans. J Rural Health. 2016;32(4):418-428. doi:10.1111/jrh.12201

36.

Taylor

Henshall

Kenyon

Litchfield

Greenfield

. Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis. BMJ Open. 2018;8(10):e019993. doi:10.1136/bmjopen-2017-019993

37.

Clarke

Wilkinson

Watson

Wilcockson

Kinnaird

Williamson

. A seat around the table: participatory data analysis with people living with dementia. Qual Health Res. 2018;28(9):1421-1433. doi:10.1177/1049732318774768

38.

Murray

Falkenburger

Saxena

. Data Walks: An Innovative Way to Share Data With Communities. Urban Institute; 2015.

39.

Moore

Audrey

Barker

, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. doi:10.1136/bmj.h1258

40.

Malecki

KMC

Keating

Safdar

. Crisis communication and public perception of COVID-19 risk in the era of social media. Clin Infect Dis. 2021;72(4):697-702. doi:10.1093/cid/ciaa758

41.

Vaughan

Tinker

. Effective health risk communication about pandemic influenza for vulnerable populations. Am J Public Health. 2009;99(suppl 2):S324-S332. doi:10.2105/AJPH.2009.162537

42.

Israel

Schulz

Parker

Becker

. Review of community-based research: assessing partnership approaches to improve public health. Annu Rev Public Health. 1998;19:173-202. doi:10.1146/annurev.publhealth.19.1.173

43.

Hacker

Tendulkar

Rideout

, et al. Community capacity building and sustainability: outcomes of community-based participatory research. Prog Community Health Partnersh. 2012;6(3):349-360. doi:10.1353/cpr.2012.0048

44.

Amico

Wieland

Weis

Sullivan

Nigon

Sia

. Capacity building through focus group training in community-based participatory research. Educ Health (Abingdon). 2012;24(3):638.

45.

Brewer

Asiedu

Jones

, et al. Emergency preparedness and risk communication among African American churches: leveraging a community-based participatory research partnership COVID-19 initiative. Prev Chronic Dis. 2020;17:E158. doi:10.5888/pcd17.200408

Community-Engaged Bidirectional Crisis and Emergency Risk Communication With Immigrant and Refugee Populations During the COVID-19 Pandemic

Abstract

Objectives:

Methods:

Results:

Conclusions:

Keywords

Methods

CEnR Partnership Narrative

Intervention Framework

Program Evaluation

Data Sources

Emails

RHCP COVID-19 work group meeting notes

Reflection interviews

Postimplementation focus groups

Communication leader tracking sheets

Data Analysis

Results

Acceptability, Feasibility, and Perceived Efficacy

Reach and Engagement

Adaptation

Sustainability

Discussion

Limitations

Conclusion

Footnotes

Acknowledgements

Declaration of Conflicting Interests

Funding

ORCID iD

References