Abstract
Introduction
Clinical research participation is under-represented among minoritized groups (eg, Black Americans) leading to suboptimal generalizability of findings and likely propagating inequities in cancer outcomes. Offices of Community Outreach and Engagement at comprehensive cancer centers establish bidirectional relationships between institutions and communities to facilitate catchment-concordant clinical research. We describe a program to educate and empower community health workers (CHWs) to act as clinical research advocates within their communities.
Methods
Academic and community stakeholders adapted existing evidence-based educational materials addressing importance of clinical research. The resulting program was entitled Community Research Academy to Foster RepresenTation (CRAFT). CRAFT is a 3-hour “train the trainer” session including introduction to clinical trials with “myth busters”, “Ask the Participant” panel, and hands-on experience finding a clinical trial. CRAFT was evaluated for acceptability, change in knowledge/perception, maintenance, and suggestions for curriculum improvement.
Results
Training was held in December 2023 with 21 CHWs, with a refresher training in July 2024 with 19 CHWs. At initial training, all participants reported ‘excellent’ or ‘good’ satisfaction with CRAFT. Results indicate 48% reported increased knowledge and 33% improved perception, and 21% demonstrated increased objective knowledge of clinical trials. At refresher training, 94% reported ‘excellent’ or ‘good’ satisfaction with CRAFT, 47% reported increased knowledge and 73% increased objective knowledge of clinical trials. Of those completing both sessions and all objective knowledge questions, 50% maintained or improved their score. Qualitative feedback indicated need for additional training (eg, more testimonials, more facts to supplement “myth busting”, more trainings, additional information on how to present to the public, and collaboration with academic health system staff during future CHW-facilitated programs).
Conclusion
CRAFT increased awareness, knowledge, and perception of clinical research among diverse CHWs with maintenance over time. Next steps include refining CRAFT, administering CRAFT to volunteer community health advisors, continuing evaluation, and sharing with other institutions.
Introduction
Participation in cancer clinical trials by members of minoritized groups (eg, Black Americans) is vastly under-represented. In fact, Black Americans comprise only about 5% of adult patients with cancer participating in clinical trials, but represent approximately 14% of the United States population and about 11.7% of new cancer cases.1-4 Lack of representation by these groups in clinical research is a result of patient-related, clinician/academician-related, and system-related factors.5,6
Patient-related factors may include, but are not limited to, medical mistrust, ineligibility due to prior or current cancer therapy and disease stage, decision-making style, lack of access to clinical trials, financial burden, and/or lack of knowledge of policies, procedures, and processes surrounding clinical trials.5-7 Clinician/academicians may offer clinical trials to minoritized groups in a limited capacity, forego offering clinical trials as options based on personal preferences for treatment options even forego, and even omit discussions due to limited time or knowledge of available clinical trials. 5 System-related factors can include lack of health insurance coverage for study drugs and clinical research being offered only at academic medical centers.5,6 Moreover, the eligibility criteria for clinical trials may systematically exclude individuals in minoritized groups, and informed consent materials may be written in ways that prevent understanding among individuals with low health literacy.5,6
Particularly in cancer clinical trials, it is essential for the clinical research community to overcome these barriers and increase participation in these studies by diverse cohorts of patients. Greater diversity in research participation improves generalizability of clinical trial findings, without which, existing inequities in cancer outcomes between Black and White patients will be propagated; evidence suggests that those who participate in clinical trials have better outcomes than those who do not.1,8 Moreover, clinical trial participation results in a sense of shared ownership of the trial outcomes and future impacts.9,10 Participation also cultivates motivation for further participation in future studies. 11 Consequently, lack of representation of minoritized populations in clinical trials prevents a nuanced and fully informed approach to cancer drug development, clinical standards for best practice, and other important deliverables such as accuracy of race or ethnicity-specific subgroup analyses. 12
Given the importance of clinical trial participation in cancer, the National Cancer Institute 13 (NCI)-designated Comprehensive Cancer Centers are required to have an Office of Community Outreach and Engagement (OCOE) to establish bidirectional relationships between the institution and the community to facilitate catchment-concordant clinical research, to disseminate research findings to the community, and to foster a symbiotic relationship between communities and institutions. A major role of the OCOE has become the facilitation of diverse accrual in clinical trials.14,15 The OCOE of the O’Neal Comprehensive Cancer Center at the University of Alabama at Birmingham (UAB), the only NCI-designated comprehensive cancer center in Alabama, works to achieve these goals through deployment of a volunteer community health advisor model of engagement, facilitated by oversight of a cadre (n = 24) of part-time community health workers (CHWs).16,17 To facilitate greater ability to meet OCOE goals and be responsive to catchment area feedback, UAB OCOE created a program to educate and empower CHWs with awareness and education to act as clinical research advocates within their communities (Community Research Academy to Foster RepresenTation: CRAFT). Here, we describe the CRAFT program and results evaluating its reach, effectiveness, acceptability, and maintenance.
Methods
Program Description
CRAFT is a “train the trainer”, low-intensity program specifically developed to educate and empower CHWs to use culturally relevant techniques to engage diverse communities on clinical trials. It was co-developed with academic and community stakeholders, including faculty/researchers and the UAB O’Neal community advisory board members (cancer survivors and community advocates), and informed by existing evidence-based materials.5,18-21 Initial iterations of this program were previously deployed in an OCOE collaboration with the GO2 Foundation for Lung Cancer’s LungMATCH program (a targeted, culturally appropriate clinical trial outreach effort to educate African American communities in Alabama) and UAB Division of Hematology & Oncology’s cancer agnostic clinical trial education campaign (aimed at increasing clinical trial education and accrual).20-23
The CRAFT program is delivered by 2 program managers and a clinical scientist, who are all trained in clinical research coordination and cultural humility, via an in person three-hour interactive PowerPoint presentation and printed materials. Other assistants in the delivery of the program include community-engaged researchers and participants who have previously participated in therapeutic clinical trials and in behavioral research studies. Components of the CRAFT program include an introduction to clinical trials with “myth busters”, an “Ask the Clinical Research Participant” panel, and a hands-on experience finding a clinical trial on electronic platforms (ie, https://httpClinicalTrials.gov, UAB Reporter, and ResearchMatch). Following the program, CHWs are encouraged to continue engaging with 1 or more of the platforms (eg, visiting the websites, clicking on trials, etc.) However, engagement with the websites is unable to be tracked. This study involved program development and evaluation, which was not intended as research. No participant identifiers were collected and informed consent was not required. The University of Alabama at Birmingham IRB also determined that the training program reported in the manuscript was not human subjects research (IRB-300012608). Rather than formal written consent, which was accordingly waived, participants gave verbal approval to participate and share the reported results.
CRAFT Evaluation
All OCOE CHWs (n = 24) were invited to participate. The only inclusion criteria was being an OCOE CHW. Three were unable to participate due to unforeseen circumstances such as illness or other conflicts. All participants had prior long-standing relationships with the OCOE. There were 2 CRAFT sessions. First, CRAFT was administered in December 2023 to 21 OCOE CHWs as a part of their regular curriculum. A refresher training was administered in July 2024 to 19 OCOE CHWs (2 CHWs from the initial training were absent due to unforeseen circumstances). CRAFT was evaluated for reach, effectiveness, acceptability, implementation, and maintenance, and suggestions for curriculum improvement using a pre-test and post-test at each administration. 24 For implementation, sessions were started at a pre-specified time and concluded when all components of the program were administered (approximately 3 hours in duration). There was no within-session sampling or between-session sampling. The refresher training was again offered to all OCOE CHWs and administered to those who were able to participate. Between-session consistency was ensured by keeping the program content the same between sessions. Some additional objective knowledge questions were added at the second session, but the content remained the same. Time-related disruptions (eg, breaks) were also kept consistent between sessions (eg, a 15 minute restroom/coffee break between the first and second program components). Since this was program development and evaluation and not human subjects research, no participant identifiers were collected and informed consent was not required.
Reach is defined as the number, proportion, and representativeness of those willing to participate in a program. 25 In this study, reach was evaluated using CHW demographics and county of residence. Within Reach, acceptability was defined as the extent to which those receiving the program consider it appropriate based on pre-conceived cognitive and emotional responses to the intervention.24,26 In this study, acceptability was evaluated via post-test evaluation of the perceived quality of the program and qualitative (free-text entry) suggestions for improvement.
Effectiveness is the impact of the program on pre-determined outcomes. 25 In this study, CRAFT was evaluated for effectiveness at improved self-reported knowledge and perception and objective knowledge of clinical trials from pre- to post-test (at both initial and refresher training). CHWs responded to a pre-test of their knowledge and perception of clinical trials. Questions were based on prior assessments including Health Information National Trends Survey (HINTS) 5, Cycle 4, and the SubjectWell Survey of Clinical Trial Awareness and Attitudes.27-29
Maintenance is defined as the 6-month or more period where knowledge gains or behavior changes as a result of the program were sustained post-implementation. 25 In this study, maintenance was assessed based on change in knowledge (or lack of change) from the initial training post-test to the refresher training pre-test. Participants responded to a post-test including the same questions from the pre-test, in addition to questions related to acceptability of the program and suggestions for curriculum improvement.
Statistically, we evaluated whether changes in metrics differed significantly from 0 using two-sided tests of location (t test). All analyses were conducted using SAS Version 9.4 (SAS Institute, Inc, Cary, NC).
Results
Initial Training: December 2023
Participant Characteristics of the Study Sample
aDue to missing data, not all categories sum to the total sample size. Percentages are reported with a denominator consisting of those answering the question. Participants at the refresher training are not the exact same group of participants completing the initial training.
Summary Characteristics of Program Evaluation
Due to missing data, not all categories sum to the total sample size.
Mean Change From Zero of Program Evaluation Scores
Estimated using two-sided tests of location (t test). Significance set at α = 0.05.
Refresher training: July 2024
Among those responding to each question, the median age of CHWs (n = 19) at the refresher training was 60.5 years, 100% identified as Black or African American; 1 person chose not to disclose their race. No participants identified as Hispanic/Latinx. All CHWs were female except for 1 who chose not to disclose their sexual identity, and 94.4% identified as heterosexual. A majority of CHWs (52.9%) indicated that they were living comfortably on their present income, 29.4% indicated that they were getting by on their present income, and 17.7% indicated that they were finding it difficult on their present income. A majority (55.6%) were employed full-time and the remainder were employed part-time; 33.3% had some college education, 38.9% had a Bachelor’s degree, 22.2% had a master’s degree, and 5.6% (1 participant) had a doctoral degree. All CHWs indicated that they had some kind of healthcare insurance coverage. Four CHWs were cancer survivors (Table 1). A majority of these CHWs had also participated in the initial training (n = 11), but the participants in the initial and the refresher trainings did not completely overlap.
Overall, 93.8% reported ‘excellent’ or ‘good’ satisfaction with the CRAFT training (Table 2). Additionally, 73.3% indicated that they were likely or very likely to recommend CRAFT to a friend (Table 2). About half (47.1%) demonstrated increased self-reported knowledge of clinical trials and this change was statistically different from 0 (mean change: 0.5 [SD: 0.5], p-value: 0.002) (Table 2, Table 3). All but one CHW in the remaining 53.0% reported that they ‘know a little about clinical trials’ in both the pre-test and the post-test. Prior to the CRAFT session, of those completing all objective knowledge questions (n = 16), no CHWs answered all questions correctly (Table 2). However, 3 CHWs (18.8%) each answered 8 of 10 or 9 of 10 questions correctly. Post-session, of those answering all objective knowledge questions in the post-test (n = 14), 4 CHWs (28.6%) answered all questions correctly and all CHWs answered at least 7 of 10 questions correctly (Table 2). Following the session, 72.7% of CHWs increased their objective knowledge of clinical trials. Only 1 CHW demonstrated a decrease in knowledge. The change in objective knowledge was statistically different from 0 (mean change: 1.4 [SD: 1.0], p-value: 0.023) (Table 2, Table 3). Finally, of those present at both sessions and fully completing the objective knowledge questions (n = 8), 50% maintained the same score or an improved score from the December to the July training. Qualitative feedback (via free-text entry) still indicated the need for “additional training” and “more information”. Some CHWs also indicated the need for “more time to study the information” and the need to “go slower…” through the content. CHWs also suggested that CRAFT be improved by adding additional topics providing “more information on encouraging African Americans” and “more info[rmation] on how to get people involved” in general. Lastly, in relation to educating others about clinical trials, CHWs believed the CRAFT program would be most effective if delivered by a trained CHW that is confident in the subject matter and clinician scientist.
Discussion
The CRAFT program is an example of a preliminarily effective and acceptable program to prepare CHWs as clinical research advocates to educate and empower individuals within their communities. CRAFT resulted in increased knowledge and perception of clinical trials which was maintained over time. Given that diverse clinical trial representation is an essential characteristic to ensure generalizable findings and avoid propagation of health disparities, CHWs can be useful resources as clinical research advocates to empower community members to participate in clinical trials. These findings are similar to a 2011 study of another cancer-related clinical trial education program for CHWs in the Boston, Massachusetts area which indicated that their CHW education program was satisfactory to the CHWs and resulted in increased knowledge of clinical trials. 30
CHW-led interventions have demonstrated efficacy in randomized trials to improve various cancer-related outcomes among minoritized adults.31,32 It is our belief that CHWs should have an understanding of the clinical trial process in order to not only guide interventions, but also to facilitate community understanding and uptake of the clinical research process. Moreover, trust is an important potential barrier to clinical trial participation.5-7 CHWs (who typically share background, culture, and experiences with the communities they serve) have the necessary trust and rapport with the community. 33 A prior study from New York University Langone Health developed a training to increase knowledge and ability of CHWs to engage their communities around discussion and understanding of clinical research. 34 The NYU program was co-developed with input from the CHWs regarding gaps in knowledge of clinical trials through the lens of the underserved communities the CHWs served. This program resulted in increased knowledge, awareness, and abilities of CHWs to engage and educate their communities on clinical trials. However, the program was administered to CHWs across almost 200 institutions throughout the United States and involved 28 online modules about 5 minutes each with multiple choice quizzes following the modules. 34 While the NYU training was a similar length to our CRAFT program, it was not specific to cancer-related clinical trials. Moreover, the online format was administered to CHWs across the country and may not be appropriate for the CHWs who have low technology literacy and live in areas that are underserved by internet connectivity. Thus, similar programs developed at other institutions should be tailored to the context of the communities CHWs serve.
It should be noted that in our study, a lower percentage of participants answered all objective knowledge questions correctly at the post-test of the initial training compared to the pre-test. This may be because not all participants who answered all questions at the pre-test also answered all questions at the post-test. When looking at the change in objective knowledge, there was no statistically significant difference in pre- vs post-test scores indicating that there was neither an increase nor a decrease of those completing all objective questions. Moreover, 50% maintained their scores from the initial to the refresher training indicating some level of maintenance.
Importantly, engagement around clinical trials may require multiple opportunities for CHWs to be prepared to act as clinical research advocates. Pilot data from our CRAFT program showed that CHWs expressed the desire for additional training and information, even after the refresher training and despite relatively high objective knowledge of clinical trials prior to the training sessions. This demonstrates some of the complexity of the clinical research process and difficulty of community members in understanding the process especially given that a majority of these CHWs were highly educated.
Furthermore, in contrast to the NYU study, our data suggest that in addition to providing education to CHWs and/or community members, we must provide strategies for them to engage and empower their communities to participate. This is noteworthy since a majority of these CHWs identified as Black or African American and despite their personal favorable view of clinical trials, they understood the difficulty of encouraging participation in clinical trials given historical injustices experienced by African Americans in the context of clinical research.
There are several next steps resulting from the development and evaluation of the CRAFT program. First, we must refine delivery of the program to address the needs expressed by participants for additional training. Secondly, we will expand the program to volunteer community health advisors. The CHWs will administer the CRAFT program to volunteer community health advisors who aid the CHWs in providing education and raising awareness about cancer screening, prevention, and research in the community. The CHWs and their community health advisors will provide additional education and information on cancer research and how to find clinical trials. The CHWs and the community health advisors engage with the community irrespective of cancer diagnosis. However, disseminating knowledge on the clinical research process may encourage community member participation should the need arise and/or may promote participation among family members or acquaintances of community members who were not directly engaged, but who are eligible or in need of cancer clinical research. Finally, as the CHWs administer the CRAFT program to community health advisors, community health advisors will complete the pre- and post-tests which will provide greater understanding of the baseline knowledge and effectiveness of the program in improving knowledge and perception of clinical research in the general community.
Additionally, to assist others with empowering their communities for clinical trial advocacy, we must share the CRAFT program with other organizations including other comprehensive cancer centers and OCOE offices. To assess longitudinal impact, we must also integrate with clinical trial offices at these organizations to track the impact of the program on accrual to clinical trials as outlined in NCI priorities for OCOE offices. 15 Finally, we must also involve our community-based organizations, industry partners, and government partners in this training so that these entities may utilize the training with those they serve as well.
Limitations
There are several limitations to the development and evaluation of the CRAFT program. First, there was very little diversity in the demographics of our CHWs. Thus, CRAFT should be administered and evaluated among a more diverse group of CHWs especially as the program is expanded to other institutions such that the CHWs are reflective of the relevant catchment areas. Additionally, the sample size for this program evaluation was small. As the program is expanded to include the volunteer community health advisors, a greater understanding of its effect on our outcomes (eg, increased knowledge, acceptability, etc.) will be appreciated.
Conclusions
The UAB OCOE co-developed a clinical research education program (CRAFT) to prepare CHWs as clinical research advocates. CRAFT increased awareness, knowledge, and perception of clinical trials among diverse CHWs. This three-hour program is a promising intervention to expand upon the success of the community health advisor model, with the ultimate goal of ensuring communities perceive cancer clinical trials positively and potentially increase rates of participation in cancer clinical trials.
Supplemental Material
Supplemental Material - Refining Our “CRAFT”: The Community Research Academy to Foster RepresenTation (CRAFT) Program
Supplemental Material for Refining Our “CRAFT”: The Community Research Academy to Foster RepresenTation (CRAFT) Program by Mackenzie E. Fowler, Oluseun Akinyele, Francine Walton, Rochelle Wallace, Stacey A. Ingram, Yu-Mei Schoenberger, Soumya J. Niranjan, Ritika R. Samant, Claudia Hardy, Silvia Gisiger-Camata, and Timiya S. Nolan in Cancer Control.
Footnotes
Ethical Approval
This study involved program development and evaluation, which was not intended as research. No participant identifiers were collected and informed consent was not required. The University of Alabama at Birmingham IRB also determined that the training program reported in the manuscript was not human subjects research (IRB-300012608). Rather than formal written consent, which was accordingly waived, participants gave verbal approval to participate and share the reported results.
Author Contributions
Mackenzie E. Fowler, PhD contributed to conception and design of the study, analysis and interpretation of data, drafting and revising the article, and final approval of the version to be submitted. Oluseun Akinyele, MPH contributed to conception and design of the study, acquisition and analysis of data, revising the article for content, and final approval of the version to be submitted. Francine Walton, MPH contributed to conception and design of the study, acquisition of data, revising the article for content, and final approval of the version to be submitted. Rochelle Wallace, MS contributed to conception and design of the study, acquisition of data, revising the article for content, and final approval of the version to be submitted. Stacey A. Ingram, MEd contributed to conception and design of the study, acquisition of data, revising the article for content, and final approval of the version to be submitted. Yu-Mei Schoenberger, PhD contributed to conception and design of the study, acquisition of data, revising the article for content, and final approval of the version to be submitted. Soumya J. Niranjan, BPharm, MS, PhD contributed to conception and design of the study, acquisition and interpretation of data, revising the article for content, and final approval of the version to be submitted. Ritika R. Samant, MPH contributed to conception and design of the study, interpretation of data, revising the article for content, and final approval of the version to be submitted. Claudia Hardy, MPA contributed to conception and design of the study, acquisition of data, revising the article for content, and final approval of the version to be submitted. Silvia Gisiger-Camata, MPH, Pharm, RN contributed to conception and design of the study, acquisition of data, revising the article for content, and final approval of the version to be submitted. Timiya S. Nolan, PhD, APRN-CRNP, ANP-BC, FAAN contributed to conception and design of the study, acquisition and interpretation of data, revising the article for content, and final approval of the version to be submitted.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by National Cancer Institute (P30CA013148).
Declaration of Conflict Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Data Availability Statement
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Supplemental Material
Supplemental Material is available online for this article.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
