Mental Health First Aid (MHFA) is an evidence-based program that equips participants with the knowledge and skills to respond to a person experiencing mental health or substance-use-related challenges. Prior evaluations of MFHA have focused on in-person delivery and effects at the participant level, largely overlooking aspects of the implementation process. This paper presents findings of the evaluation of virtual Adult MHFA using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework, using instructor reflection, the plan-do-study-act (PDSA) quality improvement tool, and a pretraining and 30-day posttraining survey. Between September 2020 and August 2022, 406 people participated in virtual MHFA training, with 96 (23.6% response rate) participating in the pre- and 30-day survey. Generally, respondents reported increased awareness of the signs and symptoms associated with mental health challenges and increased confidence in identifying the signs of mental health distress and engaging in helping behaviors. However, there were no meaningful changes to mental-health-related stigma or helping behaviors. Adoption of MHFA training was significantly higher (p = .04) among community-based organization (CBO) initiated settings compared with non-CBO-initiated settings. Instructor reflection indicated high fidelity to the MHFA curriculum, while PDSA cycles helped indicate improved survey participation through reminder e-mails. Generally, results from our evaluation indicate that virtual MHFA performs similarly to in-person MHFA, regarding effects at the participant level. Our findings highlight unique challenges encountered through the virtual curriculum, offering considerations for practitioners. Finally, the use of the RE-AIM framework provided a comprehensive lens for examining the implementation across multiple dimensions.
AlloteyP.ReidpathD. D.GhalibH.PagnoniF.SkellyW. C. (2008). Efficacious, effective, and embedded interventions: Implementation research in infectious disease control. BMC Public Health, 8(1), 343–343. https://doi.org/10.1186/1471-2458-8-343
2.
BanhM. K.ChaikindJ.RobertsonH. A.TroxelM.AchilleJ.EganC.AnthonyB. J. (2019). Evaluation of Mental Health First Aid USA using the mental health beliefs and literacy scale. American Journal of Health Promotion, 33(2), 237–247. https://doi.org/10.1177/0890117118784234
3.
BaumannB. L.McGuierE. A.RoundsJ. L.RumbargerK. M.KolkoD. J. (2023). Comparing in-person and synchronous online training for an evidence-based treatment. Administration and Policy in Mental Health and Mental Health Services Research, 50(6), 936–945. https://doi.org/10.1007/s10488-023-01294-7
4.
BerlandN.LugassyD.FoxA.GoldfeldK.OhS.-Y.TofighiB.HanleyK. (2019). Use of online opioid overdose prevention training for first-year medical students: A comparative analysis of online versus in-person training. Substance Abuse, 40(2), 240–246. https://doi.org/10.1080/08897077.2019.1572048
5.
BirdK. A.CastlemanB. L.LohnerG. (2022). Negative impacts from the shift to online learning during the COVID-19 crisis: Evidence from a statewide community college system. AERA Open, 8(1), 1–16. https://doi.org/10.1177/23328584221081220
6.
BrownC.ConnerK. O.CopelandV. C.GroteN.BeachS.BattistaD.ReynoldsC. F.III. (2010). Depression stigma, race, and treatment seeking behavior and attitudes. Journal of Community Psychology, 38(3), 350–368. https://doi.org/10.1002/jcop.20368
7.
ChengA.EppichW.EppsC.KolbeM.MeguerdichianM.GrantV. (2021). Embracing informed learner self-assessment during debriefing: The art of plus-delta. Advances in Simulation, 6(1), 22. https://doi.org/10.1186/s41077-021-00173-1
8.
CoronaR.McDonaldS. E.HittiS.AvilaM.TrujilloM. A.CoxJ. R.VelazquezE.EdgarK.HershnerL.BenzelG. K.MatijczakA.GordonC. A.AscencioI.MorenoO.GonzalezT. (2020). Training Spanish-speaking Latinx adults in Mental Health First Aid: A pilot feasibility trial. Psi Chi Journal of Psychological Research, 25(3), 260–271. https://doi.org/10.24839/2325-7342.JN25.3.260
9.
CostaT. F. O.SampaioF. M. C.SequeiraC. A.daC.RibeiroI. M. O. C.ParolaV. S. de O. (2021). Review of Mental Health First Aid programs. Western Journal of Nursing Research, 43(12), 1146–1156. https://doi.org/10.1177/0193945920980743
10.
CostelloJ.HaysK.GamezA. M. (2021). Using Mental Health First Aid to promote mental health in churches. Journal of Spirituality in Mental Health, 23(4), 381–392. https://doi.org/10.1080/19349637.2020.1771234
11.
CrisantiA. S.LuoL.McFaulM.SilverblattH.PyeattC. (2016). Impact of Mental Health First Aid on confidence related to mental health literacy: A national study with a focus on race-ethnicity. Psychiatric Services (Washington, D.C.), 67(3), 350–353. https://doi.org/10.1176/appi.ps.201400375
12.
El-AminT.AndersonB. L.LeiderJ. P.SatoriusJ.KnudsonA. (2018). Enhancing mental health literacy in rural America: Growth of Mental Health First Aid program in rural communities in the United States from 2008-2016. Journal of Rural Mental Health, 42(1), 20–31. https://doi.org/10.1037/rmh0000088
13.
EvansJ.RomaniukM.ThealR. (2021). Evaluation of Mental Health First Aid training for family members of military veterans with a mental health condition. BMC Psychiatry, 21(1), Article 128. https://doi.org/10.1186/s12888-021-03139-9
14.
GallegosP. J.MistryB.FreshwaterD.MullenC. (2021). Continued professional development: A comparison of online vs. In-person workshops. Currents in Pharmacy Teaching and Learning, 13(7), 770–775. https://doi.org/10.1016/j.cptl.2021.03.019
15.
GlasgowR. E.VogtT. M.BolesS. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327. https://doi.org/10.2105/AJPH.89.9.1322
HadlaczkyG.HökbyS.MkrtchianA.CarliV.WassermanD. (2014). Mental Health First Aid is an effective public health intervention for improving knowledge, attitudes, and behaviour: A meta-analysis. International Review of Psychiatry (Abingdon, England), 26(4), 467–475. https://doi.org/10.3109/09540261.2014.924910
18.
HavewalaM.WangC.BaliD.Chronis-TuscanoA. (2023). Evaluation of the virtual Youth Mental Health First Aid training for Asian Americans during COVID-19. Evidence-based Practice in Child and Adolescent Mental Health, 8(3), 321–334. https://doi.org/10.1080/23794925.2022.2111727
19.
KwanB. M.McGinnesH. L.OryM. G.EstabrooksP. A.WaxmonskyJ. A.GlasgowR. E. (2019). RE-AIM in the real world: Use of the RE-AIM framework for program planning and evaluation in clinical and community settings. Frontiers in Public Health, 7(345), 1–10. https://doi.org/10.3389/fpubh.2019.00345
20.
LamisD. A.UnderwoodM.D’AmoreN. (2017). Outcomes of a suicide prevention gatekeeper training program among school personnel. Crisis: The Journal of Crisis Intervention and Suicide Prevention, 38(2), 89–99. https://doi.org/10.1027/0227-5910/a000414
21.
LancasterP. G.MooreJ. T.PutterS. E.ChenP. Y.CigularovK. P.BakerA.QuinnettP. (2014). Feasibility of a web-based gatekeeper training: Implications for suicide prevention. Suicide & Life-Threatening Behavior, 44(5), 510–523. https://doi.org/10.1111/sltb.12086
22.
LangleyG. J.MoenR. D.NolanK. M.NolanT. W.NormanC. L.ProvostL. P. (2009). The improvement guide: A practical approach to enhancing organizational performance (2nd ed.). Jossey-Bass.
23.
LiangM.ChenQ.GuoJ.MeiZ.WangJ.ZhangY.HeL.LiY. (2021). Mental Health First Aid improves mental health literacy among college students: A meta-analysis. Journal of American College Health, 71, 1196–1205. https://doi.org/10.1080/07448481.2021.1925286
24.
LinkB. G. (1987). Understanding labeling effects in the area of mental disorders: An assessment of the effects of expectations of rejection. American Sociological Review, 52(1), 96–112. https://doi.org/10.2307/2095395
25.
LipsonS. K.SpeerN.PhD.BrunwasserS.HahnE.EisenbergD. (2014). Gatekeeper training and access to mental health care at universities and colleges. Journal of Adolescent Health, 55(5), 612–619. https://doi.org/10.1016/j.jadohealth.2014.05.009
26.
MalloneeS.PhillipsJ.HollowayK.RiggsD. (2018). Training providers in the use of evidence-based treatments: A comparison of in-person and online delivery modes. Psychology Learning & Teaching, 17(1), 61–72. https://doi.org/10.1177/1475725717744678
27.
MaslowskiA. K.LaCailleR. A.LaCailleL. J.ReichC. M.KlingnerJ. (2019). Effectiveness of Mental Health First Aid: A meta-analysis. Mental Health Review Journal, 24(4), 245–261. https://doi.org/10.1108/MHRJ-05-2019-0016
28.
MendenhallA. N.JacksonS. C.HaseS. (2013). Mental Health First Aid USA in a rural community: Perceived impact on knowledge, attitudes, and behavior. Social Work in Mental Health, 11(6), 563–577. https://doi.org/10.1080/15332985.2013.812542
29.
MohattN. V.BoeckmannR.WinkelN.MohattD. F.ShoreJ. (2017). Military Mental Health First Aid: Development and preliminary efficacy of a community training for improving knowledge, attitudes, and helping behaviors. Military Medicine, 182, e1576–e1583. https://doi.org/10.7205/MILMED-D-16-00033
30.
MorganA. J.FischerJ.-A. A.HartL. M.KellyC. M.KitchenerB. A.ReavleyN. J.YapM. B. H.JormA. F. (2020). Long-term effects of Youth Mental Health First Aid training: Randomized controlled trial with 3-year follow-up. BMC Psychiatry, 20(1), Article 487. https://doi.org/10.1186/s12888-020-02860-1
31.
MorganA. J.RossA.ReavleyN. J. (2018). Systematic review and meta-analysis of Mental Health First Aid training: Effects on knowledge, stigma, and helping behaviour. PLOS ONE, 13(5), Article e0197102. https://doi.org/10.1371/journal.pone.0197102
RobertsonM. N.DeShongH. L.SteenJ. S.BuysD. R.NadorffM. R. (2021). Mental Health First Aid training for Extension agents in rural communities. Suicide & Life-Threatening Behavior, 51(2), 301–307. https://doi.org/10.1111/sltb.12705
35.
SchönD. A. (1983). The reflective practitioner: How professionals think in action. Basic Books.
36.
ScottM.FeldmanB. N.UnderwoodM. (2016). Delivering professional development in suicide prevention: A comparison of online versus in-person training. Pedagogy in Health Promotion, 2(4), 266–275. https://doi.org/10.1177/2373379916658667
37.
ShendellD. G.MilichL. J.ApostolicoA. A.PattiA. A.KellyS. (2017). Comparing online and in-person delivery formats of the OSHA 10-hour general industry health and safety training for young workers. NEW SOLUTIONS: A Journal of Environmental and Occupational Health Policy, 27(1), 92–106. https://doi.org/10.1177/1048291117697109
38.
SubediP.LiC.GurungA.BizuneD.DogbeyM. C.JohnsonC. C.YunK. (2015). Mental Health First Aid training for the Bhutanese refugee community in the United States. International Journal of Mental Health Systems, 9(1), 20. https://doi.org/10.1186/s13033-015-0012-z
39.
TabakR. G.KhoongE. C.ChambersD. A.BrownsonR. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43(3), 337–350. https://doi.org/10.1016/j.amepre.2012.05.024
40.
ValeraP.MalarkeyS.OwensM.SinangilN.BhaktaS.ChungT. (2024). Remote Mental Health First Aid training for correctional officers: A pilot study. Psychological Services, 21, 328–336. https://doi.org/10.1037/ser0000860
41.
WadsworthD. P.Warren-JamesM.DuncanD.CleggL. (2023). Mental Health First Aid training for paramedic students: An evaluation study. Australasian Emergency Care, 26(2), 142–148. https://doi.org/10.1016/j.auec.2022.09.003
42.
WitryM. J.FadareO.PudloA. (2020). Pharmacy professionals’ preparedness to use Mental Health First Aid (MHFA) behaviors. Pharmacy Practice, 18(4), 2102. https://doi.org/10.18549/PharmPract.2020.4.2102
43.
WitryM. J.KarameseH.PudloA. (2020). Evaluation of participant reluctance, confidence, and self-reported behaviors since being trained in a pharmacy Mental Health First Aid initiative. PLOS ONE, 15(5), Article e0232627. https://doi.org/10.1371/journal.pone.0232627
44.
YooJ. H.ChanA. E.Hutter-ThomasS.LukulayM.KimA.LuceroA. K.Hurtado ChoqueG.KimJ. (2023). Mental Health First Aid training in rural Maryland during the COVID-19 pandemic: Program implementation through virtual delivery. Journal of Human Sciences and Extension, 11(2), 13. https://doi.org/10.55533/2325-5226.1412
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
