Abstract
Introduction and Objectives:
Canadians rely on their primary care providers to address their mental health needs, but there are longstanding system gaps that must be addressed to enhance their ability to deliver mental health care. The present study addressed the gap in pediatric mental health care through the development, delivery, and evaluation of a mental health literacy training among non-physician primary care providers.
Methods:
We delivered the training among 97 participants, with all completed the pre-test survey, and 74 completed the post-test survey on knowledge, attitudes toward mental health, and help-seeking intentions. Additionally, participants explained why they attended the training and shared how they would apply the knowledge learned into their practice (behaviors).
Results:
Participants improved their knowledge significantly from pre-test to post-test,
Conclusion:
This mental health literacy training for primary care providers demonstrated strong evidence of the need to integrate mental health and addiction support into primary care practice.
Keywords
Introduction
Primary care includes all the services people receive for their basic health needs and care. 1 It is often called “the front door” to health care—and serves as the entry point into the health-care system. Primary care usually includes the initial care, treatment, follow-up of various conditions and referrals to the rest of the health system when needed.1,2 It also encompasses wellness promotion, prevention and the management of chronic diseases and injuries. A successful primary care team includes family physicians and other health professionals such as mental health specialists, dieticians, pharmacists, and registered nurses working together. 1
The College of Family Physicians of Canada 3 supports integrating mental health services as a crucial part of community-based primary care and illustrated case examples on how mental health professionals and primary care providers worked together to improve access to mental health services in the community. Evidence demonstrating the effectiveness and cost-effectiveness of primary care based mental health interventions is emerging in Canada, 4 drawing attention of various provinces across the country. The Ontario Medical Association and Primary Care Collaborative worked together to have recommended policy actions to support primary care providers in integrating mental health services, including enhancing primary care providers capacity to treat mental disorders such as moderate to severe depression and anxiety. 5
Most Canadians rely on their primary care providers to address their mental health needs, but there are longstanding system gaps that must be addressed to enhance the ability of primary care providers to deliver mental health care. 5 Researchers 6 have further identified the need to develop competencies of pediatric primary care providers in the recognition that adverse psychosocial experiences in childhood have lifelong adverse effects on mental and physical health, and the high prevalence of mental disorders and substance abuse among youth: an estimated of 1 in 5 young people experience a mental disorder requiring professional care and evidence of functional impairment. 7
Internationally, there have been calls for collaborative mental health care for youth in pediatric primary care 8 to improve access to quality mental health care. Research is emerging in training primary care providers to care for patient mental health.9,10 And the Mental Health Gap Action Programme (mhGAP) was launched by the World Health Organization 11 for implementation across over 90 countries. While recognizing the importance of addressing youth mental health in primary care, 12 there are few studies focusing on this domain. In 2014, Alberta Health Services (AHS) supported the development of the Canadian Research and Education for the Advancement of Child Health (CanREACH). CanREACH offers evidence-based mental health literacy (MHL) in primary care that has demonstrated measurable changes in referral practices 13 resulting in improved patient and provider experiences and benefits to the larger health care system.14,15
Recognizing that the primary care setting includes interdisciplinary professionals, the Primary Care Networks (PCN) in a province in west Canada raised the need to upskill interdisciplinary team members. It enlisted the evidence-based CanREACH program: https://canreach.mhcollab.ca/ and the MHL program: https://mentalhealthliteracy.org/ to partner and develop a new initiative for non-physician professionals in the primary care setting. The initiative adapted the Go-To Educator MHL training, already being applied and proven in the education system among teachers in secondary schools, 16 to align with the CanREACH program which is already being applied and has been proven in the medical system.13 -15 This adaptation was developed and delivered to non-physician professionals across disciplines (eg administration, nursing, psychology, pharmacy, dieticians) working in the primary care setting. This joint initiative ensured that the information being delivered to the interdisciplinary primary care team was consistent with that being offered to educators and physicians across the province of Alberta through this shared literacy approach.
In this study, we described the preliminary results of this Interdisciplinary Professionals in Primary Care (IPPC) MHL training in a province in west Canada, addressing the following research questions:
Does the primary care MHL training improve knowledge, reduce stigma and enhance help-seeking intentions among primary care providers and staff across multi-disciplinary professionals working in the primacy care setting?
Do participants respond to the primary care MHL training differently based on their demographic characteristics?
Do participants’ attitudes toward mental health and help-seeking intentions be predicted by their knowledge, attitudes and their demographics?
What are participants’ perspectives about the benefits of the primary care MHL training?
Methods
Participants were informed of the study during the training and the passive consent was automatically achieved when participants completed the survey. The study ethics was approved by the first author’s institution.
The IPPC training was primarily developed for persons working within the primary care settings associated with the regional Primary Care Networks but was offered to primary care networks in the Central and South Zone of the Northwest Territories. Participants self-selected to participate, and at time of registration were asked general demographic information and questions about their education, years of employment, role in primary care, and experience with child and adolescent mental health. One week prior to the start of their training, participants were e-mailed a link to complete a pre-test to measure their knowledge and attitudes related to mental health. Upon completion of the pre-test, participants were provided the links to their training and course materials. At the end of the training sessions, participants were asked to complete a post-test online. The questions in the post-test mirrored those of the pre-test as described below in the Measures.
The training was co-led by 2 presenters, 1 from each of the 2 programs being represented in this initiative, CanREACH and MHL, and was delivered live, online via the Zoom platform. Three training cohorts were offered with participants self-selecting the cohort that best worked with their schedules. The class sizes for each of the 3 training cohorts ranged from between 30 and 60 participants per cohort. We needed a sample of 71 participants, to ensure that we have 80% power to detect an effect size of
The training offered a foundation and framework for all participants to develop core competencies in child and adolescent MHL. In the first 4-h session, participants learnt a common language and epidemiological information, gained understanding into different mental health states, and developed patient engagement, assessment, and treatment skills. In the second 4-h session, the foundational information served as a framework for the application to some of the most prominent mental disorders seen in primary care. Participants were also toured through resources applicable for use with their patient populations and/or to enhance their own practice with youth and their families. The training sessions consisted of interactive lectures supported by slides and included activities, group discussions, self-reflections, video demonstrations, question-and-answer periods, and interactive games. As participants had a wide variety of roles and backgrounds in their primary care practices (eg, nurses, pharmacists, behavioral health consultants, psychologists, social workers, dieticians, admin), throughout the training participants were encouraged to self-reflect, record and share their key learnings (knowledge) and how they intend to apply this to their specific role (behavior/action).
We evaluated participants outcomes applying 5 sections of questions on demographics (eg, gender, role, years of practice, practice location, and previous training in mental health), knowledge, attitudes toward mental health/stigma, help-seeking intentions, and training satisfaction. Participants created their own unique identifier (middle name or a nickname they go by, Year of Birth, Gender [M/F/O] and favorite color/number) without exposing their real identity. This unique identifier was used to link participants’ pre- and post-test for data analysis.
Knowledge was assessed using 23 statements created out of the training content by the program developer, asking participants to endorse a response out of 3 options: true, false, and “don’t know.” Each correct response received a score of 1; each incorrect response and “don’t know” response received a score of 0, with a maximum score of 23 and a minimum score of 0. The internal consistency reliability of the knowledge scale at baseline was α = .75. A principal component analysis was conducted with varimax rotation. The Kaiser–Meyer–Olkin (KMO) measure verified the sampling adequacy for the analysis, with KMO = 0.618, which was above the acceptable limit of 0.5. 19 An initial analysis was run to obtain eigenvalues for each factor in the data. Eight factors had eigenvalues over Kaiser’s criterion (>1) and in combination accounted for 60.432% of the variance. However, the scree plot was ambiguous and showed inflexions that would justify retaining just 1 factor that explained 17.245% of the variances.
Participant attitudes toward mental health were assessed using a 12-item 7-point Likert scale. Each response received a minimum score of 1 and maximum score of 7. Each participant gained a total of between 12 and 84, with lower scores indicating negative attitudes (higher stigma) and higher scores indicating positive attitudes (lower stigma). A previous study demonstrated strong reliability and reliability of the scale. 20 The internal consistency reliability of the scale with the current sample was α = .74.
Participants were evaluated on their help-seeking intentions using a 5-item 7-point Likert scale. Each response was assigned a value between 1 and 7, with total scores between 5 and 35. Higher scores indicated greater positive intentions for seeking help. A previous study has shown the strong reliability and validity of the scale. 21 The internal consistency reliability of the scale with the current sample was α=.83.
Participants were asked to rate their satisfaction with the training using a 6-item, 7-point Likert scale with a minimum value of 6 and a maximum of 42. Higher scores on this scale indicated greater satisfaction with the training. In addition, participants were given the chance to provide feedback on the training.
At pre-test, participants were asked to add any comments that they would like to share (eg, reason they took this training, what they hoped to learn). At post-test, participants were invited to describe at least 2 ways they intended to change their practice/behaviors as a result of attending this training program. Further, they were asked to describe at least 2 key messages (learnings, knowledge enhancement) that they took away from this training program. Lastly, participants were given the opportunity to provide any feedback that they would like to share after the training.
Quantitative data analysis contains both descriptive and inferential statistics. Descriptive statistics were reported as counts and percentages for categorical variables, means and standard deviation for normally distributed continuous variables. Differences between the pre- and post-test were examined using
Qualitative content analysis was applied for analyzing qualitative data and interpreting its meaning. 22 It was used as a systematic and objective means of describing and quantifying participants’ perspectives about the training. In content analysis, the qualitative data was reduced to concepts by creating categories, concepts, or a model as appropriate.
Results
A total of 97 participants completed the pre-test, and 74 completed the post-test. Of these, 64 were matched between pre- and post-test. Most participants identified themselves as female (94.9% at pre-test and 93.8% at post-test). Approximately half of the participants were in their 0 to 5 years of practice at both time points. More than half of the participants were from the Edmonton zone, followed by Central zone. Most participants had received previous mental health training. Participants were mostly nurses, followed by mental health professionals (eg, social work, psychology), non-clinical support staff (eg, admin, referral coordinator, facilitator, educator) and other clinically responsible professions (eg, pharmacy, nutrition, occupational therapy) (Table 1).
Demographics.
Table 2 describes the percentage of correct and incorrect responses on each knowledge question at two time points. Participants improved their understanding of mental health on 21 questions, however, not on questions 6 and 19.
Knowledge Differences by Question.
Incorrect responses included “Don’t know” responses.
Participants improved their knowledge significantly from pre-test (
We compared the outcome differences by participants’ practice year and practice location, demonstrating that they didn’t influence the outcome changes at pre-test and at post-test (
Subgroup Differences With ANOVA.
We found greater knowledge level at pre-test among participants with previous mental health training (
Non-clinical support group’s knowledge level was significantly lower than all other groups (
At pre-test, the regression model for attitude predictors was a significant fit of the data and 18.5% of variances were explained by the model (
For predictors of help-seeking intentions, at pre-test, the model was a significant fit of the data and 35.1% of the variances were explained by the model (
Further, at pre-test, 27 participants identified areas of interest including: evidence-based treatment and its processes; facilitators/barriers to prognosis and treatment; knowledge about mental health states and mental/neurodevelopment disorders (eg ADHD, Depression, and Down syndrome); patient consent; local/community resources and support.
At post-test, 48 participants discussed how they would apply their learning to their practice. Among them, 22 indicated that they planned to implement the new screening/assessment tools and rating tools; 18 participants recognized the significance of providing helpful resources to patients. Ten participants reported their intention to change their language to address youth mental health and be more patient and open with patients and families, reduce stigma around mental illness. Many (n = 32) mentioned they developed greater ability to identify signs and symptoms of mental disorders, deeper understanding about treatments, better differentiation between self-harm and suicide, and were more aware of the importance of healthy lifestyles to promote mental health.
Finally, participants expressed high satisfaction about the training, with high endorsement (87.5%-95.4%) of each satisfaction item.
Discussion
The primary care MHL training demonstrated preliminary evidence of effectiveness in improving participants’ knowledge about mental health. The qualitative data further indicated that participants felt more competent in addressing mental health in their everyday practice. Participants scored low at pre-test (
Participants demonstrated positive attitudes toward mental health and great intentions for help-seeking at both baseline and post-test, and therefore data analysis didn’t generate statistical significance. This high ceiling effect may be due to the social desirability bias by participants over-reporting “good behavior” or under-reporting “bad,” or undesirable behaviors. One potential solution is the use of social desirability scales in the future evaluation. 23 We found that more knowledge led to more positive attitudes toward mental health, and together encouraged greater help-seeking intentions. This finding explained the positive relationship among these 3 outcomes and were consistent with previous finding among youth. 18
These preliminary outcomes set foundations for further advanced research on clinical outcomes of the primary care MHL training, such as the quality of care and referral and patient satisfaction as the training aims to improve the competencies of primary care providers. Future research may also further investigate what changes actually occur in practice following the training.
This MHL training for primary care providers demonstrated evidence of the need to integrate mental health and addiction support into care provider education and practice through developing primary care providers’ competencies in this domain. This training for non-physicians aligns well with the CanREACH program to jointly address the mental health needs of Albertans in the primary care setting, and therefore has great potential to effectively enhance the mental health of Albertans and beyond. This training is designed to reach non-physicians in other geographical locations with modifications needed to accommodate local health care needs. Part of the training is adapted from the Go-To Educator training 16 that has been widely applied in other countries, which will provide guidance on how to collaborate with local health care systems for successful adoption.
This study lacked randomization in its design, which may lead to biased results. Secondly, most participants were from the Edmonton zone and the results may not be generalized to other non-physician primary care providers in the province. Participant self-selection for study could have contributed to bias. The suboptimal post-test survey rate could also limit result interpretation. These limitations warrant future advanced studies are needed to further validate the findings in the current study.
Footnotes
Acknowledgements
We thank the Edmonton Zone Primary Care Networks, Alberta Health Services, and CASA Mental Health to support this project as part of the “Building Service Capacity for Child and Adolescent Mental Health in Primary Care and Pediatrics” project.
Author Contribution Statement
Wei, McCaffrey, Baxter conceptualized the study together. Wei conducted the literature search and analyzed the data; prepared the manuscript, including designing tables and figures. McCaffrey and Baxter reviewed the data analysis and played the expert role to solve the discrepancies of data analysis. They also made significant revisions to the manuscript. All 3 authors reviewed and approved the final version of the manuscript.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was funded by Edmonton Zone Primary Care Networks.
Ethical Statement
The Health Research Ethics Board at the University of Alberta approved the study (approval: Pro00133446) on September 11, 2024. Respondents provided passive consent by completing the survey.
