Abstract
Introduction
Healthcare professionals have development needs related to their consumption, use, and practice of clinical research. Little is known about these issues in mental health services specifically.
Objectives
A survey of healthcare staff working in an NHS Mental Health and Disability Trust in England was conducted to describe research capacity and culture compared with previously reported samples, and to examine subgroup differences.
Methods
An online questionnaire was utilized. The main measure was the Research Capacity and Culture tool comprising measures of individual's perceived research skills and of team and organizational research culture. Previous studies using the same measure were systematically identified, and pooled results, weighted by sample size, were calculated. Analyses were descriptive (current sample versus previous results) and inferential (comparisons between demographic and professional groups within the current sample).
Results
Conclusion
Perceptions of individual research capacity and team and organizational culture were poor compared with previous studies, most of which were conducted in non-mental health settings. There is need for development of research capacity and culture in mental health services including opportunities to develop basic research skills through to strategic developments to promote clinical academic careers. There is considerable room for improvement in the way organizations support research and signpost opportunities.
Keywords
Introduction
Incorporating new knowledge from high quality research is key to evidence-based healthcare (Lehane et al., 2019). Research can extend knowledge about intervention content and effectiveness, illness prevention, diagnosis, and patient experience; in turn, these can facilitate healthier, longer lives, better experiences of health services, and improved use of valuable resources (Jordan et al., 2019). Engagement of health services in research activity, specifically in intervention trials, is significantly associated with indicators of mortality and care quality (Jonker & Fisher, 2018). Research using other paradigms including collaborative and action research also contributes to improved patient outcomes and greater uptake of evidence-based care processes (Boaz et al., 2015). The number of studies running in health services, as opposed to the number of participants recruited, is positively associated with better results from staff and patient surveys about information provision, teamwork, confidence in doctors, and inpatient experience (Jonker et al., 2019). A recent qualitative systematic review (Newington et al., 2021) found that research activity – as opposed to research findings – impacted positively on patients, service provision, economics, and staff recruitment and retention. In addition, the best available research evidence should inform the preparation of healthcare professionals in educational curricula content (Lehane et al., 2019), and should be available to practitioners who have the skills to identify, evaluate and implement it (Guyatt et al., 2000). At more advanced levels, healthcare practitioners are expected to participate in and lead on the identification of evidence gaps, the design and planning of research to meet those gaps, securing funding, conducting studies, analyzing data, and disseminating research results (NHS, 2017). In the UK, strategies to enhance the involvement of nurses (NHS England and NHS Improvement, 2021) and allied health professionals (NHS Health Education England, 2022) have been recently launched.
Given the above context, it is important to equip the clinical workforce with research-related knowledge, skills, and opportunities appropriate to their role, and to effectively utilize the capabilities of those with existing advanced research-related training. Practitioners of some professions have traditionally been viewed as less research active in general, and less active in research leadership specifically (Wenke & Mickan, 2016). For example, while non-medical healthcare professionals are striving to increase their role in research leadership and are targeting clinical academic roles in England to rise to 1% of all roles by 2030 (Westwood et al., 2018), 5% of UK medical consultants already work in such roles (Healthcareers NHS, 2017; National Institute for Health Research, 2016).
Review of Literature
Reflecting this ambition, recent studies have sought to establish research capacity and capability among non-medical healthcare professionals including allied health professionals, nurses and midwives, their teams and employing organizations (see Table 1). Some have used the empirically validated Research Capacity and Capability Questionnaire (RCC; Holden et al., 2012a). Table 1 summarizes 37 papers identified in a systematic literature search for primary research using the RCC for the current study. Twenty-seven studies were conducted in Australia, eight in the UK, and two in the US. Most involved Allied Health Professionals (AHPs) and most participants were AHPs. Only one sample, the smallest of those included, was drawn solely from a mental health service (Migliorini et al., 2022) while two further studies included <10% individuals working in mental health services within their samples (Comer et al., 2022; Gill et al., 2019). Mental health professionals, and mental health nurses in particular, are understudied.
Previous Published Studies Using the RCC and Reporting Median (IQR) or
I – RCC Individual factor; T – RCC Team factor; O – RCC Organizational factor; item – scores per item presented; total – scores presented as mean per item total score per factor.
Given the current lack of information, and in a policy context in which non-medical professionals are encouraged to develop research skills (NHS England and NHS Improvement, 2021; Royal College of Occupational Therapists, 2019), the current paper describes a survey of research capability and capacity conducted in a UK NHS Mental Health and Learning Disability Trust. The overall aim was to explore perceptions of individual research capacity, team and organizational culture among all non-medical health professionals. The term ‘Nursing, Allied Health Practitioners Plus’ (NAHP+) is used to describe the target sample since it extends beyond legally defined categories of ‘nurse’ and ‘allied health professional’ to encompass groups including psychologists, social workers, and pharmacists. A complete list of participating professionals can be seen in Table 2. The study was conducted to aid planning for increased future research capacity and impact. Objectives were: i) describe participants self-reported capacity to contribute to research activity, compare this between demographic and professional groups, and with results from previous research; ii) describe participants perceptions of team and organizational research culture making similar between group and across study comparisons; and iii) describe participants’ reports about their personal research interests, their perception of opportunities to get involved in research, and of individual and organizational barriers to, and motivators of, research activity.
Respondent Characteristics,
Methods
Design
A cross-sectional survey design with quantitative (objectives 1 and 2) and qualitative (objective 3) elements was used. Comparison data from previous literature was obtained from a literature search that followed principles outlined in the Preferred Reporting Items for Systematic Reviews and Meta Analyses. The study report complies with the Consensus-based Checklist for Reporting Of Survey Studies (CROSS; Sharma et al., 2021).
Sample
The study was conducted in Cumbria Northumberland Tyne & Wear NHS Mental Health Trust (CNTW), a large mental health and disability service provider in North East England serving a population of 1.7 million. CNTW employs 8,000 staff of whom around 4,000 met inclusion criteria for participation. A sample size calculation revealed that
Inclusion/Exclusion Criteria
Eligible participants were Trust employees (any age) who met the following criteria: nurses registered with the Nursing and Midwifery Council, or any practitioner of the 14 allied health professions identified by NHS England (n.d.) and regulated in the UK by either the Health and Care Professions Council, or the General Osteopathic Council; or psychologists, social workers, pharmacists, or other degree level non-medical practitioners including assistant psychologists and counsellors. A full list of participating professions is presented in Table 2.
Statistical Analysis
Results
Sample Characteristics
Professional groups were equally likely to hold Masters’ qualifications (Χ2 = 0.19, df = 3,
Of 36 respondents educated to doctoral level, 17 (47.2%) said research accounted for no part of their role; 14 (38.9%) said it accounted for 1–10% of their workload. Similarly, of those prepared to masters’ level, 88.9% reported <10% of their role involved research. Sizeable proportions of those educated to masters’ (25.4%) or doctoral level (38.9%) said research was not discussed in their annual appraisal; even more in each group (40.8% and 47.2% respectively) said research was only discussed if they raised the issue.
Research Objectives
RCC Individual Factor Results.
Weighted means and medians derived from previous studies (see Table 1).
The sole between group difference on individual factor mean-per-item score was that those who rated themselves the most research-skilled (SCORR scores 4 and 5) scored
RCC Factor Mean-per-Item Scores by Demographic and Professional Group.
Post hoc Tukey HSD indicates significantly lower score for those in group Years Qualified 21 + than all other categories.
Post hoc Tukey HSD indicates significantly lower score for those in group Years Qualified 21 + than all other categories.
RCC Team Factor Results.
Weighted means and medians derived from previous studies (see Table 1).
For the organizational factor,
RCC Organizational Factor Results.
Weighted means and medians derived from previous studies (see Table 1).
When asked which research-related information and opportunities were currently available in the Trust, the most recognized item (93.9%) was ‘Library services’ followed by ‘Information about what research is happening in the Trust’ (45.7%). The least affirmed were ‘Administrative support for research activities’ (7.5%) and ‘Opportunities to become a principal investigator’ (8.9%). Recognition of the ten remaining items was between 18.7% (‘Opportunities to be involved in delivering research’) and 30.7% (‘Funding within the Trust to support research’). Fifty-nine (20.1%) people provided a response to a follow-up free response item ‘Any additional comments about opportunities within the Trust?’ The most common cluster of comments related to the range of opportunities that are potentially available; these ranged from partial awareness (“
Responding to stimuli describing potential barriers to research participation, participants most commonly identified ‘pressure of clinical work’ and the ‘identification of research activity as a luxury’ (57.0%), ‘desire for a work/life balance’ (42.7%), ‘not knowing where to start’ (41.6%), ‘lack of skills’ (36.5%), and ‘lack of confidence’ (36.2%). These issues were reflected in free text responses made by 76.8% of respondents to a follow-up item about their experience of the biggest barriers to research activity. Time (“
Responding to items about motivators for research involvement, the most commonly affirmed were ‘to benefit service users/carers’ (80.2%); ‘to develop skills’ (78.8%), ‘increased job satisfaction’ (58.0%); and ‘problem identified that needs changing’ (47.1%). Free text responses made by 73.0% of respondents provided a similar range of views including learning and development (“
Discussion
The current paper describes a survey of NMAHP + individual research capacity and organizational research culture in a large mental health and disability NHS Trust. Results were compared with those from more than 10,000 health care employees across 42 samples in 31 previous studies. Previous studies have largely reported median per item scores while some have reported mean per item scores and a small number have reported mean per item factor scores; this has facilitated three sets of comparisons between the current sample's respondents and those from previous research. Results from all three sets of comparisons were consistent. Across the 51-items of the RCC, scores were poorer in the current sample compared with studies reporting medians in 39 cases and better in two. Compared with studies reporting means they were poorer in all 51 cases. This was reflected in factor level median and mean scores which were all poorer in comparison to previously reported results. While the reason for this clear discrepancy is not certain, it is notable that the sample examined in the current study is one of only two to be drawn entirely from a mental health organization.
In the current sample, capability in identifying and critically reviewing relevant literature were rated as adequate both (
Individual research skills items with median ratings of ‘adequate’ were about collecting data and designing questionnaires, activities which do not exclusively occur within the research domain. Other skills which are transferable between research and activities such as clinical audit or service improvement, for example data analysis, were rated as inadequate yet achieved levels in the adequate range in previous samples. Coupled with very low median ratings in the current sample related to knowledge of audit and service evaluation this is of concern. There is a need for ongoing programs of education for these groups of clinical staff that encompass evidence-based practice skills. Importantly, any such education program should seek to improve skills that are transferable between audit, service improvement and research. This may be best achieved by providing examples that are directly linked to practitioners’ own practice setting and congruent with their experience (Lyon et al., 2011).
Research skills related to writing for publication, advising others on research and securing funding were rated as less than adequate both in the current sample and previous samples. While there is no ‘correct’ proportion of employees who should have skills in these areas, this finding reflects the very low proportion of nurses and allied health professionals who have completed doctoral level studies. In the US, the number of graduations from nursing doctoral programs has remained between 611 and 804 for the decade 2012–2021(AACN, 2022). In the UK the number of PhD-prepared nurses in a typical university hospital is between 0 and 10 (Carrick-Sen, 2019). Leading on from this, a particularly notable finding was that over half of those respondents already prepared to doctoral level said that research played no part in their professional role whatever; for even more, research was not discussed, or only discussed if raised by themselves, during annual appraisals. Reflecting findings from a UK qualitative study of doctoral level nurses, it seems that their skills are under-utilized, especially when they remain in roles close to clinical practice (Hampshaw et al., 2022)
Nursing and allied health professionals have very different routes into clinical academic roles than their medical colleagues: the former group usually working for many years in clinical practice prior to developing a joint role, and the latter undertaking longer joint training from the outset of their career (Trusson et al., 2021). These are systemic issues that require addressing by professional bodies and at national policy level. Advanced practice masters’ programmes have had significant investment in England and are underpinned by four pillars: clinical practice, leadership and management, education, and research (NHS England, 2017). Findings from the current study suggest that while the advanced practice pillars imply a quarter of advanced practice relates to research, like findings from studies in non- mental health settings (Hampshaw et al., 2022; Palmer et al., 2023), this is not reflected in the day-to-day work While investment in funded pathways to clinical academic careers provides structure for joint clinical academic careers for non-medical professionals they are highly competitive, “hard to come by” (Palmer et al., 2023: p.6), and require significant preparation by applicants (NIHR & NHS Health Education England, n.d.). A requirement for employers to provide increased time and support to prepare for such opportunities is a consistent finding of studies seeking to evaluate nursing or allied health professional research capacity development (Bramley et al., 2018; Hampshaw et al. 2022; Palmer et al. 2023; Spring et al. 2023) if individuals are to apply successfully to these pathways. Research fellowship opportunities are not new in nursing and allied health professions, but recent studies identify the need for more sustained career development (e.g., Palmer et al. 2023). Importantly, successful innovative fellowships have included elements of transformational learning including mentorship and leadership (Palmer et al., 2023) alongside more traditional research training and opportunities to lead specific projects (Spring et al. 2023).
Organizational research culture was rated as adequate for more than half of the items in the current sample, just two fewer than weighted medians from previous samples. Still, the results suggest that this NHS Trust has considerable room to develop how it supports research culture for non-medical staff and, importantly, how information about research is communicated. A need for improved collaborations between university and health services leaders has been identified, to not only drive the development of joint clinical academic roles but to ensure that they are sustained over time through secure organizational ‘buy in’ (Spring et al. 2023) as the research culture takes time to change (Bramley et al., 2018; Palmer et al. 2023).
Team and organizational culture was rated similarly by profession, pay band, qualification level, and self-assessed research level; however, those with most experience (>20 years) held poorer views of both than their less experienced colleagues. This group might have been less exposed to evidence-based practice narratives during professional training. Disillusionment or failure to keep abreast of developments may also be a factor. There is an equal need to engage with longstanding employees around research ability and culture as there is to provide support for those earlier in their professional career. Those with longer professional experience are likely to be clinically expert and possess transferable knowledge and skills for research that could be optimized through research training and mentorship (NIHR, 2022).
Some of the above issues have been recognized by key research funders in England through ringfenced funding for underrepresented professions including nursing and allied health professionals (National Institute for Health and Care Research, 2023a,b). Such funding is important to address this study's finding, and those in comparator studies, that nurses and allied health professionals lack skills and confidence in applying for research funding. Whilst similarity between groups suggests that a united approach to developing nursing and AHP research careers could be viable, rather than diluting and replicating efforts, as recognized by the National Institute for Health and Care Research (2022), there is a need to ensure the distinct voice of each profession is acknowledged by having separate funding calls for nurses to allied health professionals.
A key question arising from the study is: does the derivation of our sample solely from a mental health and learning disabilities service provider explain dissimilarities with previous findings? Compared with Migliorini et al.'s (2022) study, conducted in a mental health service in Australia, median ratings were marginally less poor on individual skills (9/14 inadequate medians), but clearly better on team (12/19 inadequate medians) and organizational culture (3/18 inadequate medians). Compared with the current sample, Comer et al.'s (2022) UK-based study comprising approximately 10% of its sample from mental health services had fewer median ratings of inadequate on individual skills (6/14) and a similar number of inadequate medians on the remaining two scales (24/37). Clearly the current study cannot pinpoint a causal role for the mental health setting but it remains an issue for consideration and future comparative research.
While the results discussed this far are based on the quantitative element of the study, respondents were also provided with the opportunity to volunteer free text information about their own research interests, their perception of research opportunities within the Trust and of barriers to and motivators for research involvement. This facilitated some potentially rich complementary data to inform planning for future strategic research developments. Regarding the barriers to and motivators for conducting research, many participants identified insufficient time to be involved in research since priority was given to clinical activities. This resonated with the findings that research was not usually part of appraisal discussion. A key finding of a similar study in an acute care setting identified the need for research to be better integrated into clinical roles (Palmer et al., 2023). Staff shortages and lack of access to research funding were also linked by respondents to a need to prioritize clinical workload. This suggests that research in the organization is not seen as priority and this aligns with previous findings in UK and worldwide literature (Harrison, 2005; Hutchison & Johnston, 2006, Kanmounye et al., 2020). Since research skills are key to the development of evidence-based practice, a dialog is needed between staff, service mangers and academics to encourage incorporation of research activities as part of the routine clinical work in order to support the organization and the staff to meet their objectives about evidence-based practice.
For many clinicians, the infrastructure to facilitate research is inaccessible due to insufficient support or a lack of clear pathways to develop research skills (Oulton et al., 2022). Staff feel stymied by prevailing attitudes that research is solely an academic concern. This requires challenging with narratives about how research can impact positively on daily work and outcomes (Hicks, 1996). To harness the benefits of a research-active workforce, managers must develop a clear leadership vision and direction. Clear pathways to research training, managerial support, organizational leadership, vision and commitment are vital drivers for encouraging research culture in clinical practice (Atkinson et al., 2008; Lode et al., 2015; O’Byrne & Smith, 2010).
Reported research motivators highlighted respondents’ aspirations for career development, advancing clinical practice, and improving patient and staff experience. Ambition for career progression has been previously identified as a research motivation (Lode et al., 2015); however, funding access and research training availability is essential to support this. Increasing the availability of non-medical research role models and helping service managers to support staff could encourage practice-based research enthusiasts (Melnyk et al., 2004; National Institute for Health and Care Research, 2023a,b; O’Byrne & Smith, 2010). However, for sustainable change, it is essential to develop research strategies, communicate these effectively and place them centrally in organizational policies (Gee & Cooke, 2018).
Strengths and Limitations
The current study provides new information about mental health non-medical professionals, a group who have rarely been investigated using the current validated study tool. The comparison of results from the current sample with pooled weighted medians and means from all currently available comparable data is also a strength. Limitations include a low response rate, especially among nurses, which may reflect a lack of wider interest among this group of employees in research or may result from questionnaire distribution during the COVID-19 pandemic. However, the response rate was comparable to those reported in a number of other studies (ranked 25/30 among all reported response rates). As a result of under-recruitment there was a margin of error of 8.0% with a confidence level of 95%. Future research should endeavor to maximize response rate. There was no safeguard against multiple participation although, based on feedback received, completing the questionnaire was arduous and deliberate duplication seems unlikely. The primary data were collected in a single NHS Mental Health and Learning Disability Trust and thus results may not be generalizable to other settings. Future research should involve multiple organizations in order to facilitate comparisons and maximize generalizability.
Implications for Clinical Practice
Research activity in health services is associated with improved patient satisfaction and higher ratings of service quality. However, this survey suggests that non-medical practitioners in mental health services are not adequately prepared for roles in which working with knowledge derived from contemporary clinical research is vital, and where contributing to knowledge generation is at very least desirable. Changing this situation will require a commitment from mental health practitioners to identifying and taking development opportunities that contribute to their individual research capacity. Equally, it requires a commitment from employers to encourage staff and provide opportunities for development. Mental health services should review their organizational approach to growing research capacity and culture in order to maximize the benefits of research activity. There is a need for ongoing educational and developmental interventions to prepare staff in mental health services for roles in research. It makes sense to tailor these interventions for an audience that works in mental health services, and to maximize skills that also transfer to activities such as clinical audit. A joined-up approach across non-medical professions is warranted since there was no evidence of difference in the views of different groups.
Conclusions
There is ample room for much needed development in research capacity and culture for nurses and allied health professionals working in mental health services. There are indications that the need for development is perhaps even more urgent in this mental health setting, and this will need to incorporate tailored education that includes transformational learning (such as through mentorship) alongside more traditional research training. Organizational infrastructures that improve access to and participation in healthcare research and provide time and resources integrated as part of existing roles. Nursing and allied healthcare professional leaders at a national level should consider development of stronger leadership collaborations between universities and health services to increase the availability and buy in to support clinical academic careers.
Supplemental Material
sj-docx-1-son-10.1177_23779608241250207 - Supplemental material for Mental Health Nurses’ and Allied Health Professionals’ Individual Research Capacity and Organizational Research Culture: A Comparative Study
Supplemental material, sj-docx-1-son-10.1177_23779608241250207 for Mental Health Nurses’ and Allied Health Professionals’ Individual Research Capacity and Organizational Research Culture: A Comparative Study by Geoffrey L. Dickens, Maria Avantaggiato-Quinn, Sara-Jaye Long, Mariyana Schoultz and Nicola Clibbens in SAGE Open Nursing
Footnotes
Author Contributorship
GLD: Conceived of and designed the study, analyzed and interpreted data, drafted the article, gave final approval of the version to be published, and agrees to be accountable for all aspects of the work
MA-Q: Conceived and designed the study, analyzed and interpreted data, drafted the article, gave final approval of the version to be published, and agrees to be accountable for all aspects of the work
S-JL: Conceived and designed the study, analyzed and interpreted data, drafted the article, gave final approval of the version to be published, and agrees to be accountable for all aspects of the work
MS: Analyzed and interpreted data, drafted the article, gave final approval of the version to be published, and agrees to be accountable for all aspects of the work
NC: Analyzed and interpreted data, drafted the article, gave final approval of the version to be published, and agrees to be accountable for all aspects of the work
Declaration of Conflicting Interests
The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article. Authors GLD, MA-Q, S-JL and NC are employed by or seconded to the Trust.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The study was supported by Cumbria Northumberland Tyne & Wear NHS Trust as part of author MA-Q's employment role.
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
