Abstract
Objective
This study examined whether being scheduled in a screening clinic versus scheduled directly with a long-term provider to conduct a mental health intake (MHI) is associated with engagement in child psychiatry services in New England, USA.
Method
We used electronic medical record data from one safety-net hospital serving a predominantly low-income and minoritised population. The study sample included 815 youths aged 0 to 25 years, referred or scheduled for a MHI between 1 January 2016 and 31 December 2016. We used chi-square and t-tests to examine the association between referral pathways and engagement, logistic regression to understand the relationship between youth’s socio-demographic characteristics and referral pathways, and logistic and Poisson regressions to assess potential moderating effects of socio-demographic characteristics on engagement.
Results
The mean age of the study population was 12 years; 46% were female, and the majority had public health insurance (84%) and lived in high social vulnerability areas (65%). Less than half of the youth attended the first scheduled MHI visit. Those scheduled with the screening clinic were less likely than those scheduled with the provider to ever attend a MHI appointment. Spanish-speakers were more likely to be directly scheduled with a provider (Odds Ratio, OR 0.48; 95% CI: 0.32, 0.73), while those with public health insurance were more likely to be scheduled with the screening clinic (OR 0.56; 95% CI: 0.43, 0.96). Spanish-speaking status and areas social vulnerability scores moderated the relationship between the referral pathway and engagement in psychiatric appointments.
Conclusions
The study highlights the need for psychiatric services to evaluate how MHI referral procedures may mitigate barriers to care and facilitate engagement for youth at high risk of not attending psychiatric service appointments.
Introduction
Poor attendance is a well-documented challenge in child psychiatric services.1,2 Approximately one third of youth referred for specialty care do not attend their first-session appointment 3 ; average attendance is around four scheduled visits, 4 or lower among minoritised youth. 5
Mental health intake (MHI) procedures, which include initial clinical interviews, intake interviews, or clinical diagnostic interviews, are meant to help clients initiate care in child psychiatry services,6–8 although they may inadvertently perpetuate lower treatment engagement. While MHI procedures are common in psychiatry practice,9–11 there is a lack of empirical evidence supporting their use,9,12,13 with limited understanding of how these procedures influence engagement in child psychiatry services. 2
There are two common MHI pathways. In the MHI-Only Referral Pathway (MHI only) a client completes the MHI with a screening clinic or provider who will then refer them to a second provider for long-term care. In the MHI + Long-Term Care Referral Pathway (MHI + long-term care), the provider that conducts the MHI also delivers long-term care (Figure 1). There is strong evidence to suggest that clients who continue with their MHI providers for long-term care benefit from care continuity, building upon the established therapeutic relationship formed during the MHI.12–15 Conversely, the MHI only referral pathway may disrupt care, leading to perceptions of uncoordinated treatment.
16
Types of referral pathways in child psychiatry services.
Youth may disclose sensitive information, including about their cultural background, immigration history, discrimination, racism, and trauma, for the first time during the MHI, 17 requiring a ‘leap of faith’ and trust in the provider. Entering the service through the MHI only pathway means that clients will have to re-share their histories with different providers. This may lead to people discontinuing their care and increase mistrust, worsening treatment outcomes and attendance in mental health treatment.
There is some evidence that the MHI only pathway can exacerbate existing barriers to care for culturally and linguistically diverse youth and those facing high levels of social vulnerability. They often already encounter barriers such as resource inequality and discriminatory practices,6,8,13,14,16,18 making it even more difficult for them to engage in care. They may also be more likely to be triaged to the MHI only pathway due to well-documented systematic disparities in care pathways, 19 with underserved clients often not referred to the best treatment options. 18 Young people are more likely to engage in mental health treatment when they establish a direct connection with a provider for long-term care, 15 suggesting that the MHI + long-term care referral pathway may improve attendance in child psychiatry services compared to the MHI only referral pathway.
The MHI only and MHI + long-term care referral pathways are established procedures in clinical practice but there is a lack of standardisation,6,13 and limited understanding of their relative impacts. 1 In this study we examined the potential effects of these referral pathways on engagement in psychiatric appointments in a large safety-net hospital in the USA. We hypothesised that the MHI only referral pathway would be associated with worse rates of initial, delayed, and sustained engagement in psychiatry department services compared to the MHI + long-term care pathway. Based on research examining systemic racism in health care in the USA, 18 we further hypothesised that youth who are non-English speakers, have public insurance, and face high levels of social vulnerability, would be more likely to be referred to the MHI only pathway compared to the MHI + long-term care pathway. Finally, we hypothesised that socio-demographic characteristics will moderate the relationship between referral pathways and engagement, that is, Spanish speakers, those with public insurance, and with high levels of social vulnerability who are referred to the MHI only pathway will have poorer initial and sustained engagement as well as more delayed engagement than their counterparts.
Methods
The study was set in the largest safety-net hospital in New England in the USA. In 2016, over half (54%) of the patient population served by the hospital were from racial/ethnic minoritised communities, some 46% spoke a non-English language at home, and 75% had government insurance (e.g., Medicaid). 20 Most patients reported that poverty was a major stressor in their lives.
Study sample
We used deidentified electronic medical records to identify young people aged 0–25 years who were referred or scheduled for a MHI at the safety-net hospital’s Child & Adolescent Outpatient Psychiatry Center between 1 January 2016 to 31 December 2016. This period was selected following standard clinical referral procedures to account for seasonal variation in scheduled visits (e.g., due to the school calendar). Of all youths seen during that period (N = 1461), 815 met our inclusion criteria; 646 were excluded because they were existing patients continuing care from the previous year. Data extracted from the final sample included demographics, referrals, and visits (scheduled, rescheduled, cancelled, and attended). All psychiatry department visit types were included; thus we considered new patient sessions, long and short therapy sessions, consultations, groups, medication management visits, and risk of harm evaluations.
Variables
Demographic characteristics
Age was a continuous variable. Gender was coded as male (reference) and female. Preferred language was coded as English (reference), Spanish, and other (e.g., Haitian Creole and Port Creole/Cape). Insurance was coded as private (reference) and public. There were no missing data for the demographic data except for race/ethnicity. Although the data programmer did not report the percentage of missing data for race/ethnicity, variables with 10–40% missing data are often unusable without substantial imputation measures. 21 Therefore, we did not extract the race/ethnicity variable, and as a result, it could not be included in the analysis.
Social vulnerability
We used the individual youth’s post office area (ZIP) code and matched it to the 2016 CDC Social Vulnerability Index (SVI) score.
22
The CDC SVI ranks census areas (county subdivisions) based on 15 social factors, including race/ethnicity, language, poverty, and crowded housing on a scale as low (0
Referral pathway
The standard policy at the Child & Adolescent Outpatient Psychiatry Center was to send clients to a screening clinic for a 15-minute MHI to determine needs before assigning clients to a provider for a full assessment and long-term care. This referral pathway was coded as MHI only. However, some patients were scheduled directly with a specific provider for long-term care. An internal clinician or social worker could schedule patients directly to individual providers. This referral pathway was coded as MHI + long-term care (reference). Details about who specifically scheduled patients directly to providers were not documented in medical records.
Patient engagement
Patient engagement was categorised as: initial (attended the first scheduled MHI visit: yes/no), delayed (number of rescheduled visits necessary for youth to attend the MHI), and sustained engagement (number of attended scheduled appointments, up to 24 visits, after youth completed the MHI). We set a cut-off of 24 visits, as only 23 of 815 (2.8%) youth had more than 24 appointments. Visits include therapy sessions, consultations, groups, medication management visits, and risk of harm evaluations. This cut-off aimed to account for the variability in specialty care, which extends beyond the typical 12–16 visits for evidence-based psychotherapy, and includes a range of treatment and support services.
Analysis
We used descriptive statistics to report demographic data and chi-square and t-tests to examine the association between MHI only and MHI + long-term care pathway with initial, sustained, and delayed engagement. We used multiple logistic regression to assess the association between youth’s socio-demographic characteristics and referral pathway, controlling for age and gender. We conducted moderation analyses using multiple logistic and Poisson regressions to further examine the degree to which socio-demographic characteristics moderated the effect of the referral pathways on initial, sustained, and delayed engagement. Moderation analyses included interaction terms between the referral pathway and each moderator (preferred language, insurance type, and SVI), controlling for age and gender. All logistic regression results are presented as odds ratios.
Ethics review
This study received ethical approval (BMC H-36037; UCLA IRB#20-002281) from the University of California, Los Angeles and the safety-net hospital in New England, USA.
Results
Socio-demographic characteristics and engagement outcomes by referral pathway.
Note. *Significance level of p = < .05. **Significance level of p = < .001. ∼Trend towards significance at p = < .06. M refers to mean. SD refers to standard deviation.
Referral pathway’s association with initial, delayed, and sustained engagement
Initial engagement
Of the 815 clients, less than half attended the first scheduled MHI visit (339; 41.6%). There was a trend towards fewer youth attending the first scheduled MHI appointment when referred to the screening clinic (37.8%) than when referred directly to a specific provider (44.5%; p = .054). Including rescheduled MHI appointments, 493 (60.5%) youth ever engaged in services over the observation period. Youth were less likely to ever engage if they were scheduled to the screening clinic (51.7%) than if they were scheduled to directly see a provider (67.2%; p < .001).
Delayed engagement
Of the 493 youth who ever engaged in care, most attended the first scheduled visit (339; 68.8%), followed by the second visit after missing the first (114; 23.1%). Only 8.1% (40) attended a visit after missing two scheduled appointments. Youth assigned to the screening clinic required fewer rescheduled appointments (M 1.34; SD 0.62) to engage in care than those referred directly to a provider (M 1.48; SD 0.79; p = .04).
Sustained engagement
Of the 493 clients who ever engaged in care, 24.8% (122) did not attend follow-up appointments, and about one in five attended only one (111; 22.5%), or five or more appointments (108; 21.9%). After the MHI, the mean number of follow-up appointments attended was 2.97 (SD 3.76; range 0 to 22), with no difference between screening clinic (M 3.12; SD 4.08) and direct referral to provider (M 2.73; SD 3.08).
Association between youth’s socio-demographic characteristics and referral pathway
Preferred language
Association between youth’s socio-demographic characteristics and referral pathway.
Note. The dependent variable in this logistic regression analysis is referral pathway coded as 0 = MHI + long-term care (direct referral to provider) and 1 = MHI only (screening clinic). The logistic regression controlled for age and gender. *Significance level of p = < .05. SE refers to the standard error. Z ratio is also known as a Z score or Z statistic.
Health insurance
Publicly insured youth were more likely to be scheduled in the screening clinic (44.7%) than those privately insured (35.4%; OR 0.56; 95% CI: 0.43, 0.96).
Social vulnerability
There were no differences in mean SVI scores between youth scheduled to the screening clinic versus those referred directly to a provider.
Association between youth’s socio-demographic characteristics, referral pathway, and engagement
Initial engagement
Association between youth’s socio-demographic characteristics, referral pathway, and initial engagement.
Note. The dependent variable in the logistic regression analysis for attendance at first scheduled MHI appointment is coded as 0 = did not attend first scheduled MHI appointment and 1 = yes, attended first scheduled MHI appointment. The dependent variable in the logistic regression analysis for ever engaged in care is coded as 0 = did not attend any scheduled MHI appointments and 1 = yes, attended at least 1 scheduled MHI appointment. The logistic regressions controlled for age and gender. *Significance level of p = < .05. SE refers to the standard error. Z ratio is also known as a Z score or Z statistic.
Youth who had private insurance (OR 1.96, 95% CI: 1.11, 3.47) and those who spoke Spanish (OR 1.78, 95% CI: 1.04, 3.05) were more likely to ever engage in care, however these factors did not moderate the relationship between screening clinic and ever attending a psychiatry visit (Table 3). SVI scores moderated the relationship between screening clinic and ever attending a psychiatry visit (OR 3.43; 95% CI: 1.18, 9.98). Youth living in the most vulnerable and least vulnerable areas were less likely to ever attend psychiatry services when referred to the screening clinic (Online Supplement Figure S1).
Delayed engagement
Socio-demographic characteristics did not moderate the relationship between referral pathway and number of rescheduled visits among youth who eventually engaged in care (Online Supplement Table S1).
Sustained engagement
Association between youth’s socio-demographic characteristics, referral pathway, and follow-up appointments after the MHI.
Note. The dependent variable in this Poisson regression analysis is sustained engagement which is coded as the number of follow-up appointments after the MHI. The Poisson regression controlled for sex and gender. *Significance level of p = < .05. β refers to the beta coefficient. SE refers to the standard error. Z ratio is also known as a Z score or Z statistic.
Discussion
This study examined the effects of two referral pathways on youth engagement in child psychiatry services in the largest safety-net hospital in New England, USA. We found that, in 2016, 58% of youth who were referred to the screening clinic or directly to a provider missed their first scheduled MHI appointment. Even after rescheduling, approximately 40% did not attend their MHI appointment. This level of non-attendance for the first appointment is almost twice as high than previously reported (33%). 2 Our results demonstrate that low initial attendance in child psychiatric services continues to be a widespread issue, which has been associated with increased emergency service use, poor health outcomes, suicide, and premature mortality.17,23,24
We found that socio-demographic characteristics were associated with low engagement and MHI procedures. Thus, young people living in the most vulnerable areas in New England were less likely to ever engage in psychiatric care for the MHI. This is consistent with previous research which indicated that clients from high vulnerability neighbourhoods experience more challenges engaging in health care, often due to financial and logistical barriers. 25 These barriers could have prevented youth from ever attending their MHI appointment. Similarly, young people with public insurance were less likely to attend their first MHI appointment compared to those with private insurance. This is also consistent with national data suggesting that people with public insurance have lower engagement with mental health care despite greater need, 26 often due to service costs.26,27 We further found that people with public insurance were more likely to be referred to the MHI only pathway than privately insured youth, possibly due to third-party reimbursement policies.10,18 Clients with public insurance are less likely to successfully schedule primary care appointments 26 which is often required for specialty care. Administrative staff at the Child & Adolescent Outpatient Psychiatry Center may have used information about external referrals, such as from primary care, 19 and youth’s insurance type to determine which clients could be referred to the MHI only or the MHI + long-term care pathways, as private insurance did not reimburse the MHI only pathway.
These findings point to an urgent need for psychiatric services to evaluate organisational processes to mitigate clinic-based barriers and proactively engage youth who are at higher risk of not attending their initial MHI appointment. For example, we found that Spanish-speaking youth were less likely to be referred to the MHI only pathway and were more likely to engage in psychiatric care, which contradicted our initial hypothesis. Our findings might reflect the safety-net hospital’s availability of bilingual Spanish-speaking providers, 20 who could conduct the MHI in Spanish and may have helped Spanish-speaking clients overcome linguistic barriers and improve engagement in care.28,29
MHI procedures often confuse clients, 17 with differences in administrative workflow, service availability, and third-party reimbursement for specific visit types. 1 This variation can reduce engagement in psychiatry services. We found that youth were less likely to ever attend a MHI appointment when referred through the MHI only pathway. We also found that youth in the MHI + long-term care referral pathway had more rescheduled MHI appointments than youth in the MHI only pathway. These findings suggest that referral pathway type may influence appointment attendance and rescheduling, potentially due to differences in administrative workflow decisions unique to each pathway; 1 however, further research is needed to examine these pathways in greater detail.
Finally, we found that clients attended a total of four sessions on average, which is consistent with attendance rates in other mental health care settings.4,16 Spanish speakers attended slightly more follow-up appointments on average when referred to the MHI only pathway. This implies that while having a Spanish-speaking provider in the MHI + long-term care pathway may be beneficial, it may not address all barriers to sustained engagement. 28 Screening clinics that conduct the MHI should evaluate key factors such as client’s diagnosis, cultural background, structural barriers, and experiences of discrimination, racism, and trauma.11–13,18 These factors are critical for effective provider-client matching, ensuring that client needs align with provider skills and training, and can significantly impact sustained engagement in follow-up care. In addition to addressing clients’ language needs,11,29 further research is needed to better understand how differences in referral pathway processes, such as length of visit, quickly addressing structural or social needs when referred to other public sectors, and making referrals, can improve engagement in child psychiatric services.
Study limitations
Our dataset did not allow assessing participants’ racial/ethnic identity and we were thus not able to investigate racial and ethnic disparities in engagement with psychiatric services. Due to the limited nature of our dataset, the reasons why youth terminated treatment or which providers scheduled clients directly to individual providers cannot be assessed. This limits our understanding of potential workforce availability and workflow decisions that may impact engagement. We did not find that SVI scores predicted the likelihood of being referred to the screening clinic or to a direct provider, possibly due to the low variability in scores, as over 80% of participants lived in moderate to high vulnerability areas. Finally, our study was conducted in one hospital only and findings are therefore not generalisable.
Conclusions
Our findings suggest that the MHI + long-term care pathway may be more effective at engaging youth in psychiatry services than the MHI only pathway. However, there is a need for further research to better understand the content and focus of each of type of MHI referral pathway, and organisational decision making. Psychiatry services should identify and address structural barriers, and consider adopting new procedures, such as the use of interdisciplinary teams that could engage youth during MHI appointments and reduce treatment dropout. If psychiatry services can keep clients engaged in care, it might help the nation offset a loss of revenue of $150 billion annually for missed appointments 30 and improve mental health outcomes for youth in the USA.
Supplemental Material
Supplemental Material - Engagement in child psychiatry department appointments: An analysis of electronic medical records in one safety-net hospital in New England, USA
Supplemental Material for Engagement in child psychiatry department appointments: An analysis of electronic medical records in one safety-net hospital in New England, USA by Yesenia Aguilar Silvan, Lisa R Fortuna, Andrea E Spencer and Lauren C Ng in Journal of Health Services Research & Policy.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Ethical statement
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
