Abstract
Objective:
The purpose of this article was to assess the satisfaction of adult patients who received mental health services (MHS) in healthcare networks staffed by multidisciplinary professionals and offering a range of MHS, and to identify variables associated with patient satisfaction.
Methods:
This cross-sectional study included 325 patients with mental disorders (MDs) among 4 Quebec health service networks. Data were collected using 9 standardized instruments and participant medical records. A 3-factor conceptual framework (predisposing, enabling, and needs-related factors) based on Andersen’s Behavioral Model was used, integrating sociodemographic, clinical, needs-related, service utilization, social support, and quality-of-life (QOL) variables. An adjusted multiple linear regression model was performed.
Results:
The global mean score for patient satisfaction was 4.11 (minimum: 2.0; maximum: 5.0). Among the enabling factors, continuity of care, having a case manager, and help received from services were positively associated with patient satisfaction, whereas being hospitalized was negatively associated. Among the needs-related factors, the number of needs was negatively associated with satisfaction.
Conclusions:
Findings demonstrated higher levels of satisfaction among patients who received good continuity of care and well-managed, frequent services in relation to their needs. Dissatisfaction was higher for patients with serious unmet needs or those hospitalized, which underlines the importance of taking these particular variables into account in the interest of improving MHS delivery and patient recovery.
Introduction
Patient satisfaction related to health services has been increasingly studied during the past 20 years, because satisfaction is a good indicator of quality in service delivery and individual healthcare. Patients satisfied with the effectiveness of interventions are more treatment compliant and tend to take better advantage of services. 1 A high level of satisfaction among patients using mental health services (MHS) also increases involvement in treatment and supports recovery. 1,2 Yet patient satisfaction with mental health (MH) care is particularly challenging among those with multiple and diverse needs. Healthcare reforms aimed at increasing quality in health systems have viewed patient satisfaction as an important consideration.
Studies have demonstrated that men, 3 –5 the elderly, 4,6 –8 and educated patients 3 are relatively more satisfied with MHS. Ethnicity also has an effect on patient satisfaction; that is, belonging to an ethnic group may be associated with variability in conceptualizations of satisfaction and in expectations associated with care. 2,9,10 Other research showed a decrease in patient satisfaction among people with severe mental disorders (MDs) (e.g. schizophrenia and schizophrenia spectrum disorders) following the experience of pharmacological disturbances, 9,11 –13 although the association between severe MDs and satisfaction did not reach significance. 14,15 As underlined in the literature, the needs of patients in treatment, whether directly related to MH, are more vital research considerations than clinical characteristics are. Studies have also observed that fewer unmet needs related to an adequate support in different life domains were related to better patient MH recovery, 6,16 –18 increasing satisfaction with MHS in turn. 1,2
Good communication between patients and professionals 19,20 as well as rapid and effective patient health management were also identified as determinants of high satisfaction. 13,21 Positive attitudes among service providers, professionalism, 9,22 and professional competence 22 –24 also had a positive impact on satisfaction. Moreover, research has identified the importance of an appropriate and adequate environment for providing patient care. 15 In this connection, patients who received services outside of hospitals, in public or community care programs, were particularly satisfied with their treatment compared to hospitalized patients. 24 Continuity of care and longer treatment duration, among more vulnerable patients especially, were other important determinants of increased patient satisfaction. 8,24,25 Finally, quality of life (QoL), which includes satisfaction in life domains related to housing, money, and relationships, as well as family and social networks, also related positively to patient satisfaction. 7,25 –31
Many studies have analyzed patient satisfaction for specific populations and for particular types of services. Patient satisfaction has been evaluated for different population groups, including adults, 32 children and adolescents, 1,20 –22,33 geriatric patients, 34 and veterans. 25 Other studies analyzed patient satisfaction for specific clinical diagnoses, including schizophrenia and major depression. 11,26,35 Regarding different types of MHS, studies have assessed satisfaction following admission to public hospitals 6,12,13,19,20,22,36,37 as well as services received through public clinics or community programs. 1,9,38 –43 Comparisons of patient satisfaction among those who received hospital treatment versus outpatient treatment demonstrated patient preferences for community-based services. 14,44 Finally, patient satisfaction has generally been evaluated in particular geographic areas, whether urban 21 or rural, 7,40 in both European and Middle Eastern countries 14,22 and in the United States. 10 Few studies on service utilization and patient satisfaction have been conducted in Quebec, Canada. However, the available studies have used cohorts of immigrants recruited exclusively from the island of Montreal, 45 or from single settings (e.g. outpatient settings) in urban areas. 46 –48
Several tools have been developed to optimize the evaluation of patient satisfaction, including the Verona Service Satisfaction Scale (VSSS: VSSS-54, VSSS-32, and VSSS-EU), partly adapted from the Service Satisfaction Scale (SSS), which measures satisfaction with MHS received during the previous year. 14,19,23,26,44,49 –53 The Client Satisfaction Questionnaire (CSQ/CSQ-8) also estimates general satisfaction with services, 1,36,39,54 whereas the Barker instrument assesses care received from psychiatrists. 38 Many studies have adapted these instruments 9,11,15,32,55 or developed others with qualitative, quantitative, or mixed-method approaches in line with study objectives. 3,4,10,40,41,56,57 Among previous studies conducted in Quebec that used standardized tools, 46,47 however, none assessed the overall impact of service utilization or types of professionals on patient satisfaction. Moreover, to the best of our knowledge, no study has evaluated patient satisfaction with MHS in Quebec, taking into account both urban and semirural areas, and including the full range of MH diagnoses.
This study is based on Andersen’s Behavioral Model, 58 the most frequently used tool for identifying factors associated with health service use. This model distinguishes variables according to predisposing, enabling, and needs factors. Predisposing factors are sociocultural characteristics of individuals existing prior to diagnosis, such as gender and age. Enabling factors represent the logistical aspects of obtaining MH care, including facilitators to healthcare use. Needs factors, based on a variety of functional and health-related problems, are considered the most immediate motivational factors in seeking help from MHS. Although previous studies have established relationships between specific sociodemographic and diagnostic variables, and predisposing and needs factors, certain other variables such as type of housing, help desired, help received from services, and help received from relatives, as enabling factors, have received little attention. Moreover, no study has tested variables in the multidimensional Andersen model for associations with patient satisfaction or with MHS utilization.
This study aims to assess satisfaction with MHS utilization among adults with various MDs, including both severe and common (e.g. anxiety and depression) conditions, living in communities and using a variety of services and professionals. A second objective is to identify variables associated with patient satisfaction. Based on studies of MHS utilization using the Andersen model, we hypothesize that needs-related variables and predisposing factors, in that order, will better explain levels of patient satisfaction with MHS. The unique contribution of this study was to systematically examine sociodemographic, clinical, needs, QoL, and social support variables, as well as service use variables including continuity of care, in association with global satisfaction within a network of diversified services. Using the Andersen model and integrating variables not previously tested for patient satisfaction, the study will identify potential variables related to patient satisfaction or dissatisfaction with MHS.
Method
Setting
The study occurred in 4 health service networks located in Quebec, including 3 urban areas and 1 semi-urban area. Populations ranged from 135,000 to 300,000 inhabitants. Networks included service delivery by general hospital psychiatric departments and psychiatric hospitals, inpatient and outpatient MH teams, primary care clinics including general practitioners (GPs) and psychologists, addiction centers, community health and social service centers (CLSCs), and community-based MH organizations offering day centers, crisis services, self-help groups, supported housing, and employment programs for consumers with MDs and with co-occurring problems. The study coincided with implementation of the Quebec Mental Health Reform (2005–2015), 59,60 which aimed to improve the accessibility, quality, and continuity of healthcare by developing primary care and optimizing integrated service networks.
Study Design, Sample, and Data Collection
The study was cross-sectional. Participants were 18–70 years old and diagnosed with schizophrenia spectrum disorders or other conditions, including mood, anxiety, obsessive–compulsive, personality, attention-deficit hyperactivity, or stressor-related disorders, according to the DSM-V. Patients too clinically fragile to provide informed consent and complete data collection were excluded, as were those hospitalized during the study period, anyone under involuntary treatment by judicial order, or anyone affected by a severe intellectual disability. Various recruitment strategies were used, including self-referral in response to posters displayed at hospitals or in CLSCs. Data were collected from June 2013 to August 2014. A professional interviewer trained by a research coordinator conducted two 90 min interviews at 1 week intervals with each participant. All participants were required to sign a consent form. The study was approved by the Ethics Board of the Douglas Mental Health University Institute (ref. no. 07/35). Recruitment strategies and data collection are more fully described in Roux et al. (2016). 61
Conceptual Framework, Variables, and Instruments
The analytical framework based on Andersen’s Behavioral Model is presented in Figure 1 . Variables were selected for potential association with patient satisfaction, the dependent variable, including those identified in previous studies. Table 1 describes standardized instruments used to measure each variable. The dependent variable was measured with the Service Utilization Questionnaire (SUQ), 62 completed by each patient. The SUQ measured the type, number, and frequency of MHS and professionals consulted (e.g. hospitalization; community-based services: crisis centers, day centers, self-help groups, and employment integration programs; as well as psychiatrists, general practitioners [GPs, including family physicians], nurses, psychologists, social workers, case managers, and alcohol and drug counselors). The questionnaire also asked about professionals consulted (e.g. in hospitals, walk-in clinics, medical clinics, CLSCs, and specialized service centers). For every MHS or professional consulted, a single follow-up question on satisfaction was asked: “What is your level of satisfaction with the service you received?” Responses were recorded on a 5-point Likert-type scale ranging from “very unsatisfied” to “very satisfied.” A global score for patient satisfaction with the use of all MHS and professionals was calculated for construction of the dependent variable (range: 3.0 to 59.0).

Conceptual framework of variables tested for association with patient satisfaction in a sample of individuals with mental disorders.
Instruments.
The independent variables are presented in Figure 1 and were organized according to 3 factors based on the Andersen model. 58 Predisposing factors included age, sex, education, civil status, accommodation (living alone), and spoken language. Enabling factors included income source (welfare/other), type of housing, recovery orientation of services and personal recovery, QoL, social support, service utilization (type, number, and frequency), continuity of care, amount and adequacy of help received from relatives and/or services, amount of help desired, and involvement in treatment decisions. Recovery orientation of services was evaluated with the Recovery Self-Assessment Scale, revised person-in-recovery version (RSA; 32 items, 5-point Likert-type scale responses, Cronbach’s α = 0.94), 63 whereas personal recovery was assessed with the Recovery Assessment Scale (RAS; 41 items, 5-point Likert-type scale responses, Cronbach’s α = 0.76–0.97). 64 QoL was assessed with the Satisfaction with Life Domains Scale (SLDS; 20 items, 7 Likert-type scale response levels, Cronbach’s α = 0.92), 65 and social support with the Social Provisions Scale (SPS; Cronbach’s α = 0.92). 66 Continuity of care was measured with the Alberta Continuity of Services Scale for MH (ACSS-MH; 43 items, 5-point Likert-type scale responses, Cronbach’s α = 0.78–0.92), 67 whereas adequacy of help, help desired, and involvement in treatment were assessed using the Montreal Assessment of Needs Questionnaire (MANQ; based on 26 areas of need and scored with 11 Likert-type scale response levels, Cronbach’s α = 0.70–0.73). 68 The MANQ was derived from the Camberwell Assessment of Needs (CAN). 69
Needs factors included diagnosis, number of MDs and co-occurring disorders, lifetime and recent suicidality, family history of MDs, and both number and severity of needs. The Alcohol Use Disorders Identification Test (AUDIT; 10 items, 4-point Likert-type scale responses, Cronbach’s α = 0.88) 70 evaluated alcohol consumption and use, whereas the Drug Abuse Screening Test (DAST-20; 20 items, yes/no responses, Cronbach’s α = 0.74) 71 evaluated drug use. The number of patient needs and their level of severity were assessed using the MANQ. 68
Analyses
Missing values were detected using SPSS’s 72 missing value analysis feature, which shows the number of participants with missing values, the total number of missing values, and the pattern of missing values (random vs. systematic). Variables with more than 5% missing were discarded. The few variables with missing values were treated by imputing the most likely value using regression analyses (multiple imputation). We have also tested post-hoc bivariate and multivariate analyses using a database with missing values replaced by mean values, instead of multiple imputations. Using box plot graphs, no outliers were detected. Univariate analyses were run, including frequency distributions for categorical variables, and central tendency measures (mean and standard deviations) for continuous variables. The overall patient satisfaction score was assessed for normality assumptions (skewness and kurtosis). Bivariate analyses were then run using t-test ANOVA, assessing statistical associations between each independent variable separately, and with patient satisfaction (α value at p = 0.10). Variables found to be significant were used to build an adjusted multiple linear regression model (α value at p = 0.05). The model was assessed for the total variance explained and goodness of fit. SPSS 24th edition was used to run analyses. 72
Results
Overall, 339 participants were recruited for a response rate of 81.2%. After removing missing values, this study included 325 patients. Comparative analyses between respondents and nonrespondents with regard to age and gender yielded nonsignificant results (Age: ANOVA t-test: F=620; P=0.453; Gender: Pearson χ2 = 0.522; P = 0.829). Mean patient age ( Table 2 ) was 48 years (SD: 12), and participants were equally divided by gender. Most were single (85%), and 43% reported living alone. Fewer than half had more than a high school education (47%), and 83% lived in autonomous (nonsupervised) housing. The most prevalent MDs were mood disorders (44%), schizophrenia (30%), personality disorders (29%), and anxiety disorders (19%).
Participant Characteristics (N = 325).
All participants had used at least 1 MHS or professional in the previous 12 months; 85% reported having a family physician, and 22% had been hospitalized (
Table 2
). Patients had visited more than 4 MHS and consulted 3 MH professionals, on average, in the previous year, mainly psychiatrists (74%), nurses (63%), and social workers (51%). The most frequently visited community services were food banks (30%), day centers (25%), and organizations offering self-help groups (23%). Psychiatrists, psychologists, and nurses were most often consulted in hospitals; GPs in private medical clinics; social workers in CLSCs; and alcohol or drug counselors in addiction rehabilitation centers (
Variables Associated with Satisfaction
Variables associated with overall patient satisfaction in the bivariate analysis are presented in Table 3 . The multiple linear regression model built from the bivariate results yielded a total explained variance of 28% and had acceptable goodness of fit. With regard to enabling factors ( Table 4 ), continuity of care (p < 0.001), having a case manager (p = 0.034), and help received from services (p = 0.048) were positively associated with patient satisfaction, whereas hospitalization was negatively associated (p < 0.001). Need factors produced 1 variable negatively associated with patient satisfaction: number of needs (p < 0.001). No predisposing variables were related to satisfaction.
Satisfaction: Bivariate Analyses.
Variables Associated with Satisfaction: Multiple Linear Regression Model.
R 2 = 0.278; adj_R 2 = 0.262; P < 0.001.
Discussion
This study was the first to assess patient satisfaction with MHS based on Andersen’s Behavioral Model. Our results demonstrated a high level of patient satisfaction, revealing 5 variables associated with patient satisfaction and 2 marginally significant variables. The global mean score for patient satisfaction in our study was similar to results in most other studies. 13,19,38,40,37 In previous studies, however, satisfaction scores have generally been based on single services, programs, and professionals, and studies were based on particular clinical populations. By contrast, our results reflect the evaluation of patient satisfaction among a variety of services and professionals. Our model also established that enabling factors were most strongly associated with patient satisfaction, which invalidates our research hypothesis. This result differs from previous findings in studies using the Andersen model, 73 –75 in which needs factors were most promising as potential predictors of service use. Yet it should be noted that these studies focused on the utilization of MHS without considering patient satisfaction in the analysis.
Continuity of care and having a case manager emerged as the most important variables among the enabling factors. Continuity of care is a multidimensional concept that takes in a number of care-related dimensions, such as delivery, accessibility, and enduring relationships between patient and professional. 76,77 Care is individualized in the context of a long-term treatment plan that encompasses multiple services and service providers as required. 77 Adequate continuity of care insures a seamless transition between services as needs and problems evolve, in particular for patients with chronic conditions, and also tends to reduce acute MH interventions. 78 Continuity of care was also found to enhance QoL and community functioning, while reducing symptom severity and increasing patient satisfaction. 79,80 The case manager ensures continuity of care and facilitates more frequent and flexible follow-up, offering support to patients as well as a bridge between service delivery and holistic patient needs. 25,78,81
Help received from services (enabling factors) was also related to patient satisfaction. Patients with MDs have multiple biopsychosocial needs that services must address. Our study used a validated tool to measure patient needs, for instance in the areas of self-care, food, daytime activities, money, adaptation to stress, social exclusion, and job integration. Findings revealed that help received from health and social services that contributed to meeting daily needs or to social life was particularly important for increasing satisfaction, particularly among patients with severe MDs or serious problems in various areas (e.g. physical health, daytime activities, and food). 82 The responsiveness of services throughout the entire spectrum of needs is important for facilitating recovery and community integration, reducing unmet needs, and increasing patient satisfaction with MHS. 16 According to the American Psychiatry Association (APA), 83 diversified MHS, for example medication-based treatment in combination with psychotherapy, reinforces recovery for patients with moderate or severe depression. Others studies have noted that patient satisfaction increases when treatments are integrated into various MHS, both inside and outside of hospitals, or in multidisciplinary teams. 14,40
By contrast, patients with severe or chronic MDs, with multiple unmet needs, or lacking good case management have a greater likelihood of hospitalization. Patients with MDs are recognized as high service users, particularly in emergency departments, or tend to consult hospital-based professionals during crises. 84 Our study suggested that hospitalization in the previous year led to greater dissatisfaction with MHS. Many studies reported that receiving hospital inpatient services or compulsory treatment during hospitalization 4,24,40 significantly reduced patient satisfaction. Patients with MDs preferred to receive local outpatient services 40 or community-oriented approaches and crisis intervention outside the hospital, 14 because these services could be integrated into daily routines, provide more information about health status, and ensure better long-term follow-up. 44
Having to resort to hospitalization reflects a lack of service effectiveness in meeting chronic or severe needs among patients. Studies illustrate that, as mentioned, patients with MDs have multiple needs that services must address. As this study highlights, the more patients with MDs fail to receive support in their various spheres of life, the more and the greater their dissatisfaction with MHS received. 1,2 This result is consistent with literature claiming that reductions in the number of needs among patients with MDs increase compliance with treatment, recovery, QoL, and satisfaction with services. 6,7,16 –18 Most studies have shown that the most serious patient needs are correspondingly difficult to meet. 16,73 Lack of specialized services in specific areas, and weak coordination among MHS and other health or social services, 65 may explain the difficulty in reducing unmet needs. Moreover, some patients have needs that are both serious and recurrent, and are likely viewed as “unmeetable.” 16 Unmet needs have been linked to decreased recovery and QoL among patients, and, by extension, lower patient satisfaction with MHS. 7,16
Limitations
This study has limitations that should be noted. First, as a cross-sectional study, causal inferences about the findings cannot be made. Second, because the sample was not randomly selected, satisfaction scores should be interpreted with caution. Our results, however, remain consistent with the literature. Third, our study analyzed satisfaction based on a single question measured with a 5-point Likert-type scale, a strategy that did not allow us to investigate subdimensions of satisfaction, as in certain other studies that used standardized questionnaires. Yet patient satisfaction as analyzed in the present study included a broad range of services and professionals consulted during a 12-month period, as well as a full range of MH diagnoses, which would have largely offset this limitation and provided a robust analysis of overall patient satisfaction with MHS. Fourth, this study did not assess satisfaction within specific settings, such as community organizations or hospitals, nor were variables specifically related to patient satisfaction evaluated. These issues could provide a topic for further research. Moreover, the context of this study, including 4 local MH networks, may limit the generalizability of the findings. Our model would require further testing in other healthcare systems. Finally, the results may not be applicable to samples based on single MDs (e.g. schizophrenia only).
Conclusion
This study is the first to evaluate overall patient satisfaction with MHS among adults representing a diverse clinical population from 4 MH service networks, and to simultaneously test multiple variables associated with patient satisfaction using Andersen’s Behavioral Model. The high level of patient satisfaction that emerged from our analysis suggests that patients are generally satisfied with MHS, in particular when they received good continuity of care and well-managed and frequent service delivery in relation to their needs. Case management and assertive community treatment should be better deployed to respond more adequately to the diverse biopsychosocial needs of patients with MDs. By contrast, dissatisfaction was observed among patients presenting serious unmet needs and those hospitalized. Findings highlight the importance of attending to these variables in providing care as a way of improving patient satisfaction with MHS and with their recovery.
Footnotes
Acknowledgments
We would like to thank the coinvestigators and patients who participated in this research.
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) declared receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by the Fonds de la recherche en santé du Québec (FRSQ; grant no. 22367); we gratefully acknowledge the support of this agency.
