Abstract
A recent review of Cochrane meta-analyses on psychosocial interventions (PIs) concludes that clinical trials fail to confirm PIs effective for all types of dementia at every stage of the disease. This article describes how and to what extent it is necessary to identify treatment indications when researching PIs and employing them in clinical practice. Twelve Cochrane reviews on PIs for people with dementia, selected because of their systematic methodology, were searched to identify outcomes related to treatment indications (dosage, type of dementia, severity…). The authors identified several research and practice issues that related to treatment indications: sample profiling, hypothesizing and statistical interpretation, external validity, effectiveness of interventions, contraindications and limits of interventions, and tailoring. Developing an effective PI requires empirical, developmental, exploratory, and confirmatory development stages to achieve credibility and robustness.
Keywords
Introduction
The aim of employing psychosocial interventions (PIs) is to alter the course of a condition that poses significant cognitive, behavioral, emotional, and/or social challenges. Psychosocial interventions are designed to reduce or compensate for these challenges, maintain or enhance abilities and positive emotions, and improve quality of life. Psychosocial interventions use a wide range of resources such as music, sensory stimulation, and social activities to elicit sensory, cognitive, behavioral, and social responses among those targeted for improvement. Zeisel et al 1 suggest that physical environmental design should be included as a PI. These authors propose an ecopsychosocial approach in which they conceptually locate PI’s in a broader field incorporating environmental and contextual influences of interventions in the lives of those living with dementia. These authors stress that physical design as well as physical contextual factors also need to be investigated to tailor and facilitate implementation of PI’s for people with dementia (PwD).
Treatment indications in medicine refer to symptoms or particular circumstances that indicate the advisability or necessity of a specific clinical treatment or procedure, including identifying the cause, or some other aspect of a disease (https://www.nlm.nih.gov/). 2 Treatment indications relate to a patient’s specific biological and/or psychological profile, dosage, adverse effects, and contraindications. They serve an important purpose for clinical practice and must be investigated thoroughly with robust evaluation procedures in order to apply a clinical treatment without jeopardizing patients’ psychological or physiological balance. Treatment indications are rarely identified in studies of PIs.
Vernooij-Dassen and Moniz-Cook 3 point out that because statistical type III errors—also called implementation errors—are often found in treatment protocols for PIs in the field of dementia care, PIs often lack precision and reliability, reducing their internal validity that consequently reduces reproducibility and generalizability of PI-related outcomes. Vernooij-Dassen and Moniz-Cook 3 (p810) stress that implementation errors “undermine the credibility of an otherwise successful intervention, thus rendering effect analyses and positive outcomes meaningless […], with associated wasted effort and resources.” They suggest a much needed “paradigm shift in the design and methodology for evaluation of complex interventions in applied dementia care research.”(p809) It has not yet been proven that PIs are an easy, costless, and harmless alternative compared to pharmacological treatment. In fact, PIs are more epistemologically complex than they are commonly thought to be.
While PIs observably impact the behavior of PwD, meta-analytic reviews of PIs often fail to prove their efficacy for this population with regard to hypothesized effects as defined by the American Psychiatric Association 4 : compensating deficits, maintaining abilities, maintaining positive emotions, and improving quality of life.
Charras et al, 5 in a recent Cochrane meta-analyses review of PIs for PwD, observe that less than a third of reviews show statistically significant results and effects. The authors point out that in order to show any effects of PIs researchers must (1) adapt their investigation methodology to specific characteristics of each PI, (2) acknowledge the methodological weaknesses of randomized control trials (RCTs) that lead to reduced quality of research and clinical practice, (3) apply methodological prerequisites when proceeding to RCTs, and (4) employ research methods other than RCTs that are likely to result in more informative results than RCTs. 6 Charras et al 5 point out that while systematic reviews fail to confirm the overgeneralized statement that PIs are effective for all type of dementia at every stage of the disease, these reviews do not prove that PIs have no effects. The authors observe that such reviews often end with the suggestion that in order to correctly interpret findings and to evaluate effect of PIs, it is necessary to indicate type and severity of dementia. In PI clinical trials, in addition to tailoring interventions to specific populations with dementia, Douglas et al 7 and Woods 8 suggest that there is a need to clearly identify the treatment aims of PIs being studied. Similarly, Van Mierlo et al 9 (p802) state that “little research [has been conducted] into the effects of PIs for subgroups of PwD or their caregivers.” Previous research on PwD by these authors has focused primarily on intrapersonal characteristics on participants and their caregivers who were more sensitive to different types of PIs. 10,11
The aim of this article is to understand how and to what extent treatment indications are and should be involved with PIs from a research as well as clinical practice perspective. This investigation is a natural progression of Charras et al’s 5 study.
Methods
The Cochrane Database employs a systematic and homogenous methodology across meta-analyses and updates them regularly. For this reason, the PI Cochrane reviews that Charras et al 5 selected in their study, which included finalized reviews referring to PIs for PwD, were also selected in this article. Only most recently updated meta-analytic reviews were included. Studies excluded for this article were protocol descriptions; nonpharmacologic interventions that did not meet the APA definition of PI (2010) such as acupuncture, Transcutaneous Electrical Nerve Stimulation, and whole-body vibration; and PIs focused on caregivers of PwD. Because they were undertaken with objectives that did not fit those of the study, reviews aimed at determining efficient PIs for only one type or range of symptoms were also excluded.
After verifying that the review author’s practice and research conclusions corresponded to the results they indicated, the authors of this study identified and selected the relevant information to the area of concern of this study.
Results
Employing the Cochrane Library search tool, in August 2014, 176 reviews were identified using the key word “dementia.” Nineteen of these concerned PIs. Seven were excluded: 4 protocols, 2 aimed at determining effectiveness of interventions for a symptom or a range of symptoms, 1 for which the sample was healthy people and people with mild cognitive impairment without mentioning dementia. Unlike Charras et al’s study, aromatherapy and light therapy were included in this study, although it is sometimes argued that aromatherapy and light therapy are not PIs because these interventions are based on physiologically invasive essences and processes. Douglas et al 7 point out that these are often considered as PIs and are frequently used in combination with other interventions such as massage, touch, and multisensory interventions. Twelve reviews referring to 13 PIs were ultimately selected: aromatherapy, cognitive stimulation, cognitive training, cognitive rehabilitation, functional analysis-based interventions, light therapy, massage and touch, music therapy, physical activity, psychological treatments, reminiscence therapy, Snoezelen, and Validation therapy. For each selected review, Table 1 presents review author quotes that reflect practice and research implications, the concerns of the present study.
Quotes From Cochrane Meta-Analytic Reviews on PI Referring to Practice and Research Issues Concerning Indications.
Abbreviations: PI, psychosocial intervention; RCT, randomized control trial.
Implications for Research
Analysis of treatment indications in research reveals important methodological questions. Just as Vernooj-Dassen and Moniz-Cook 3 demonstrate that heterogeneity of PI implementation procedures frequently confuses efficacy and effectiveness, analysis of indications in the review authors’ conclusions, and recommendations (see Table 1) which lead to the same conclusion.
Typical sentences in the research implications of 8 of 12 reviews are “Treatment effects for the different types and severity of dementia need to be investigated” or “future studies should investigate the effect of severity of dementia on treatment efficacy.” Such statements imply that PwD have different personality traits, emotional processing, cognitive functioning, behavioral patterns, and social relations. That must be taken into analytic account. Differential analysis within a comparative approach is necessary to target the range of patient/participant profiles sensitive to a given intervention.
The authors also found that PI reviews that restrict areas of implementation on conceptual grounds (eg, psychological interventions and depression, functional analysis and Behavioral and Psychological Symptoms of Dementia—BPSD, cognitive stimulation, and cognitive deficits) report more robust evidence compared to those who study a wide range of symptoms or report symptoms not linked to the original purposes of the PI being studied, such as Snoezelen or Validation therapy.
These outcomes highlight important methodological issues in the Cochrane review authors’ conclusions: sample profiling, hypothesizing and statistical interpretation, and external validity.
Implications for Practice
“Insufficient evidence” of effectiveness for prescribing an intervention for PwD is a general conclusion of most of the Cochrane reviews analyzed. Chung et al 21 emphasize the inappropriateness of considering a PI “as a general programme to occupy PwD without a meaningful purpose […] there is a need for more reliable and sound research-based evidence to inform and justify the use of Snoezelen [and other psychosocial interventions may we add] in dementia care” (p11). This observation supports the present authors’ conclusion that a single PI cannot address all needs of PwD, but rather only a limited range.
Several reviews suggest that employing a PI with PwD is not without consequences for the person or their relatives. To date, we have failed to prove any harmful effects of PIs; although as Forrester et al 12 stipulate for aromatherapy “there is plenty of nonrandomized evidence of both benefit and harm.”
Cochrane review authors’ quotes indicate 3 major conceptual issues that treatment indications positively influence in clinical practice: effectiveness, limits and contraindications, and tailoring.
Discussion
Implications for Research
Sampling
Homogenous sample selection that reflects a particular target of concern may contribute to establishing a causal relationship between a PI and a related psychological and behavioral target, thus demonstrating the potential impact of the PI on BPSD. On the other hand, a sample drawn from a general PwD population mixes all indications and blurs any mean measured impact.
Suppose, for example, that the overall population of PwD comprises 3 equal-in-size indication segments A, B, and C (subsets of the overall population): with results indicating a positive output for segment A, inefficient output for segment B, and contraindication for segment C. Combining the 3 different impacts will obviously obscure any straightforward conclusion. Even though a slight positive impact may be inferred, since the PI does not apply to segment B and C, results will not reflect the true picture. Statistical results on the impact of the PI efficiency depends entirely on the indication segment of the targeted population.
It is therefore necessary to select research samples with a profile that represents the specific population in need of an intervention. On the other hand, exploratory studies may necessitate samples with a wide range of participant profiles in order to identify those profiles sensitive to an intervention.
When designing a PI, clinicians have in mind characteristics of the PI that will impact the course of the disease, impairment, or disorder. It is logical to assume that PI studies must segment PwD according to those targeted factors (cognitive, emotional, behavioral…) as well as intrinsic factors of participants (age, gender, severity of the disease, symptoms, psychological states, personality traits…) and then set a comparative analysis of impacts of the PI on particular sample segments to determine whether there are any significant impacts.
Statistical hypothesizing
The more precise a hypothesized PI effect, the greater the statistical power of results. Preciseness of a hypothesis is highly dependent on accuracy of treatment indications, and conversely treatment indications are refined by sharpening alternative hypotheses. Such circular reasoning suggests a multi-stage statistical hypothesis testing strategy with exploratory and confirmatory stages requiring more or less precise treatment indications.
In early stages of implementation, referred to in Table 2 as the empirical stage, PI creators and/or experimenters have a vague idea of behavioral, psychological, and social fields that could and are likely to be impacted. Interventions at this stage tend to be conceptually designed to respond to an observed problem in the target population recognized as important by the clinical and scientific community. Such a problem statement can be used to identify intended treatment indications that PI was originally conceptually built to achieve.
Implication of Treatment Indication at Different Stages of Development and Testing of PI.
Abbreviations: PI, psychosocial intervention; RCT, randomized control trial.
Before a PI is subjected to an RCT, its feasibility and range of benefits must be observed in a targeted sample of participants. 3 Experimenters then employ these observations to formulate a broad range of behavioral, psychological, and social impact hypotheses. Such an observational phase is necessary to identify behavioral and psychological characteristics impacted on which more precise hypotheses can be built. The developmental stage enables experimenters to test the impact of interventions on originally targeted participants and to identify contraindications and adverse side effects. This phase typically requires 2-tailed hypotheses in order to establish relationships between potential explanatory variables and outcomes. Results enable investigators to identify possible outcomes and issues related to an intervention and help them monitor and adjust for errors. Allchin 23 (p44) stresses that “in error analytics […] controls [randomisation, blinding, control groups…] perform substantive epistemic work by ruling out potential alternatives and thereby deepening reliability.” Only after such an analysis are directional hypotheses and RCTs meaningful. Employing an exploratory perspective in the developmental stages, experimenters better understand both positive and negative relationships between PIs and sets of variables and can test concordance with already tested PIs, theoretical knowledge, and other empirical studies.
Directional causal hypothesis can be formulated in both exploratory and confirmatory research stages. In exploratory stages, hypotheses will naturally be 2-tailed whereas in confirmatory stages, depending on the nature of and the expectations for an intervention, hypothesis can also be 1-tailed.
It is essential to develop hypotheses regarding causal relationships with psychological and social outcome impacts in a targeted participant population for which a PI may provide benefits, excluding those for which the PI is contraindicated. Testing causal hypotheses in this way enables researchers to confirm or deny adverse side effects (disempowerment, risk of failure jeopardizing self-esteem, enhancement of psychotic symptoms) and to determine dosage (duration, periodicity, and frequency) of the intervention according to patient profiles.
A confirmatory study is the best way to test a PI on a specific profile of participants in order to determine its effectiveness within a limited range of dependent variables. Such studies represent a powerful level of proof in traditional medical research, enabling clinicians to practice such that clinical practice and research practice serve each other’s interests.
Identifying indications facilitates formulating precise research questions and operationalizing hypotheses which in turn enable researchers to pinpoint indicators closely related to desired primary outcomes. Such choices are less evident in early research stages when concepts are still being developed, inevitably weakening statistical analysis in such studies (see Table 2).
External validity
Mayo-Wilson et al 24 claim that taking into account context and participant characteristics helps elucidate causal chains, greatly contributing to external validity and generalizability of outcomes to other settings.
Identifying potential outcomes creates opportunities to implement a PI with people sensitive to it and to optimize implementation conditions. Mayo-Wilson et al 24 (p252) point out that “an intervention that works for one group of people […] may not work for people with slightly different problems and comorbidities.”
As discussed earlier, participant profiling is highly dependent on the stage of an intervention’s development. It is also essential to determine inclusion and exclusion criteria which are necessary to limit biases from intrapersonal participant characteristics. Reporting adverse effects contributes to identifying an intervention’s contraindications and to reduce selection bias. One strategy to explore external validity and determine indications of PIs for PwD is to study their effectiveness for one type or a specific range of dementia symptoms. Several Cochrane Library meta-analytic reviews adopt this approach in an attempt to target PIs that are effective for one type of BPSD. 25,26
Implications for Practice
Treatment indications are of primary importance in clinical practice. Clinicians prescribing interventions are trained to pay particular attention to their congruency with specific patient needs and symptomatic profiles.
Effectiveness of PIs
Psychosocial interventions with well-defined treatment areas show more robust evidence of effectiveness than PIs claiming to impact a wide range of symptoms and disabilities. Precisely, defining the target population and symptoms for a PI contributes to its internal validity, enabling clinical practitioners to better target a prescribed PI. Mayo-Wilson et al 24(p252) stress that “lack of information relevant to external validity may prevent practitioners or policy makers from using evidence appropriately to inform decision making, yet existing guidelines do not adequately explain how authors should describe (a) how interventions work, (b) for whom, and (c) under what conditions.”
Contraindications and limits of PIs
Whatever helps a person maintain her cognitive, social, emotional, or behavioral functioning and quality of life provides hope to those living with dementia and relatives, creating heightened expectations. Without scientific, conceptual, or empirical evidence, creating such expectations can appear as miraculous—a promise difficult to keep and thus vulnerable to quackery.
Clinicians administering PIs must be aware of and manage disappointment that can result from failure to treat in response to expectations created, especially when no limits to type and severity of dementia are provided. Woods 27 points out that this phenomenon is most often observed for dementia for which there is little knowledge about symptom progression and for which treatment targets are constantly changing. Establishing clear indications for an intervention will improve clinician’s ability to target a specific symptom or sets of symptoms according to the difficulties PwD experience and to focus on symptom-specific evaluations and efficacy of prescribed PI interventions. Relationships between “dosage”—period, frequency, and length—of each intervention and its outcomes must also be evaluated as part of treatment. 14,21 Such a paradigm shift would definitely make it clear to relatives of PwD that when clinicians suggest a PI, they do so with the intention of treating particular disabilities, not to cure the disease.
In practice, clinicians must have evidence—still not available according to the Cochrane Library—that PIs will treat their patients’ dementia symptoms. Without scientific evidence, clinicians’ hands are tied. Clinicians also require external competences for certain PIs—art therapy for example. They need to know when to suggest a PI even when their own competence does not enable them to treat symptoms directly or when some other PI, for which they do not have deep knowledge, might be indicated. Identifying treatment indications facilitates implementation of complex and tailored interventions. 9
Conclusions
The probability is null that a painkiller will prove effective for someone who feels no pain. In most cases, a painkiller will remain harmless if ingested occasionally. But would we nonetheless continue to prescribe this medication or would we bring it to a stop?
The same principle can be applied to psychological and/or PIs for PwD. Based on analysis of Cochrane reviews on effectiveness of PIs for PwD, the authors posit that to prove effectiveness of a PI on PwD, the chosen sample for the implementation must first prove a need for the intervention. In addition, valid statistical analysis will depend on the appropriateness of a study’s sampling, statistical hypothesizing, and internal as well as external validity.
Treatment indications for PIs can be defined as valid reasons for prescribing or withholding an intervention in response to symptomatology, needs, targeted deficits, and psychological profiles of PwD. Conclusions from this article, congruent with the ecopsychosocial approach, 1 suggest that treatment indications enable clinicians to tailor interventions by specifying dosage (periodicity, frequency, and length) and contextual (physical and social) conditions that will facilitate implementation of a PI according to targeted outcomes. Following this perspective, Mabire et al 28 in a literature review on the effect of dance interventions for PwD suggest breaking down interventions into 10 practice recommendations (Table 3).
Practice Recommendations According to Therapeutic or Recreational Intention of Danse Interventions. 28
Identifying treatment indications and recommendations undoubtedly strengthen research questions and outcomes and also prove more efficient in clinical practice.
Development of a PI necessitates passing through segmented stages in order to gain credibility and robustness. Clinical trials aim at applying and testing fundamental knowledge to treatment conditions by testing a PI’s efficacy and effectiveness in terms of dosage according to specific patient profiles. Following the research stages described in Table 2 will help achieve conditions congruent with Van Mierlo et al’s 9 16 core components of personalized care in order to tailor interventions to individual needs and symptomatic profiles. It is of the responsibility of both clinicians and researchers to insure the reliability of PI treatments. One cannot proceed without the other, and whatever recognition a PI has from the clinical and scientific community, it must always be further investigated in order to guarantee its effectiveness and seriousness.
Footnotes
Author's Note
Moustapha Dramé is now affliated with Faculty of Medicine, University of the French West Indies, Martinique, France and Department of Clinical Research and Innovation, University Hospitals of Martinique, Pierre Zobda-Quitman Hospital, Martinique, France.
Acknowledgements
The authors wish to thank Alec Charras, Ph.D, for his help with statistical theory and the reviewers for their useful comments.
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
