Abstract
Background
Two randomized, double-blind, sham-controlled trials (ACT1, ACT2) evaluated non-invasive vagus nerve stimulation (nVNS) as acute treatment for cluster headache. We analyzed pooled ACT1/ACT2 data to increase statistical power and gain insight into the differential efficacy of nVNS in episodic and chronic cluster headache.
Methods
Data extracted from ACT1 and ACT2 were pooled using a fixed-effects model. Main outcome measures were the primary endpoints of each study. This was the proportion of participants whose first treated attack improved from moderate (2), severe (3), or very severe (4) pain intensity to mild (1) or nil (0) for ACT1 and the proportion of treated attacks whose pain intensity improved from 2–4 to 0 for ACT2.
Results
The pooled population included 225 participants (episodic: n = 112; chronic: n = 113) from ACT1 (n = 133) and ACT2 (n = 92) in the nVNS (n = 108) and sham (n = 117) groups. Interaction was shown between treatment group and cluster headache subtype (p < 0.05). nVNS was superior to sham in episodic but not chronic cluster headache (both endpoints p < 0.01). Only four patients discontinued the studies due to adverse events.
Conclusions
nVNS is a well-tolerated and effective acute treatment for episodic cluster headache.
Trial registration
The studies were registered at clinicaltrials.gov (ACT1: NCT01792817; ACT2: NCT01958125).
Keywords
Introduction
Cluster headache is a highly disabling brain disorder typically characterized by attacks of excruciating unilateral headache associated with ipsilateral cranial autonomic features and often an urge to move (1). Attacks last from 15 minutes to 3 hours and may occur up to eight times a day, frequently at night (2). About 80% of patients have episodic cluster headache, in which attacks come in periods lasting from 1 week to several months and are separated by attack-free periods of more than 1 month. The remaining 20% experience chronic cluster headache, in which attacks continue to recur for more than 1 year without attack-free periods longer than a month (3).
Research into differential treatment effects among episodic and chronic cluster headache subtypes warrants further attention in clinical trials. Cluster headache therapy for the acute treatment of both subtypes should preferably have a low adverse event profile and be easy to use and must be fast acting because the pain builds up quickly and is extremely severe. Current acute treatments for cluster headache, although limited, have shown efficacy, but clinical disadvantages include daily dosing limitations (1), cardiovascular contraindications (4), inconvenience, and/or unavailability. Pain-free rates of up to 49% (subcutaneous sumatriptan) at 15 minutes have been reported in clinical studies of triptans for the acute treatment of cluster headache (5), and inhalation of 100% oxygen was shown to relieve attacks at 15 minutes in 78% of patients (6). Results for episodic and chronic cluster headache subtypes are not commonly evaluated separately, likely because of the much smaller chronic cluster headache subgroups typically enrolled (7–9). Studies that separately evaluated both subtypes demonstrated higher treatment effects in episodic cluster headache than in chronic cluster headache but were not powered to dissect any differential effects (7,10,11). Consistent with these findings, recent data suggested that a monoclonal antibody targeting the calcitonin gene-related peptide (CGRP) ligand was ineffective for the preventive treatment of chronic cluster headache but effective for preventing attacks in episodic cluster headache (12).
Non-invasive vagus nerve stimulation (nVNS; gammaCore; electroCore, Inc., Basking Ridge, NJ, USA) is a novel, easy-to-use, non-invasive neuromodulation treatment option for cluster headache (13). In ACT1, acute nVNS treatment showed efficacy in participants with episodic cluster headache but not in the chronic cluster headache subgroup or in the total population that included all participants of both subtypes (11). The ACT1 trial was underpowered for analysis of the differential effect size in episodic and chronic cluster headache separately. A further study using the same nVNS and sham devices (ACT2) had similar results (10). The study designs and populations of ACT1 and ACT2 were similar, particularly in terms of sham and active stimulation and data collection. This allowed for pooled data analysis and, because of greater statistical power, formal verification of possible differential effects of nVNS in episodic and chronic cluster headache. Given the rarity of the disorders, combined analysis of both studies may also provide a more complete depiction of the efficacy, tolerability, and application options of nVNS in the two different cluster headache subtypes. We present here a pooled data analysis of both studies, focusing on the possibility of differential effects in episodic and chronic cluster headache.
Methods
Study design and participants
We pooled and analyzed the data of all 225 participants (age 18 years or older) with episodic (n = 112) or chronic (n = 113) cluster headache (2) from two prospective, randomized (ratio 1:1), double-blind, sham-controlled, multicenter clinical trials. Demographic data for both trials were self-reported by participants and were validated by the investigator. The trials had similar designs with a few exceptions. The main difference was the primary endpoint. For ACT1, this was “the proportion of participants whose first treated attack had improved (on a 5-point pain intensity scale) from pain intensity of moderate (2), severe (3), or very severe (4) to mild (1) or nil (0) at 15 minutes after treatment initiation”. For ACT2, the primary outcome was “the proportion of all treated attacks that had improved from pain intensity 2–4 to 0 at 15 minutes after treatment initiation for that attack”. ACT1 had a 1-month double-blind period followed by a 3-month open-label phase, whereas ACT2 had a 1-week run-in period followed by a 2-week double-blind period and then a 2-week open-label phase. In both studies, participants had to treat attacks as soon as possible after onset with three consecutive 120-second applications of nVNS. In ACT2, however, participants could apply up to three additional stimulations if not pain-free at 9 minutes after initiation of the first treatment. Finally, although in ACT1 all treatments were applied to the right cervical vagus nerve, in ACT2 the participants were encouraged to treat ipsilateral to the pain.
Both studies were conducted in accordance with the Declaration of Helsinki, Good Clinical Practice, and local laws. The protocols were reviewed by the appropriate national regulatory agency for each site, and additional reviews were completed by regional or local independent ethics committees as required. The studies were registered at ClinicalTrials.gov (ACT1 (11): NCT01792817 and ACT2 (10): NCT01958125), and all participants had signed informed consent forms prior to study inclusion.
Data sources
We pooled the final data sets from ACT1 and ACT2 and used the full analysis set to analyze all efficacy endpoints and adverse events in the total population and separately in the episodic and chronic cluster headache subgroups.
Statistical analyses
We used logistic regression models to estimate odds ratios and associated 95% confidence intervals (95% CIs) for (i) the proportion of participants whose first treated attack had improved from pain intensity 2–4 to 0–1 at 15 minutes after treatment initiation (the ACT1 primary endpoint) and (ii) the proportion of participants in whom ≥ 50% of all treated attacks had improved from pain intensity 2–4 to 0–1 at 15 minutes after treatment initiation. Analyses resulting in pooled estimates included site as a covariate in the logistic regression models.
Generalized linear mixed-effects regression models (with logit link and binomial response distribution) were used to estimate the proportion of all treated attacks that had improved from pain intensity 2–4 to 0 at 15 minutes after treatment initiation for that attack (the ACT2 primary endpoint). Population averaged/marginal models (to account for repeated headache attacks within patient) were utilized, and the structure of the covariance matrix was specified as compound symmetry. p values for comparisons between the nVNS and sham groups were determined from resulting F tests.
Individual participant data were used in the meta-analysis. Fixed effects meta-analysis models were used to estimate the pooled effects of nVNS treatment, given the small number of studies being pooled and because the ACT1 and ACT2 studies were homogeneous for participant populations and results. In addition, there was no evidence of treatment by study interactions for any of the outcomes examined.
In the meta-analysis models, interactions between treatment group and cluster headache subgroup were examined to determine whether the magnitude of treatment effect varied significantly by cluster headache subtype.
First-order interactions between treatment group and cluster headache subgroup were examined to determine whether the magnitude of treatment effect varied significantly by cluster headache subtype.
Two-sided p values < 0.05 were considered statistically significant. p values are provided for all efficacy analyses without adjustment for multiple comparisons. Data were analyzed using SAS 9.4 (SAS Institute Inc., Cary, NC, USA).
Results
Demographic and baseline characteristics (pooled analysis).
n/N: number of subjects using treatment/total number of subjects with data; nVNS: non-invasive vagus nerve stimulation; SD: standard deviation.
an = 108; bn = 115; cn = 120; dn = 103.
ePercentages may not add up to 100% because of rounding.
Between–cluster headache type interactions
Interaction model results.
SE: standard error.
Treatment response at 15 minutes in first treated attack
Among participants with episodic cluster headache, more participants treated with nVNS than with sham achieved the ACT1 primary endpoint: Improvement of the first treated attack at 15 minutes to pain intensity 0–1 in the ACT1 (absolute difference, 24%; p = 0.01) and pooled (absolute difference, 27%; p < 0.01) study populations, but not in the ACT2 study population (absolute difference, 35%; p = 0.07; Figure 1).
Proportion of participants who responded at 15 minutes for the first treated attack.
Proportion of all attacks pain-free at 15 minutes
Among participants with episodic cluster headache, the proportion of all treated attacks that had improved at 15 minutes to pain-free (the ACT2 primary endpoint) was higher in the nVNS-treated group than in the sham-treated group for ACT1 (absolute difference, 9%; p < 0.05), ACT2 (absolute difference, 41%; p < 0.05), and pooled (absolute difference, 22%; p < 0.01) study populations (Figure 2).
Proportion of all treated attacks that achieved pain-free status at 15 minutes.
Key secondary endpoints
The proportion of participants who were pain-free at 15 minutes in ≥ 50% of their treated attacks was higher for nVNS than for sham (absolute difference, 18%; p = 0.01) in participants with episodic cluster headache in the pooled study population (Figure 3(a)). The absolute difference for this endpoint in episodic cluster headache was 14% (p = 0.05) in the ACT1 study population and 28% (p = 0.11) in the ACT2 population. There were no other treatment differences for this endpoint in any of the other study populations. The proportion of participants who were pain-free or with mild pain at 15 minutes in ≥ 50% of their treated attacks was higher for nVNS than for sham in participants with episodic cluster headache in the ACT1 (absolute difference, 19%; p = 0.04), ACT2 (absolute difference, 49%; p = 0.02), and pooled (absolute difference, 27%; p < 0.01) study populations. The ≥ 50% response rates for pain freedom or mild pain at 15 minutes also favored nVNS in the total population of the ACT2 (absolute difference, 26%; p < 0.01) and pooled (absolute difference, 14%; p = 0.01) study populations (Figure 3(b)).
Pain-free (a) or responder (b) status at 15 minutes for ≥ 50% of attacks.
Adverse events
Incidence of adverse events, serious adverse events, and adverse device effects (pooled data).
ADE: adverse device effect; AE: adverse event; CH: cluster headache; nVNS: non-invasive vagus nerve stimulation; SAE: serious adverse event.
One patient from the safety population assigned to the nVNS group (n = 124) provided only baseline data and was therefore excluded from the safety analysis.
Included one participant with an SAE of CH (two occurrences) in ACT1 and one participant with SAEs of lower abdominal pain and back pain in ACT2.
SAEs were not considered related to the study device.
Included one participant with SAEs of anxiety and depression in ACT2.
Discussion
We pooled the data of two large clinical trials, ACT1 and ACT2, to enable both a formal analysis of acute efficacy separately for episodic and chronic cluster headache and a larger pooled analysis of tolerability. Meta-analysis of the entire population of 225 participants demonstrated significant efficacy of nVNS as an acute treatment for episodic cluster headache but not for the acute treatment of chronic cluster headache. The data show that repeated use of nVNS was well tolerated and that there were no obvious short-term safety concerns.
A recent mechanistic model of autonomic function provides further insights into the possible differential efficacy of nVNS observed between the two cluster headache subtypes. Reductions in kinetic oscillation stimulation–induced lacrimation in healthy subjects suggested that the symptom relief seen with nVNS in ACT1 and ACT2 was likely attributable to a bilateral inhibitory effect on parasympathetic output of the trigeminal autonomic reflex (14,15). The possibility of a differential parasympathetic response among patients with episodic and chronic cluster headache could play a role in the differential acute efficacy of nVNS between the episodic and chronic cluster headache subgroups in the ACT1 and ACT2 studies. Several other mechanistic studies were previously reported, suggesting that multiple distinct mechanisms may contribute to the efficacy of nVNS as an acute treatment. In animal models, two doses of vagus nerve stimulation (VNS) inhibited acute nociceptive activation of trigeminocervical neurons for up to 3 hours (16), and VNS attenuated pain responses and Fos protein expression (17). In healthy volunteers, nVNS caused activation of the nucleus tractus solitarius as measured with functional magnetic resonance imaging (18). Taken together, the beneficial acute effects of nVNS in episodic cluster headache seem biologically plausible.
There are a number of possible explanations for why patients with chronic cluster headache have a poorer response to acute treatment. Inter-paroxysmal pain is considerably more common in chronic than in episodic cluster headache (19), complicating achievement of pain-free status in the chronic subgroup. The presence of inter-paroxysmal pain was not measured in ACT1 or ACT2, representing a limitation of this pooled analysis. This information may have provided further insight into the observed differences among the two cluster headache subtypes. Spontaneous transitions from episodic to chronic cluster headache, and vice versa, do occur and are unpredictable (20,21). Given the cohort size, such transitions may have occurred in at least some participants, potentially influencing treatment response. A possible pathophysiological reason for a differential treatment response in episodic and chronic cluster headache involves differences in gray matter volume in pain processing areas (22). Such differences likely reflect the brain's adaptive capacity to different stimuli (23). There may also be differences in brain pharmacology between chronic and episodic cluster headache (24). Although establishing causal links to chronicity is challenging, such differences may contribute to disparity in treatment response. Central sensitization is considered essential for the pathologic mechanisms underpinning the chronification of primary headache disorders (25). The changes underlying treatment refractoriness in some patients with chronic cluster headache may involve consolidation of neuronal connections and networks in the disease mechanism.
Several similarities of ACT1 and ACT2, including participant characteristics, overlapping outcome measures, and use of the same nVNS and sham devices, allowed for pooled data evaluation of differential effects in episodic and chronic subtypes, but the trials also have differences. The double-blind period in ACT1 was 4 weeks, whereas in ACT2 it was 2 weeks to minimize exposure to sham. Because both studies were acute attack treatment trials and cluster headache attacks are clinically stable, this should not have been a major issue. The allowance of extra pulses in ACT2 may have contributed to the greater efficacy seen in ACT2. Application of three consecutive stimulations takes 6–8 minutes; given the 15-minute endpoint, the paradigm may have biased against a response in the total population. We also do not know whether the move from right-sided stimulation to stimulation ipsilateral to the pain was important. The anatomy suggests that the vagal afferents are bilateral. This may have increased the placebo rate, which would have rendered a positive outcome more challenging. Taken together, the similarities seem more relevant than the only minor dissimilarities, thus allowing for meta-analysis of both studies.
The results from this pooled analysis offer additional evidence for the clinical utility and advantages of nVNS in patients with cluster headache. Adverse events were mild, and there were no safety concerns during the trial. Long-term safety can be judged only after monitoring repeated use of nVNS over longer periods. The portability of nVNS and the fact that, in contrast to triptans, nVNS may be used more than three times per day and without major restrictions to co-medication highlight its practical utility. The ability to use the device in patients with cardiovascular contraindications to triptans is an important advantage of nVNS (4). In previous trials, nVNS therapy was associated with adherence rates ≥ 90% and treatment satisfaction rates ≥ 50% and was generally regarded as easy to use (13).
The apparent lack of acute nVNS efficacy in subjects with chronic cluster headache attacks is somewhat surprising, considering that clinical efficacy was shown when nVNS was used preventively in patients with chronic cluster headache (13). However, the combined ACT1 and ACT2 data, as well as recent data for a CGRP-targeted monoclonal antibody (12), reinforce previous data that suggest that acute (13,26) and preventive (27) treatments are more challenging in chronic than in episodic cluster headache. Consistent with this, a consensus statement from the European Headache Federation recommended amending the International Classification of Headache Disorders (2) to include a sub-classification for treatment of refractory chronic cluster headache (28).
The differential results in chronic versus episodic cluster headache have important implications for participant selection and minimum size of future therapeutic studies in cluster headache. Clinical trial design requirements, the challenges encountered selecting eligible participants, and patient motivation to enroll have generally shifted the selection of study participants toward an episodic subtype dominance (6). Attack numbers in patients with cluster headache often exceed limits for triptan therapy, making these patients more likely to overuse opioids and other analgesic medications (29), generally precluding inclusion in controlled trials. Combining participants with episodic and chronic cluster headache into one analysis may distort outcomes and, driven by the dominance of participants with the episodic subtype, may result in a potentially false conclusion that both groups are responders. Our analysis represents the first adequately powered analysis to assess the differential effect of a specific treatment between the two forms of cluster headache. The results underline the importance of redoubling efforts at developing further suitable acute treatments for patients with chronic cluster headache.
Conclusions
nVNS is effective in aborting attacks in episodic cluster headache. It does not show the same acute efficacy in patients with chronic cluster headache. The clearance of nVNS for the acute treatment of episodic cluster headache by the US Food and Drug Administration was, in part, based on findings from this analysis of the ACT1 and ACT2 studies. In all patients, nVNS is well tolerated. nVNS offers several advantages over existing treatment options, including its ease and flexibility of use and its ability to be used for as many attacks as the patient experiences per day, without restrictions to daily number of treatments and co-medications. nVNS is also not contraindicated in cardiovascular disease. Additional studies are needed to further elucidate the mechanism of action and possibly related reasons for failure in the acute treatment of chronic cluster headache, including potential studies of the effects of nVNS on parasympathetic output from the trigeminal autonomic reflex for patients with episodic and chronic cluster headache. This could lead to better understanding of the pathogenesis of cluster headache.
Clinical implications
This meta-analysis of data pooled from two randomized sham-controlled studies (N = 225) demonstrated significant benefits of acute non-invasive vagus nerve stimulation versus sham for subjects with episodic (n = 112) but not chronic cluster headache (n = 113). Non-invasive vagus nerve stimulation has differential acute effects among the two cluster headache subtypes, with greater efficacy seen in episodic than in chronic cluster headache, although the mechanisms underlying these differential effects are currently unclear.
Footnotes
Acknowledgements
We thank the many patients with cluster headache who participated and have provided these data for their fellow sufferers. Annelie Andersson of electroCore, Inc., was responsible for coordination and execution of the ACT2 study. Medical writing support was provided by MedLogix Communications, LLC, in cooperation with the authors.
Author contributions
MDF and PJG had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: SDS, EL, SJT, MDF, PJG. Acquisition, analysis, or interpretation of data: All authors. Drafting of the manuscript: All authors. Approval of version to be published: All authors. Critical revision of the manuscript for important intellectual content: All authors. Statistical analysis: CKM. Obtained funding: EL. Administrative, technical, or material support: EL, PJG. Study supervision: PJG, SDS, EL.
Declaration of conflicting interests
The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: SDS has received consultancy and advisory board fees from Abide Therapeutics, Alder Biopharmaceuticals, Allergan, Inc., Amgen, Avanir, Biohaven Pharmaceuticals, Cefaly, Curelator, Inc., Dr. Reddy’s Laboratories, Egalet Corporation, GlaxoSmithKline Consumer Health Holdings, LLC, eNeura, Impel NeuroPharma, Inc., Lilly USA, LLC, Medscape, LLC, Novartis, Inc., Satsuma Pharmaceuticals, Supernus, Teva Pharmaceuticals, Theranica, and Trigemina, Inc. DIF reports grants from Autonomic Technologies, Inc, other from Allergan, other from Avanir, grants and other from Eli Lilly, other from Zosano, other from Alder BioPharmaceuticals, other from Amgen, and grants from Merck outside the submitted work. CG has received honoraria from Allergan, Grünenthal, Desitin, Bayer, Boehringer Ingelheim, Teva GmbH, Reckitt Benckiser, Ratiopharm GmbH, Novartis, Lilly Deutschland, and Hormosan. CG has no ownership interests and does not own any pharmaceutical company stocks. CKM is an employee of North American Science Associates Inc. AT has received honoraria from Allergan, Inc. EL is an employee of electroCore, Inc., and receives stock ownership. SJT has received consultancy fees from Acorda, Alder BioPharmaceuticals, Alexza, Allergan, AlphaSights, Amgen, ATI, Avanir Pharma, Axsome Therapeutics, Charleston Laboratories, DeepBench, Dr. Reddy’s Laboratories, Eli Lilly, eNeura, Kimberly-Clark, Gerson Lehman Group, Guidepoint Global, Magellan Rx Management, Neurolief, Nordic BioTech, Novartis, Pernix, Pfizer, Satsuma, Scion NeuroStim, Slingshot Insights, Sorrento, Supernus, Teva Pharmaceuticals, WebMD, and Zosano. He receives royalties from Springer. He owns ATI stock options. He receives a salary from the American Headache Society. MDF has received consultancy fees from Medtronic and independent research support from the Netherlands Organization for Scientific Research (NWO), the European Community, ZonMw, and the Dutch Heart Foundation. PJG reports grants and personal fees from Allergan, Amgen, Eli-Lilly and Company, and eNeura, and personal fees from Alder BioPharmaceuticals, Avanir Pharma, Cipla Ltd, Dr Reddy’s Laboratories, Novartis, Pfizer Inc, Quest Diagnostics, Scion, Teva Pharmaceuticals, and Trigemina, Inc.; personal fees from MedicoLegal work, Journal Watch, Up-to-Date, Oxford University Press, Massachusetts Medical Society, and Wolters Kluwer; and a patent for magnetic stimulation for headache issued to eNeura without fee.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The ACT1 and ACT2 studies were sponsored by electroCore, Inc. IFdC has received travel grants from electroCore, Inc. JCAM has received honoraria and travel grants from electroCore, Inc. SDS has been an investigator and has received consultancy and speaking fees from electroCore related to this work. DIF reports grants from electroCore, Inc. CG has received honoraria from electroCore, Inc. AT has received honoraria from electroCore, Inc. SJT has received consultancy fees from electroCore, Inc. PJG reports personal fees from electroCore, Inc., during the conduct of the study.
Role of the funder/sponsor
The funding source was involved in the design and conduct of the ACT1 and ACT2 studies; analysis and interpretation of the data; preparation, review, and approval of this and the ACT1 and ACT2 manuscripts; and the decision to submit the manuscripts for publication.
Co-investigators
Data sharing statement
Data from the ACT1 and ACT2 studies will be publicly available at ClinicalTrials.gov with the identifiers NCT01792817 and NCT01958125, respectively. Individual participant data will not be shared.