Abstract
Background:
In order to ensure safer use of non-vitamin K antagonist oral anticoagulants (NOACs), continuously detecting unexpected adverse drug reactions (ADRs) after market approval is necessary.
Methods:
We performed disproportionality analysis to evaluate association between ADRs and NOACs including apixaban, dabigatran, and rivaroxaban using data from the Korea Institute of Drug Safety and Risk Management–Korea Adverse Event Reporting System database (KIDS-KD) between 2012 and 2016. There was no significant signal other than bleeding when considering quantity, signal strength, seriousness, and causality. In order to evaluate the NOAC reports about bleeding, we selected 62 WHO-ART diagnostic codes associated with bleeding. Among the 26 codes that referred to major bleeding, 18 codes referred to gastrointestinal bleeding and 8 were referred to intracranial bleeding. We evaluated the significance of the signals using reporting odds ratios (RORs) adjusted for age and sex.
Results:
Treatments with apixaban, dabigatran, and rivaroxaban were associated with 1989, 1668, and 2960 adverse events, respectively. Any type of bleeding with apixaban, dabigatran, rivaroxaban, and warfarin was reported in 174 (8.8%), 209 (12.5%), 523 (17.8%), and 620 (9.5%) events, respectively. For any bleeding, adjusted RORs of apixaban, dabigatran, and rivaroxaban were 0.99 [95% confidence interval (CI): 0.83–1.17], 1.47 (95% CI: 1.25–1.75), and 2.48 (95% CI: 2.16–2.84), respectively. With respect to major bleeding, the adjusted RORs of apixaban, dabigatran, and rivaroxaban were 1.08 (95% CI: 0.82–1.41), 1.46 (95% CI: 1.10–1.90), and 1.82 (95% CI: 1.43–2.32), respectively.
Conclusion:
Rivaroxaban might have stronger association with bleeding than apixaban and dabigatran.
Introduction
Atrial fibrillation (AF) is associated with a four- to five-fold increased risk of stroke and is responsible for approximately 15% of all strokes. 1 Oral anticoagulant (OAC) use is well-established for stroke prevention in patients with AF. In recent decades, non-vitamin K antagonist oral anticoagulants (NOACs) have been developed. Randomized controlled trials (RCTs) of NOACs have documented that NOACs have similar efficacy and safety as warfarin, but are more convenient for the patient since NOACs generally do not require periodic checking of the patient’s international normalized ratio. 2 Therefore, clinical guidelines for AF suggest that NOACs be included as one of the options or first-line choice for preventing stroke.3,4 The amount of NOACs used to replace warfarin is increasing rapidly.5,6
A risk of bleeding is expected with all anticoagulation therapies, and so prior RCTs and observational studies on adverse events (AEs) of NOACs have mainly focused on rates of bleeding. Some studies and case reports have suggested that NOACs induce other types of AEs such as liver injury, Stevens–Johnson syndrome, and gastroesophageal reflux syndrome.7–9 In order to ensure the safe use of NOACs, information on the occurrence of unexpected adverse drug reactions (ADRs) from studies that use ‘real-world’ healthcare databases is necessary.
We applied signal detection to evaluate the rate of unexpected AEs caused by NOACs through disproportionality analysis of data in spontaneous AE reporting systems. 10 The purpose of our study was to detect signals in AE reports of NOACs, and then to evaluate the priority levels of these signals based on the seriousness and causality assessment results. In addition, we compared the reporting trend of each NOACs based on prioritized signals.
Methods
Data source
We used the Korea Institute of Drug Safety and Risk Management (KIDS)–Korea Adverse Event Reporting System (KAERS) database, abbreviated to KIDS-KD, to evaluate AEs related to NOACs. KIDS-KD was established by the Ministry of Food and Drug Safety (MFDS) in 1988. KIDS-KD, managed by the KIDS, contained 1,089,163 reports of AE as of December 2016. More than 90% of reports in KIDS-KD were reported by medical professionals such as doctors, nurses, and pharmacists via 27 regional pharmacovigilance centers.
In KIDS-KD, drugs were coded according to Anatomical Therapeutic Chemical Classification System (ATC). AEs coded according to the Preferred Terms (PTs) among WHO Adverse Reaction Terminology. KIDS-KD also contained baseline patient characteristics such as age and sex, and seriousness and causality assessment results for reported AEs. Seriousness assessment was determined according to six categories including disability, deformity, life-threatening event, death, hospitalization, and other serious situations. In the causality assessment, the reporter chose one of six categories: ‘certain’, ‘probable’, ‘possible’, ‘unlikely’, ‘unclassified’, and ‘unassessable’. These seriousness and causality assessments were primarily recorded by each pharmacovigilance centers based on the WHO Uppsala Monitoring Center (UMC) criteria. 11
We analyzed the KIDS-KD, which included AEs due to antithrombotics (ATC: B01A) and antiarrhythmics (ATC: C01B) from January 2012 to December 2016. We defined the target drugs to be apixaban (ATC: B01AF02), dabigatran (ATC: B01AE07), and rivaroxaban (ATC: B01AF01), in comparison with warfarin (ATC: B01AA03). Since this study was performed using a deidentified secondary database, it was exempted from a review of the institutional review board of Seoul National University College of Medicine/Seoul National University Hospital (IRB No. 1706-112-860).
Signal detection and prioritization
In pharmacovigilance studies, disproportionality analysis, which compares the proportion of AE reports between the target drug and other drugs, is a well-established method for evaluating AE outbreak. When the target drug satisfies the index criteria for a specific AE due to higher disproportionality, the target drug is associated with that AE. 12
We applied three indices, including a proportional reporting ratio (PRR), reporting odds ratio (ROR), and information component (IC) for disproportionality analysis (Table 1).13–15 We restricted detected signals to events reported in more than three cases and which satisfied all three criteria indices (described in the following). For signal prioritization, we performed an additional two-step disproportionality analyses. In the first step, in order to reflect seriousness, we calculated the same indices using reports of serious cases including any kinds of six seriousness categories. In the second step, to reflect causality, the same indices were calculated using reports that were assessed to have possible or higher association. We defined a prioritized signal as satisfying quantity, signal strength, seriousness, and causality. Each type of AE that was determined to be a prioritized signal was then reviewed individually.
Indexes for signal detection in pharmacovigilance.
AE, adverse events; CI, confidence intervals; IC, information component; PRR, proportional reporting ratio; ROR, reporting odds ratio.
Vertical bars in the calculation column mean conditional probability; minus signs in the calculation column mean anything other than the drug or adverse events of interest in the study.
Focused risk quantification
We evaluate the reporting ratio of bleeding for warfarin and each NOAC. In order to select PTs in WHO-ART associated with bleeding, two pharmacoepidemiologists identified the entire PTs and, if the two disagreed, decided whether to include them through consultation. We defined 62 PTs in WHO-ART for any bleeding, and selected 26 of these which referred to major bleeding. Major bleeding was composed of 18 PTs referring to gastrointestinal (GI) bleeding and eight PTs referring to intracranial bleeding. The list of PTs associated with bleeding are supplied in Table S1 in the supplemental material.
We compared ROR adjusted for age and sex (aROR) between each NOAC and warfarin according to the type of bleeding including any bleeding, major bleeding, GI bleeding, and intracranial bleeding. We performed sequential analysis to evaluate the quarterly time trend of aRORs from the first quarter of 2014 to the fourth quarter of 2016. This method was based on analyzing each quarter from the cumulative data, including all the previously reported AEs. We performed a visual inspection to determine whether aRORs for each anticoagulant were persistently stable.
Statistical analysis
We analyzed differences in baseline patient characteristics enrolled in the studies of each NOAC and warfarin by using the χ2 test for categorical variables, and the t test and analysis of variance for continuous variables. PRR, ROR, and IC were calculated according to the formula of Table 1.13–15 We used a multiple logistic regression model to calculate the aROR. All statistical analyses were performed using SAS 9.4 (SAS institute Inc., Cary, NC, USA).
Results
Between 2012 and 2016, KIDS-KD contained 58,834 reports of AEs referring to the investigated drug classes, thereof 54,964 occurred after the use of antithrombotics and 3870 occurred after the use of antiarrhythmics. Among the 58,834 reports, 1989 (3.4%), 1668 (2.8%), 2960 (5.0%), and 6550 (11.1%) cases included the use of apixaban, dabigatran, rivaroxaban, and warfarin, respectively (Table 2). Since NOACs are the only newly approved drugs, more than 90% of reports with NOACs were reported after 2014. All the baseline characteristics were significantly different between each anticoagulant, and NOAC cases were older than warfarin users.
Baseline characteristics of apixaban, dabigatran, rivaroxaban, and warfarin in KIDS-KD 2012–2016.
KIDS-KD, Korea Institute of Drug Safety and Risk Management (KIDS)-Korea Adverse Event Reporting System (KAERS) database.
Assessed by reporter.
There were 320, 273, and 393 types of AE in KIDS-KD connected to apixaban, dabigatran, and rivaroxaban, respectively. After calculating the PRR, ROR, and IC from the full reports, 80, 34, and 66 signals were detected for apixaban, dabigatran, and rivaroxaban, respectively (data not shown). From serious cases, the signals of apixaban, dabigatran, and rivaroxaban were reduced to 66, 17, and 48, respectively. Finally, 13 rivaroxaban signals remained after signal prioritization (Figure 1). Ten of these prioritized signals were bleeding diagnoses, and other signals, which included anemia, hypochromic anemia, and increased prothrombin time, were explained as laboratory results associated with bleeding.

Flow chart of signal detection and prioritization in KIDS-KD 2012–2016.
Any type of bleeding with apixaban, dabigatran, rivaroxaban, and warfarin was reported in 174 (8.8%), 209 (12.5%), 523 (17.8%), and 620 (9.5%) cases, respectively (Figure 2). Rivaroxaban had a higher aROR (2.48, 95% CI: 2.16–2.84) related to any bleeding than apixaban (0.99, 95% CI: 0.83–1.17), dabigatran (1.47, 95% CI: 1.25–1.75), and warfarin (1.30, 95% CI: 1.18–1.42). With respect to major bleeding, the aROR of rivaroxaban (1.82, 95% CI: 1.43–2.32) was not statistically higher than that of dabigatran (1.46, 95% CI: 1.10–1.90) or warfarin (1.44, 95% CI: 1.23–1.69), but it was statistically higher than that of apixaban (1.08, 95% CI: 0.82–1.41). Adjusted ROR patterns for GI bleeding were similar to that for major bleeding, but comparatively clear differences were seen between the patterns for each OAC. Specifically, rivaroxaban (2.35, 95% CI: 1.81–3.04) had a statistically higher aROR than apixaban (1.08, 95% CI: 0.82–1.41).

aRORs according to type of bleeding in apixaban, dabigatran, rivaroxaban, and warfarin in KIDS-KD 2012–2016.
Of all 58,834 reports, 13,302 (22.6%) that did not contain dates of AE occurrence were excluded from the sequential analysis. The time trend for aROR for any bleeding due to NOACs fluctuated and had wide 95% CIs in 2014, but became stable after the middle of 2015. Of the aRORs for any bleeding, rivaroxaban had persistently higher aRORs than other OACs from the second quarter of 2015 (Figure 3). For GI bleeding, 95% CIs of adjusted rivaroxaban RORs overlapped with those for apixaban, dabigatran, and warfarin (Figure 4).

Sequential analyses of aROR of any bleeding in apixaban, dabigatran, rivaroxaban, and warfarin in KIDS-KD 2012–2016.

Sequential analyses of aROR of GI bleeding in apixaban, dabigatran, rivaroxaban, and warfarin in KIDS-KD 2012–2016.
Discussion
NOACs and bleeding risk
In our study, rivaroxaban had a higher aROR for any bleeding than other OACs, including apixaban, dabigatran, and warfarin. A higher aROR indicated that rivaroxaban was more frequently reported as being connected to any bleeding than other AEs were reported as being connected to other anticoagulants, and this reporting tendency was preserved from the third quarter of 2015 onwards. For major bleeding, the aROR of rivaroxaban was higher than that of apixaban, but similar to those of dabigatran and warfarin, and this was affected by reports of GI bleeding rather than intracranial bleeding.
These outcomes were similar to previous results of RCTs and observational studies. The Rivaroxaban Once Daily Oral Direct Factor Xa Inhibition Compared with Vitamin K Antagonist for Prevention of Stroke and Embolism Trial in Atrial Fibrillation (ROCKET-AF) trial reported that the major bleeding rate of rivaroxaban was 3.60 per 100 patient-years (PYs). 16 This rate was relatively higher than the 2.13 per 100 PYs of apixaban in the Apixaban for Reduction in Stroke and Other Thromboembolic Events in Atrial Fibrillation (ARISTOTLE) trial and 3.11 per 100 PYs of dabigatran, 150 mg, in The Randomized Evaluation of Long-term Anti-coagulant Therapy (RE-LY) trial.17,18 In post-approval observational studies, the major bleeding rate attributed to each NOAC was similar to the results of the RCTs: 2.29–2.38 per 100 PYs, 2.04–3.60 per 100 PYs, and 2.90–6.00 per 100 PYs for apixaban, dabigatran, and rivaroxaban, respectively.19–22 In pairwise comparisons among NOACs, the major bleeding rates attributed to apixaban, dabigatran, and rivaroxaban were the lowest, intermediate, and the highest, respectively. In the subgroup analyses, intracranial bleeding rates attributed to all three NOACs were lower than that of warfarin.21–23 For GI bleeding, the incidence rate of rivaroxaban was higher than that of warfarin, though apixaban and dabigatran had similar incidences as warfarin.22,24
According to the results of previous studies, rivaroxaban was associated with a significantly higher risk of minor bleeding and GI bleeding than apixaban or dabigatran. Some researchers suggested that the conventional dose of rivaroxaban was related to a higher bleeding risk. Larsen et al. and Nielsen et al. reported, based on database from a Danish prescription registry, that rivaroxaban had a relatively higher hazard ratio (HR) for any bleeding and major bleeding than apixaban or dabigatran at conventional doses. 21 However, a reduced dose of rivaroxaban, 20 mg once daily or 15 mg once daily, caused a similar HR of any bleeding and major bleeding compared with apixaban or dabigatran. 25 Since the bleeding risk could be explained as the additive and opposing effects aimed at preventing strokes in patients with AF, it would be desirable that the use of a risk-adjusted dose of rivaroxaban be recommended in order to maintain a balance between bleeding risk and effects of preventing the stroke.
Another potential hypothesis was that physicians tended to prescribe rivaroxaban to older and higher-risk patients. 26 When choosing between NOACs, physicians may decide to prescribe a particular NOAC to patients who are similar to those included in the pivotal RCT, and the RCT of rivaroxaban included older and higher-risk participants than the other RCTs. However, in our study, we could not confirm this finding. Moreover, patients who reported AEs with rivaroxaban were younger on average than that of patients who reported AEs with apixaban or dabigatran.
Disproportionality analysis in the spontaneous AE reporting system
This study aimed to broadly examine the disproportionality of AEs with each NOAC. For newly approved drugs such as NOACs, the clinical trial provides the most valuable scientific evidence for effectiveness and safety. Recently, many epidemiologic studies, including both nationwide claims-based or registry-based studies, have been conducted. Research using spontaneous AE reporting system cannot provide strong evidence for safety, but can provide highly sensitive and timely evidence of unexpected safety issues. 8 Research with this method is usually performed to detect unexpected ADRs that are not found in the list of well-documented ADRs found on the drug label information.27–29 Therefore, continuous monitoring is needed along with cooperation with other epidemiologic studies on drug safety.
In our study, 34, 66, and 80 signals for dabigatran, rivaroxaban, and apixaban, respectively, were detected using pharmacovigilance disproportionality analysis from full AE reports. Because there were too many signals to evaluate, signal prioritization was needed. Therefore, we set up more specific criteria including the results of seriousness and causality assessments performed by the reporters. After prioritization, the remaining signals were more specific and included relatively serious issues associated with bleeding and NOACs. However, this method for prioritization could not detect unexpected ADRs, since the assessments of causality were performed by primary practitioners based on well-established safety information. Therefore, we are planning to apply more loose criteria of prioritization to increase the sensitivity of detecting unexpected ADRs in future studies.
Strengths and limitations
This study has several strengths. First, KIDS-KD was a suitable database for detecting signals as we applied disproportional analysis. This database contained all AE reports from 27 regional pharmacovigilance centers composed of 25 general hospitals covering all provinces in South Korea, the National Medical Center that responded to AE reports from nationwide public health care institutions, and the Korean Pharmaceutical Association that received AE reports from nationwide pharmacists. Furthermore, KIDS-KD is the most active spontaneous adverse event reporting system in the world. According to the UMC reports in 2015, South Korea was the third-highest ranked country for both total number of AE reports and reports per million inhabitants, preceded by the United States and Singapore, respectively. 30 Second, we analyzed the trend of the strength of association between drug and AE on a quarterly basis. aRORs for NOACs stabilized from the second quarter of 2015 onwards and were persistently higher for rivaroxaban than for apixaban or dabigatran. This consistent aROR supports the association between bleeding risk and class of NOACs.
This study has several limitations. First, a spontaneous AE reporting system does not have denominator data. In order to estimate AE incidence, the number of AE occurrences per total amount of consumed drugs is needed. Therefore, we applied disproportionality analysis to measure different occurrence rates in the same drug classes. Second, spontaneous AE reporting systems have inadequate information on individual cases including indicated disease, comorbidities, and regimen of drugs taken. Disproportionality analysis was not performed to confirm causality assessment, but for screening the occurrence of AEs. Third, since practitioners are concerned about the safety issues of newly approved drugs, AEs of these drugs are reported relatively more frequently than those of other drugs. It is possible that AEs of newly approved drugs were reported more frequently than overall reporting of AEs. Therefore, we additionally analyzed the change in reporting rate between different NOACs, which is similar in the timing of approval and interest of practitioners. Furthermore, we performed sequential analyses to evaluate the persistency of AE reporting. Since the middle of 2015, the reporting rate of bleeding stabilized.
Conclusion
The risk of bleeding, a well-recognized AE of NOACs, was found to be similar to the results of previous studies in that rivaroxaban showed a higher risk of any bleeding than apixaban or dabigatran. This finding was persistently maintained in various databases and research methods. We have added to the evidence about bleeding risk of NOACs by disproportionality analysis using the Korean spontaneous AE databases. Further well-designed pharmacoepidemiologic studies are needed to evaluate the causality of the unexpected AEs of NOACs other than bleeding.
Supplemental Material
NOAC_signal_evaluation_tables_S1_180807 – Supplemental material for Comparison of bleeding risks among non-vitamin K antagonist oral anticoagulants using the Korea adverse event reporting system database
Supplemental material, NOAC_signal_evaluation_tables_S1_180807 for Comparison of bleeding risks among non-vitamin K antagonist oral anticoagulants using the Korea adverse event reporting system database by Young-Jin Ko, Seonji Kim, Kyounghoon Park, Minsuk Kim, Bo Ram Yang, Joongyub Lee, Mi-Sook Kim and Byung-Joo Park in Therapeutic Advances in Drug Safety
Footnotes
Acknowledgements
The authors greatly appreciate KIDS for providing KIDS-KD for this study.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by the Korea Medical Institute (KMI) Grant Program in 2017.
Conflict of interest statement
The authors declare that there is no conflict of interest.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
