Evaluating the impact of imputations for missing participant outcome data in a network meta-analysis

Abstract

Background

In a meta-analysis of trials with missing outcome data, a parameter known as informative missing odds ratio (IMOR) can be used to quantify the relationship between informative missingness and a binary outcome. IMORs also account for the increased uncertainty due to missingness in the meta-analysis results.

Purpose

To extend the idea of IMOR into a network meta-analysis (NMA) setting in order to explore the impact of missing outcome data on the inferences about the relative effectiveness of several competing treatments in psychiatric trials.

Methods

IMORs were estimated in two datasets comparing anti-manic treatments and antidepressants. The outcome was response to treatments. In the original meta-analyses, missing participants were assumed to have failed regardless the treatment they were allocated to. To evaluate the robustness of this assumption in each dataset, several imputations of the missing outcomes were studied by an IMOR parameter in the NMA model. By comparing the odds ratios for efficacy under the initial analysis and under several assumptions about the missingness, we assessed the consistency of the conclusions. The missing data mechanism was studied by comparing the prior with the posterior IMOR distribution. Models were fitted using Markov chain Monte Carlo (MCMC) in WinBUGS.

Results

In both datasets, the relative effectiveness of the treatments seems to be affected only by the two extreme imputation scenarios of worst- and best-case analyses. Moreover, heterogeneity increases in both datasets under these two extreme scenarios. Overall, there is a non-significant change on the ranking of the anti-manic and antidepressant treatments. The posterior and prior IMOR distributions are very similar showing that the data do not provide any information about the true outcome in missing participants. There is a very weak indication that missing participants tend to fail in placebo and paroxetine, while the opposite occurs for sertraline, fluoxetine, and fluvoxamine.

Limitations

Investigation of informative missingness was limited two classes of treatments and for dichotomous outcome measures. The proportion of missing outcomes was very low overall, and hence, the power of detecting any differences in effectiveness estimated under the various imputation methods is small.

Conclusions

Sensitivity analysis to account for missing outcome data and their uncertainty in the NMA can be undertaken by extending the idea of IMOR. In two case examples, we found no differences between the various models due to low missing data rate. In line with previous observations, data carry little information about the reason of missingness.