Systematic reviews with quantitative synthesis of included studies (meta-analysis) are being produced at increased rates in orthodontics. However, their reporting quality is often suboptimal, and methodological limitations can affect their conclusions. This article is designed to help orthodontists critically appraise the validity of a meta-analysis by providing 11 questions that address the planning, conduct and interpretation of these investigations.
DownsSH, BlackN.The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Commun Health1998; 52: 377–384.
5.
GuyattGH, OxmanAD, KunzR, BrozekJ, Alonso-CoelloP, RindD, GRADE guidelines 6. Rating the quality of evidence–imprecision. J Clin Epidemiol2011a; 64: 1283–1293.
6.
GuyattGH, OxmanAD, SchünemannHJ, TugwellP, KnottnerusA.GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol2011b; 64: 380–382.
7.
HardyRJ, ThompsonSG. Detecting and describing heterogeneity in meta-analysis. Stat Med1998; 17: 841–856.
8.
HigginsJP, AltmanDG, GøtzschePC, JüniP, MoherD, OxmanAD, The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ2011; 343: d5928.
9.
HigginsJPT, GreenS.Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. [Accessed 2014 March 24], Available from: http://www.cochrane-handbook.org
10.
HigginsJPT, ThompsonSG. Controlling the risk of spurious findings from meta-regression. Stat Med2004; 23: 1663–1682.
11.
HigginsJPT, ThompsonSG. Quantifying heterogeneity in a meta-analysis. Stat Med2002; 21: 1539–1558.
12.
LiberatiA, AltmanDG, TetzlaffJ, MulrowC, GθtzschePC, IoannidisJP, The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol2009; 62: e1–e34.
13.
NüeschE, TrelleS, ReichenbachS, RutjesAW, TschannenB, AltmanDG, Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study. BMJ2010; 341: c3515.
14.
PapageorgiouSN. Meta-analysis 101. Am J Orthod Dentofacial Orthop2013; 144: 497.
15.
PapageorgiouSN. Meta-analysis for orthodontists: Part I �— How to choose effect measure and statistical model. J Orthod2014; 41: 317–326.
16.
PapageorgiouSN, AntonoglouG, TsiranidouE, JepsenS, JägerA.Bias and small-study effects influence treatment effect estimates: a meta-epidemiological study in oral medicine. J Clin Epidemiol2014, Epub ahead of print: DOI: 10.1016/j.jclinepi.2014.04.002.
17.
PapageorgiouSN, KonstantinidisI, PapadopoulouK, JägerA, BourauelC.Clinical effects of pre-adjusted edgewise orthodontic brackets: a systematic review and meta-analysis. Eur J Orthod2014b; 36: 350–363.
18.
PogueJM, YusufS.Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative metaanalysis. Control Clin Trials1997; 18: 580e93.
19.
SavovićJ, JonesH, AltmanD, HarrisR, JűniP, PildalJ, Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies. Health Technol Assess2012; 16: 1–82.
20.
SloanJ, SymondsT, Vargas-ChanesD, FridleyB.Practical guidelines for assessing the clinical significance of health-related quality of life changes within clinical trials. Drug Inf J2003; 37: 23–31.
21.
SunX, BrielM, BusseJW, YouJJ, AklEA, MejzaF, Credibility of claims of subgroup effects in randomised controlled trials: systematic review. BMJ2012; 344: e1553.
22.
ThiruvenkatachariB, HarrisonJE, WorthingtonHV, O'BrienKD. Orthodontic treatment for prominent upper front teeth (Class II malocclusion) in children. Cochrane Database Syst Rev2013; 11: CD003452.
23.
WellsG, SheaB, O'ConnellD, PetersonJ, WelchV, LososM, The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. [Accessed 2014 March 24]. Available from: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp
24.
ZhangZ, XuX, NiH.Small studies may overestimate the effect sizes in critical care meta-analyses: a meta-epidemiological study. Crit Care2013; 17: R2.
