power swgee: GEE-based power calculations in stepped wedge cluster randomized trials

Abstract

Stepped wedge cluster randomized trials (SW-CRTs) are increasingly being used to evaluate interventions in medical, public health, educational, and social science contexts. With the longitudinal and crossover natures of an SW-CRT, complex analysis techniques are often needed, which makes appropriately powering SW-CRTs challenging. In this article, we introduce a newly developed SW-CRT power calculator embedded within the power command in Stata. The power calculator assumes a marginal model (that is, generalized estimating equations) for the primary analysis of SW-CRTs, for which other currently available SW-CRT power calculators may not be suitable. The command accommodates complete cross-sectional and closed-cohort designs and includes multilevel correlation structures appropriate for such designs. We discuss the methods and formulas underlying our SW-CRT calculator and provide illustrative examples of the use of power swgee. We provide suggestions about the choice of parameters in power swgee and conclude by discussing areas of future research that may improve the command.

Keywords

st0692 power swgee stepped wedge cluster randomized trials staggered rollout designs statistical power group randomized trials marginal models generalized estimating equations

Get full access to this article

View all access options for this article.

References

Baio

Copas

Ambler

Hargreaves

Beard

Omar

R. Z.

2015. Sample size calculation for a stepped wedge trial. Trials 16: 354. https://doi.org/10.1186/s13063-015-0840-9.

Baio

Leech

2016. SWSamp: Computes sample size for a stepped wedge design, using simulation-based calculations. R package version 0.3. https://rdrr.io/github/giabaio/SWSamp/.

Barker

McElduff

D’Este

Campbell

M. J.

2016. Stepped wedge cluster randomised trials: A review of the statistical methodology used and available. BMC Medical Research Methodology 16: 69. https://doi.org/10.1186/s12874-016-0176-5.

Brimblecombe

Ferguson

Chatfield

M. D.

Liberato

S. C.

Gunther

Ball

Moodie

, et al. 2017. Effect of a price discount and consumer education strategy on food and beverage purchases in remote Indigenous Australia: A stepped-wedge randomised controlled trial. Lancet Public Health 2: e82–e95. https://doi.org/10.1016/S2468-2667(16)30043-3.

Chen

Zhou

Spiegelman

2022. swdpwr: A SAS macro and an R package for power calculations in stepped wedge cluster randomized trials. Computer Methods and Programs in Biomedicine 213: 106522. https://doi.org/10.1016/j.cmpb.2021.106522.

Copas

A. J.

Lewis

J. J.

Thompson

J. A.

Davey

Baio

Hargreaves

J. R.

2015. Designing a stepped wedge trial: Three main designs, carry-over effects and randomisation approaches. Trials 16: 352. https://doi.org/10.1186/s13063-015-0842-7.

Eldridge

S. M.

Ukoumunne

O. C.

Carlin

J. B.

2009. The intra-cluster correlation coefficient in cluster randomized trials: A review of definitions. International Statistical Review 77: 378–394. https://doi.org/10.1111/j.1751-5823.2009.00092.x.

Fitzmaurice

G. M.

Laird

N. M.

Ware

J. H.

2011. Applied Longitudinal Analysis. 2nd ed. Hoboken, NJ: Wiley.

Ford

W. P.

Westgate

P. M.

2017. Improved standard error estimator for maintaining the validity of inference in cluster randomized trials with a small number of clusters. Biometrical Journal 59: 478–495. https://doi.org/10.1002/bimj.201600182.

10.

Ford

W. P.

Westgate

P. M.

2020. Maintaining the validity of inference in small-sample stepped wedge cluster randomized trials with binary outcomes when using generalized estimating equations. Statistics in Medicine 39: 2779–2792. https://doi.org/10.1002/sim.8575.

11.

Girling

A. J.

Hemming

2016. Statistical efficiency and optimal design for stepped cluster studies under linear mixed effects models. Statistics in Medicine 35: 2149–2166. https://doi.org/10.1002/sim.6850.

12.

Grayling

M. J.

Wason

J. M. S.

Mander

A. P.

2017. Stepped wedge cluster randomized controlled trial designs: A review of reporting quality and design features. Trials 18: 33. https://doi.org/10.1186/s13063-017-1783-0.

13.

Hargreaves

J. R.

Copas

A. J.

Beard

Osrin

Lewis

J. J.

Davey

Thompson

J. A.

Baio

Fielding

K. L.

Prost

2015. Five questions to consider before conducting a stepped wedge trial. Trials 16: 350. https://doi.org/10.1186/s13063-015-0841-8.

14.

Hemming

Girling

2014. A menu-driven facility for power and detectabledifference calculations in stepped-wedge cluster-randomized trials. Stata Journal 14: 363–380. https://doi.org/10.1177/1536867X1401400208.

15.

Hemming

Haines

T. P.

Chilton

P. J.

Girling

A. J.

Lilford

R. J.

2015. The stepped wedge cluster randomised trial: Rationale, design, analysis, and reporting. BMJ 350: h391. https://doi.org/10.1136/bmj.h391.

16.

Hemming

Kasza

Hooper

Forbes

Taljaard

2020. A tutorial on sample size calculation for multiple-period cluster randomized parallel, cross-over and stepped-wedge trials using the shiny CRT calculator. International Journal of Epidemiology 49: 979–995. https://doi.org/10.1093/ije/dyz237.

17.

Hemming

Lilford

Girling

A. J.

2015. Stepped-wedge cluster randomised controlled trials: A generic framework including parallel and multiple-level designs. Statistics in Medicine 34: 181–196. https://doi.org/10.1002/sim.6325.

18.

Hemming

Taljaard

2020. Reflection on modern methods: When is a stepped-wedge cluster randomized trial a good study design choice? International Journal of Epidemiology 49: 1043–1052. https://doi.org/10.1093/ije/dyaa077.

19.

Hooper

Teerenstra

de Hoop

Eldridge

2016. Sample size calculation for stepped wedge and other longitudinal cluster randomised trials. Statistics in Medicine 35: 4718–4728. https://doi.org/10.1002/sim.7028.

20.

Hughes

J. P.

Granston

T. S.

Heagerty

P. J.

2015. Current issues in the design and analysis of stepped wedge trials. Contemporary Clinical Trials 45: 55–60. https://doi.org/10.1016/j.cct.2015.07.006.

21.

Hussey

M. A.

Hughes

J. P.

2007. Design and analysis of stepped wedge cluster randomized trials. Contemporary Clinical Trials 28: 182–191. https://doi.org/10.1016/j.cct.2006.05.007.

22.

Kasza

Forbes

A. B.

2019. Inference for the treatment effect in multiple-period cluster randomised trials when random effect correlation structure is misspecified. Statistical Methods in Medical Research 28: 3112–3122. https://doi.org/10.1177/0962280218797151.

23.

Kasza

Hemming

Hooper

Matthews

J. N. S.

Forbes

A. B.

2019. Impact of non-uniform correlation structure on sample size and power in multiple-period cluster randomised trials. Statistical Methods in Medical Research 28: 703–716. https://doi.org/10.1177/0962280217734981.

24.

2020. Design and analysis considerations for cohort stepped wedge cluster randomized trials with a decay correlation structure. Statistics in Medicine 39: 438–455. https://doi.org/10.1002/sim.8415.

25.

Forbes

A. B.

Turner

E. L.

Preisser

J. S.

2019. Power and sample size requirements for GEE analyses of cluster randomized crossover trials. Statistics in Medicine 38: 636–649. https://doi.org/10.1002/sim.7995.

26.

Hughes

J. P.

Hemming

Taljaard

Melnick

E. R.

Heagerty

P. J.

2020. Mixed-effects models for the design and analysis of stepped wedge cluster randomized trials: An overview. Statistical Methods in Medical Research 30: 612–639. https://doi.org/10.1177/0962280220932962.

27.

Turner

E. L.

Preisser

J. S.

2018a. Optimal allocation of clusters in cohort stepped wedge designs. Statistics and Probability Letters 137: 257–263. https://doi.org/10.1016/j.spl.2018.02.002.

28.

Turner

E. L.

Preisser

J. S.

2018b. Sample size determination for GEE analyses of stepped wedge cluster randomized trials. Biometrics 74: 1450–1458. https://doi.org/10.1111/biom.12918.

29.

Rathouz

P. J.

Turner

E. L.

Preisser

J. S.

2021. Marginal modeling of cluster-period means and intraclass correlations in stepped wedge designs with binary outcomes. ArXiv Working Paper No. arXiv:2101.00484. https://doi.org/10.48550/arXiv.2101.00484.

30.

Liang

K.-Y.

Zeger

S. L.

1986. Longitudinal data analysis using generalized linear models. Biometrika 73: 13–22. https://doi.org/10.1093/biomet/73.1.13.

31.

Martin

Girling

Nirantharakumar

Ryan

Marshall

Hemming

2016a. Intra-cluster and inter-period correlation coefficients for cross-sectional cluster randomised controlled trials for type-2 diabetes in UK primary care. Trials 17: 1–12. https://doi.org/10.1186/s13063-016-1532-9.

32.

Martin

Taljaard

Girling

Hemming

2016b. Systematic review finds major deficiencies in sample size methodology and reporting for stepped-wedge cluster randomised trials. BMJ 6: e010166. https://doi.org/10.1136/bmjopen-2015-010166.

33.

Maselko

Sikander

Turner

E. L.

Bates

L. M.

Ahmad

Atif

Baranov

, et al. 2020. Effectiveness of a peer-delivered, psychosocial intervention on maternal depression and child development at 3 years postnatal: A cluster randomised trial in Pakistan. Lancet Psychiatry 7: 775–787. https://doi.org/10.1016/S2215-0366(20)30258-3.

34.

Mdege

N. D.

Man

M. S.

Taylor Nee Brown

C. A.

Torgerson

D. J.

2011. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. Journal of Clinical Epidemiology 64: 936–948. https://doi.org/10.1016/j.jclinepi.2010.12.003.

35.

Mhurchu

C. N.

Gorton

Turley

Jiang

Michie

Maddison

Hattie

2013. Effects of a free school breakfast programme on children’s attendance, academic achievement and short-term hunger: Results from a stepped-wedge, cluster randomised controlled trial. Journal of Epidemiology and Community Health 67: 257–264. https://doi.org/10.1136/jech-2012-201540.

36.

Mhurchu

C. N.

Turley

Gorton

Jiang

Michie

Maddison

Hattie

2010. Effects of a free school breakfast programme on school attendance, achievement, psychosocial function, and nutrition: A stepped wedge cluster randomised trial. BMC Public Health 10: 738. https://doi.org/10.1186/1471-2458-10-738.

37.

Murray

D. M.

1998. Design and Analysis of Group-Randomized Trials. New York: Oxford University Press.

38.

Parker

D. R.

Evangelou

Eaton

C. B.

2005. Intraclass correlation coefficients for cluster randomized trials in primary care: The cholesterol education and research trial (CEART). Contemporary Clinical Trials 26: 260–267. https://doi.org/10.1016/j.cct.2005.01.002.

39.

Preisser

J. S.

Qaqish

B. F.

2008. Finite sample adjustments in estimating equations and covariance estimators for intracluster correlations. Statistics in Medicine 27: 5764–5785. https://doi.org/10.1002/sim.3390.

40.

Preisser

J. S.

Young

M. L.

Zaccaro

D. J.

Wolfson

2003. An integrated population-averaged approach to the design, analysis and sample size determination of cluster-unit trials. Statistics in Medicine 22: 1235–1254. https://doi.org/10.1002/sim.1379.

41.

Qaqish

B. F.

2003. A family of multivariate binary distributions for simulating correlated binary variables with specified marginal means and correlations. Biometrika 90: 455–463. https://doi.org/10.1093/biomet/90.2.455.

42.

Rochon

. 1998. Application of GEE procedures for sample size calculations in repeated measures experiments. Statistics in Medicine 17: 1643–1658. https://doi.org/10.1002/(SICI)1097-0258(19980730)17:14<1643::AID-SIM869>3.0.CO;2-3.

43.

Roth

Sant’Anna

P. H. C.

2021. Efficient estimation for staggered rollout designs. ArXiv Working Paper No. arXiv:2102.01291. https://doi.org/10.48550/arXiv.2102.01291.

44.

Scott

J. M.

deCamp

Juraska

Fay

M. P.

Gilbert

P. B.

2017. Finite-sample corrected generalized estimating equation of population average treatment effects in stepped wedge cluster randomized trials. Statistical Methods in Medical Research 26: 583–597. https://doi.org/10.1177/0962280214552092.

45.

Svetkey

L. P.

Batch

B. C.

Lin

P. H.

Intille

S. S.

Corsino

Tyson

C. C.

Bosworth

H. B.

, et al. 2015. Cell phone intervention for you (CITY): A randomized, controlled trial of behavioral weight loss intervention for young adults using mobile technology. Obesity 23: 2133–2141. https://doi.org/10.1002/oby.21226.

46.

Taljaard

Teerenstra

Ivers

N. M.

Fergusson

D. A.

2016. Substantial risks associated with few clusters in cluster randomized and stepped wedge designs. Clinical Trials 13: 459–463. https://doi.org/10.1177/1740774516634316.

47.

Thompson

J. A.

Hemming

Forbes

Fielding

Hayes

2020. Comparison of small-sample standard-error corrections for generalised estimating equations in stepped wedge cluster randomised trials with a binary outcome: A simulation study. Statistical Methods in Medical Research 30: 425–439. https://doi.org/10.1177/0962280220958735.

48.

Tian

Preisser

Esserman

Turner

Rathouz

2022. Impact of unequal cluster sizes for GEE analyses of stepped wedge cluster randomized trials with binary outcomes. Biometrical 64: 419–439. https://doi.org/10.1002/bimj.202100112.

49.

Turner

E. L.

Gallis

J. A.

Prague

Murray

D. M.

2017a. Review of recent methodological developments in group-randomized trials: Part 1—Design. American Journal of Public Health 107: 907–915. https://www.doi.org/10.2105/AJPH.2017.303706.

50.

Turner

E. L.

Prague

Gallis

J. A.

Murray

D. M.

2017b. Review of recent methodological developments in group-randomized trials: Part 2—Analysis. American Journal of Public Health 107: 1078–1086. https://www.doi.org/10.2105/AJPH.2017.303707.

51.

Voldal

E. C.

Hakhu

N. R.

Xia

Heagerty

P. J.

Hughes

J. P.

2020. swCRTdesign: An R package for stepped wedge trial design and analysis. Computer Methods and Programs in Biomedicine 196: 105514. https://doi.org/10.1016/j.cmpb.2020.105514.

52.

Xiong

Athey

Bayati

Imbens

G. W.

2019. Optimal experimental design for staggered rollouts. http://dx.doi.org/10.2139/ssrn.3483934.

53.

Zhou

Liao

Kunz

L. M.

Normand

S.-L. T.

Wang

Spiegelman

2020. A maximum likelihood approach to power calculations for stepped wedge designs of binary outcomes. Biostatistics 21: 102–121. https://doi.org/10.1093/biostatistics/kxy031.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB