This article explores the statistical methodologies used in demonstration and effectiveness studies when the treatments are applied across multiple settings. The importance of evaluating and how to evaluate these types of studies are discussed. As an alternative to standard methodology, the authors of this article offer an empirical binomial hierarchical Bayesian model as a way to effectively evaluate multisite studies. An application of using the Bayesian model in a real-world multisite study is given.
Agresti, A., and J. Hartzel.2000. Strategies for comparing treatments on a binary response with multi-centre data. Statistics in Medicine19(8): 1115-39.
2.
Babor, T.F., K.L. Steinberg, B. McRee, J. Vendetti, and K.M. Carroll.2002. Treating marijuana dependence in adults: A multisite, randomized clinical trial. New Directions for Evaluation94:17-30.
3.
Battistich, V., E. Schaps, M. Watson, and D. Solomon.1996. Prevention effects of the child development project: Early findings from an ongoing multisite demonstration trial. Journal of Adolescent Research11(1): 12-35.
4.
Casella, G., and E. George.1992. Explaining the Gibbs sampler. American Statistician46:167-74.
5.
Cook, J.A., M.A. Carey, L.A. Razzano, J. Burke, and C.R. Blyler.2002. The Pioneer: The employment intervention demonstration program. New Directions for Evaluation94:310-44.
6.
Cunningham-Williams, R.M., L.B. Cottler, W.B. Compton, D.P. Desmond, W. Weschsberg, W.A. Zule, and P. Deichler.1999. Reaching and enrolling drug users for HIV prevention: A multi-site analysis. Drug and Alcohol Dependence54(1): 1-10.
7.
Feaster, D.F., M.S. Robbins, V. Horigian, and J. Szapocznik.2001. Statistical issues in multisite effectiveness trials: The case of brief strategic family therapy for adolescent drug abuse treatment. Clinical Trials1(5): 428-39.
8.
Fleiss, J.L.1986. Analysis of data from multiclinic trials. Controlled Clinical Trials7(4): 267-75.
9.
Gelman, A., J.B. Carlin, H.S. Stern, and D.B. Rubin.1995. Bayesian data analysis. London: Chapman & Hall.
10.
Gilks, W.R., A. Thomas, and D.J. Spiegelhalter .1994. A language and program for complex Bayesian modeling. Statistician43(3): 169-77.
11.
Gould, A.L.1998. Multi-centre trial analysis revisited. Statistics in Medicine17(15/16): 1779-97.
12.
Hardin, J.M.1998. The principle of intention to treat analysis in clinical trials: Its use and controversies. Journal of Pharmacy Practice10(4): 231-38.
13.
Hueston, W.J., A.G. Mainous, and J.B. Farrell.1994. A cost-benefit analysis of smoking cessation programs during the first trimester of pregnancy for the prevention of low birth weight. Journal of Family Practice39:353-57.
14.
Lauby, J.L., P.J. Smith, M. Stark, B. Person, and J. Adams.2000. A community-level HIV prevention intervention for inner-city women: Results of the women and infants demonstration projects . American Journal of Public Health90(2): 216-22.
15.
Lin, Z.1999. An issue of statistical analysis in controlled multi-centre studies: How shall we weight the centres? Statistics in Medicine18(4): 365-73.
16.
Margitic, S.E., S.K. Inouye, J.L. Thomas, C.K. Cassel, D.I. Regenstreif, and J.K. Kowal.1993. Hospital Outcomes Project for the Elderly (HOPE): Rationale and design for a prospective pooled analysis. Journal of the American Geriatrics Society41(3): 258-67.
17.
Michnich, M., S. Shortell, and W. Richardson.1981. Program evaluation: Resource for decision making. Health Care Management Review6:25-35.
18.
Milliken, G.A., and D.E. Johnson.1984. Design of experiments. Vol. 1 of Analysis of messy data. Belmont, CA: Life Learning.
19.
Normand, S.T., M.E. Glickman, and C.A. Gatsonis.1997. Statistical methods for profiling providers of medical care. Journal of the American Statistical Association92(439): 803-14.
20.
Novick, M.R., C. Lewis, and P.H. Jackson.1973. The estimation of proportions in m groups . Psychometrika38:19-46.
21.
Searle, S.R.1971. Linear models. New York: John Wiley .
22.
Senn, S.1998. Some controversies in planning and analysing multi-centre trials. Statistics in Medicine17(15/16): 1753-65.
23.
Speed, F.M., R.R. Hocking, and O.P. Hackney.1978. Methods of analysis of linear models with unbalanced data. Journal of the Royal Statistical Society73:105-12.
24.
Stillman, F.A., A.M. Hartman, B.I. Graubard, E.A. Gilpin, D.M. Murray, and J.T. Gibson.2003. Evaluation of the American Stop Smoking Intervention Study (ASSIST): A report of outcomes. Journal of theNational Cancer Institute95(22): 1681-91.
25.
Thomas, N., N. Longford, and J. Rolph.1994. Empirical Bayes methods for estimating hospital-specific mortality rates. Statistics in Medicine13(9): 889-903.
26.
Turpin, R. S., and J. M. Sinacore, eds. 1991. Multisite evaluations . San Francisco: Jossey-Bass.
27.
Wang, M., M.R. Novick, G.L. Isaacs, and D. Ozenne.1977. A Bayesian data analysis system for the evaluation of social programs. Journal of the American Statistical Association72(360): 711-22.
28.
Windsor, R.A.1998. A pregnant woman's guide to quit smoking. 5th ed. Washington, DC: Society for Public Health Education.
29.
Windsor, R.A., T. Baranowski, N. Clark, and G. Cutter.1994. Evaluation of health promotion, health education, and disease prevention programs. Mountain View, CA: Mayfield.
30.
Windsor, R.A., M.A. Crawford, and L.L. Woodby.1998. Commit to quit during and after pregnancy . Birmingham: University of Alabama at Birmingham Medical Television.
31.
Windsor, R.A., J.B. Lowe, L.L. Perkins, D. Smith-Yoder, L. Artz, M.A. Crawford, K. Ambrugy, and N.R. Boyd.1993. Health education for pregnant smokers: Its behavioral impact and cost benefit. American Journal of Public Health83(2): 201-6.
32.
Windsor, R.A., L.L. Woodby, T.M. Miller, J.M. Hardin, M.A. Crawford, and C.C. DiClemente .2000. Effectiveness of agency for health care policy and research clinical practice guideline and patient education methods for pregnant smokers in Medicaid maternity care. American Journal of Obstetrics and Gynecology182 (1 pt. 1): 68-75.
