In this paper we discuss statistical considerations regarding endpoints in preventive vaccine trials. Brief discussion is given to preclinical, Phase I, and Phase II trials, with the bulk of attention paid to endpoint choice and analysis in Phase III efficacy trials. In addition to traditional efficacy measures of vaccine effects for immunized individuals, consideration is given to waning, strain specific efficacy, correlates of protective immunity, postinfection endpoints, and cluster randomized trials.
Get full access to this article
View all access options for this article.
References
1.
Clemens JD , Stanton BF.Long term evaluation of vaccine efficacy. Methodological issues for Phase III and Phase IV trials. In: Woodrow GC , Levine MM eds. New generation vaccines. New York: Marcel Dekker , 1990, pp 51-68.
2.
Piantadosi S.Clinical trials: a methodologic perspective. New York: Wiley , 1997.
3.
Heyse JF.Outcome measures in clinical trials. In: Armitage P , Colton T , eds. Encyclopedia of biostatistics. New York: Wiley , 1998, pp 3214-3220.
4.
Friedman LM , Furberg C , DeMets DL.Fundamentals of clinical trials. New York: Springer-Verlag , 1998.
5.
Stanley K , Lagakos S.Biostatistical considerations in the design and analysis of AIDS clinical trials. In: Merigan TC , Bartlett JG , Bolognesi D , eds. Textbook of AIDS medicine, 2nd edn. Baltimore: Williams and Wilkins , 1999, pp 807-814.
6.
Ellenberg SS , Dixon DO.Statistical issues in designing clinical trials of AIDS treatments and vaccines . Journal of Statistical Planning and Inference1994; 42: 123-135 .
7.
Horne AD , Lachenbruch PA , Goldenthal KL.Intent-to-treat analysis and preventive vaccine efficacy . Vaccine2001; 19: 319-326 .
8.
Horne AD , Clifford J , Goldenthal KL , Kleppinger C , Lachenbruch PA.Efficacy and safety of preventive vaccines: FDA evaluation . In Proceedings of the Annual Meeting of the American Statistical Association, Atlanta, August 5-9, 2001.
9.
Clements-Mann ML.Lessons for AIDS vaccine development from non-AIDS vaccines . AIDS Research and Human Retroviruses1998; 14(Suppl 3): S197-S203 .
10.
Almeida R , Norrish A , Levick M , Vetrie D , Freeman T , Vilo J , Ivens A , Lange U , Stober C , McCann S , Blackwell J.From genomes to vaccines: Leishmania as a model . Philosophical Transactions of the Royal Society of London B: Biological Sciences2002; 357: 5-11 .
11.
De Groot AS , Sbai H , Aubin CS , McMurry J , Martin W.Immuno-informatics: mining genomes for vaccine components . Immunology and Cell Biology2002; 80: 255-269 .
12.
Strathdee SA , Loughlin AM.Vaccines - past, present, and future. In: Nelson KE , Williams CM , Graham NMH , Masters CF , eds. Infectious disease epidemiology: theory and practice. Gaithersburg, MD: Aspen Publishers , 2001, pp 255-282.
13.
Westfall PH , Young SS.Resampling-based multiple testing: examples and methods for p-value adjustment. New York: Wiley , 1993.
14.
Mehrotra DV , Heyse JF.Multiplicity considerations in clinical safety analyses . In Proceedings of the Annual Meeting of the American Statistical Association, Atlanta, USA, 5-9 August 2001.
15.
ICH Harmonised Tripartite Guidelines : Statistical Principles for Clinical Trials . Federal Register1998; 63(179): 49583-49598 .
16.
Belshe RB , Stevens C , Gorse GJ , Buchbinder S , Weinhold K , Sheppard H , Stablein D , Self S , McNamara J , Frey S , Flores J , Excler JL , Klein M , El Habib R , Duliege A , Harro C , Corey L , Keefer M , Mulligan M , Wright P , Celum C , Judson F , Mayer K , McKirnan D , Marmor M , Woody G , for the National Institute of Allergy and Infectious Diseases AIDS Vaccine Evaluation Group , and HIV Network for Prevention Trials (HIVNET) . Safety and immunogenicity of a canarypoxvectored human immunodeficiency virus type 1 vaccine with or without gp120: A phase 2 study in higher- and lower-risk volunteers . Journal of Infectious Diseases2001; 183: 1343-1352 .
17.
Clements-Mann ML , Weinhold K , Matthews TJ , Graham BS , Gorse GJ , Keefer MC , McElrath MJ , Hsieh R , Mestecky J , Zolla-Pazner S , Mascola J , Schwartz D , Siliciano R , Corey L , Wright PF , Belshe R , Dolin R , Jackson S , Xu S , Fast P , Walker MC , Stablein D , Excler J , Tartaglia J , Duliege A , Sinangil F , Paoletti E , and the NIAID AIDS Vaccine Evaluation Group . Immune responses to human immunodeficiency virus (HIV) type 1 induced by canarypox expressing HIV-1MN gp120, HIV-1SF2 recombinant gp120, or both vaccines in seronegative adults . Journal of Infectious Diseases1998; 177: 1230-1246 .
18.
Corey L , McElrath MJ , Weinhold K , Matthews T , Stablein D , Graham B , Keefer M , Schwartz D , Gorse G , and the AIDS Vaccine Evaluation Group . Cytotoxic T cell and neutralizing antibody responses to human immunodeficiency virus type 1 envelope with a combination vaccine regimen . Journal of Infectious Diseases1998; 177: 301-309 .
19.
Evans TG , Keefer MC , Weinhold KJ , Wolff M , Monteffori D , Gorse GJ , Graham BS , McElrath MJ , Clements-Mann ML , Mulligan MJ , Fast P , Walker MC , Excler J , Duliege A , Tartaglia J , and the NIAID AIDS Vaccine Evaluation Group . A canarypox vaccine expressing multiple human immunodeficiency virus type 1 genes given alone or with rgp120 elicits broad and durable CD8+ cytotoxic T lymphocyte responses in seronegative volunteers . Journal of Infectious Diseases1999; 180: 290-298 .
20.
AIDS Vaccine Evaluation Group 022 Protocol Team . Cellular and humoral immune responses to a canarypox vaccine containing human immunodeficiency virus type 1 env, gag, and pro in combination with rgp120 . Journal of Infectious Diseases2001; 183: 563-570 .
21.
Russell N , Hudgens MG , Ha R , Havenar-Daughton C , McElrath MJ.Moving to HIV-1 vaccine efficacy trials: defining T cell responses as potential correlates of immunity . Journal of Infectious Diseases2003; 187: 226-242 .
22.
Kahn P.NIH drops plans for Phase III trial. International AIDS Vaccine Initiative Report, 6, 2002.
23.
Self SG , Hudgens MG , Chiu Y , Rossini AJ.Statistical methods for evaluating ELISPOT assays in HIV vaccine trials. AIDS Vaccine 2001, Philadelphia , September 2001. Poster no. 36.
24.
Broman K , Speed T , Tigges M.Estimation of antigen-responsive T cell frequencies in PBMC from human subjects . Journal of Immunological Methods1998; 98(2): 119-132 .
25.
Herrington DA.Initial clinical evaluation of new vaccine candidates. Phase I and II trials of safety, immunogenicity, and preliminary efficacy. In: Woodrow GC , Levine MM , eds. New generation vaccines. New York: Marcel Dekker , 1990, pp 43-49.
26.
Rao MR , Blackwelder WC , Troendle JF , Naficy AB , Clemens JD.Sample size determination for phase II studies of new vaccines . Vaccine2002; 20: 3364-3369 .
27.
Farrington P , Miller E.Clinical trials. In: Robinson A , Farrar G , Wiblin C , eds. Methods in molecular medicine: vaccine protocols. Totowa: Humana Press , 1996, pp 251-268.
28.
Carey VJ , Baker CJ , Platt R.Bayesian inference on protective antibody levels using case-control data . Biometrics2001; 57(1): 135-142 .
29.
Moulton LH , Halsey NA.A mixed gamma model for regression analyses of quantitative assay data . Vaccine1996; 14: 1154-1158 .
30.
Moulton LH , Holt EA , Job JS , Halsey NA.Percentile regression analysis of correlated antibody responses . Statistics in Medicine1995; 14: 777-787 .
31.
Moulton LH , Halsey NA.A mixture model with detection limits for regression analyses of antibody response to vaccine . Biometrics1995; 51: 1570-1578 .
32.
Hudgens MG.Estimating cumulative probabilities from incomplete longitudinal binary responses with application to HIV vaccine trials . Statistics in Medicine2003; 22: 463-479 .
33.
Flores J , Perez-Schael I , Gonzalez M , Garcia D , Perez M , Daoud N , Cunto W , Chanock RM , Kapikian AZ.Protection against rotavirus diarrhoea by rhesus rotavirus vaccine in Venezuelan children . Lancet1987; 1: 882-884 .
34.
Flores J , Perez-Schael I , Blanco M , Rojas AM , Alfonso E , Crespo I , Cunto W , Pittman A , Kapikian AZ.Reactogenicity and immunogenicity of a high titered rhesus rotavirus based quadrivalent rotavirus vaccine . Journal of Clinical Microbiology1994; 31: 2439-2445 .
35.
Cochran WG , Cox GM.Experimental designs, 2nd edn (Classics Edition). New York: Wiley , 1992.
36.
Levine MM , Kaper JB , Herrington D , Ketley J , Losonsky G , Tacket CO , Tall B , Cryz S.Progress in the development of an HIV-1 vaccine . Lancet1988; 2(8609): 467-470 .
37.
Farrington CP.Communicable diseases. In: Armitage P , Colton T , eds. Encyclopedia of biostatistics. New York: Wiley , 1998; pp 795-815.
38.
Goldenthal KL , Falk LA , Geber A.Prelicensure evaluation of combination vaccines . Clinical Infectious Diseases2001; 33(Suppl 4): S267-S273 .
39.
Smith PG , Rodrigues LC , Fine PEM.Assessment of the protective efficacy of vaccines against common diseases using case-control and cohort studies . International Journal of Epidemiology1984; 13: 87-93 .
40.
Clemens J , Brenner R , Rao M , Tafari N , Lowe C.Evaluating new vaccines for developing countries. Efficacy or effectiveness ? Journal of the American Medical Association1996; 275: 390-397 .
41.
Chick SE , Barth-Jones DC , Koopman JS.Bias reduction for risk ratio and vaccine effect estimators . Statistics in Medicine2001; 20: 1609-1624 .
42.
Szmuness W , Stevens CE , Zang EA , Harley EJ , Kellner Z.A controlled clinical trial of the efficacy of the hepatitis B vaccine Heptavax B: a final report . Hepatology1981; 1: 377-385 .
43.
Kaplan EL , Meier P.Nonparametric estimation from incomplete data . Journal of the American Statistical Association1958; 53: 457-481 .
44.
Peto R.Empirical survival curves for interval censored data . Applied Statistics1973; 22: 86-91 .
45.
Yip PSF , Chen Q.A partial likelihood estimator of vaccine efficacy . The Australian and New Zealand Journal of Statistics2000; 42(3): 367-374 .
46.
Alonso PL , Smith T , Armstrong Schellenberg JRM , Masanja H , Mwankusye S , Urassa H , Bastos de Azevedo I , Chongela J , Kobero S , Menendez C , Hurt N , Thomas MC , Lyimo E , Weiss NA , Hayes R , Kitua AY , Lopez MC , Kilama WL , Teuscher T , Tanner M.Randomised trial of efficacy of SPf66 vaccine against Plasmodium falciparum malaria in southern Tanzania . Lancet1994; 344: 1175-1181 .
47.
Schaper C , Fleming TR , Self SG , Rida WN.Statistical issues in the design of HIV vaccine trials . Annual Review of Public Health1995; 16: 1-22 .
48.
Gilbert PB.Some statistical issues in the design of HIV-1 vaccine and treatment trials . Statistical Methods in Medical Research2000; 9(3): 207-229 .
49.
Haber M , Longini IM , Halloran ME.Measures of the effects of vaccination in a randomly mixing population . International Journal of Epidemiology1991; 20: 300-310 .
50.
Halloran ME , Longini IM , Struchiner CJ.Design and interpretation of vaccine field studies . Epidemiological Reviews1999; 21: 73-88 .
51.
Gilbert PB , Bosch R , Hudgens MG.Sensitivity analysis for the assessment of causal vaccine effects on viral load in HIV vaccine trials . Biometrics2003; 59: 531-541 .
52.
Hudgens MG , Hoering A , Self SG.On the analysis of viral load endpoints in HIV vaccine trials . Statistics in Medicine2003; 22: 2281-2298 .
53.
Francis DP , Gregory T , McElrath MJ , Belshe RB , Gorse GJ , Migasena S , Kitayaporn D , Pitisuttitham P , Matthews T , Schwartz DH , Berman PW.Advancing AIDSVAX to phase 3: safety, immunogenicity, and plans for phase 3 . AIDS Research and Humun Retroviruses1998; 14(Suppl 3): S325-S331 .
54.
Fine PEM.Implications of different study designs for the evaluation of acellular pertussis vaccines . Developments in Biological Standardization1997; 89: 123-133 .
55.
Gilbert PB , DeGruttola V , Hudgens MG , Self SG , Hammer SM , Corey L.What constitutes efficacy for an human immunodeficiency virus vaccine that ameliorates viremia: issues involving surrogate end points in phase 3 trials . Journal of Infectious Diseases2003; 188: 179-193 .
56.
Rotnitzky A , Robins JM , Scharfstein DO.Semiparametric regression for repeated outcomes with nonignorable nonresponse . Journal of the American Statistical Association1998; 93: 1321-1339 .
57.
Chang MN , Guess HA , Heyse JF.Reduction in burden of illness: a new efficacy measure for prevention trials . Statistics in Medicine1994; 13: 1807-1814 .
58.
Vesikari T , Rautanen T , Varis T , Beards GM , and Kapikian AZ.Rhesus Rotavirus candidate vaccine: clinical trial in children vaccinated between 2 and 5 months of age . American Journal of Diseases of Children1990; 144: 285-289 .
59.
Frangakis CE , Rubin DB.Principal stratification in causal inference . Biometrics2002; 58: 21-29 .
60.
Kliks SC , Nisalak A , Brandt WE , Wahl L , Burke DS.Antibody-dependent enhancement of dengue virus growth in human monocytes as a risk factor for dengue hemorrhagic fever . American Journal of Tropical Medicine and Hygiene1989; 40: 444-451 .
61.
Nabel GJ.Challenges and opportunities for development of an AIDS vaccine . Nature2001; 410: 1002-1007 .
62.
Burke DS.Human HIV vaccine trials: does antibody-dependent enhancement pose a genuine risk ? Perspectives in Biology and Medicine1992; 35(4): 511-530 .
63.
Mascola JR , Mathieson BJ , Zack PM , Walker MC , Halstead SB , Burke DS.Summary report: workshop on the potential risks of antibody-dependent enhancement in human HIV vaccine trials . AIDS Research and Human Retroviruses1993; 9(12): 1175-1184 .
64.
Prentice RL.On the role and analysis of secondary outcomes in clinical trials . Statistics in Medicine1989; 8: 431-440 .
65.
Lachin JM.Statistical considerations in the intent-to-treat principle . Controlled Clinical Trials2000; 21: 167-189 .
66.
Ellenberg JN.Intention-to-treat analysis. In: Armitage P , Colton T , eds. Encyclopedia of biostatistics. New York: Wiley , 1998, pp 2056-2060.
67.
Goetghebeur E , Loeys T.Beyond intent to treat . Epidemiologic Reviews2002, 24: 85-90 .
68.
Halloran ME , Longini IM.Using validation sets for outcomes and exposure to infection in vaccine field studies . American Journal of Epidemiology2001; 154: 391-398 .
Fine PEM , Clarkson JA.Reflections on the efficacy of pertussis vaccines . Reviews of Infectious Diseases1987; 9: 866-883 .
71.
Pepe MS , Reilly M , Fleming TR.Auxiliary outcome data and the mean score method . Journal of Statistical Planning and Inference1994; 42: 137-160 .
72.
Prentice RL.Surrogate endpoints in clinical trials: Definition and operational criteria . Statistics in Medicine1989; 8: 431-440 .
73.
Fleming TR , DeMets DL.Surrogate end points in clinical trials: are we being misled ? Annals of Internal Medicine1996; 125: 605-613 .
74.
DeGruttola VG , Clax P , DeMets DL , Downing, GJ , Ellenberg SS , Friedman L , Gail MH , Prentice R , Wittes J , Zeger SL.Considerations in the evaluation of surrogate endpoints in clinical trials: summary of a National Institutes of Health workshop . Controlled Clinical Trials2001; 22: 485-502 .
75.
Edwards KM.Development, acceptance, and use of immunologic correlates of protection in monitoring the effectiveness of combination vaccines . Clinical Infectious Diseases2001; 33: S274-S277 .
76.
Siber GR.Methods for estimating serological correlates of protection . Developments in Biological Standardization1997; 89: 283-296 .
77.
Chan ISF , Li S , Matthews H , Chan C , Vessey R , Sadoff J , Heyse J.Use of statistical models for evaluating antibody response as a correlate of protection against varicella . Statistics in Medicine2002; 21: 3411-3430 .
78.
Storsaeter J , Hallander HO , Gustafsson L , Olin P.Levels of anti-pertussis antibodies related to protection after households exposure to Bordetella pertussis . Vaccine1998; 16: 1907-1916 .
79.
Mellors JW , Kingsley LA , Rinaldo Jr CR , Todd JA , Kokka RP , Gupta P.Quantitation of HIV-1 RNA in plasma predicts outcome after seroconversion . Annals of Internal Medicine1995; 122: 573-579 .
80.
Katzenstein TL , Pedersen C , Nielsen C , Lundgren JD , Jakobsen PH , Gerstoft J.Longitudinal serum HIV RNA quantification: correlation to viral phenotype at seroconversion and clinical outcome . AIDS1996; 10(2): 167-173 .
81.
Pedersen C , Katzenstein T , Nielsen C , Lundgren JD , Gerstoft G.Prognostic value of serum HIV-RNA levels at virologic steady state after seroconversion: relation to CD4 cell count and clinical course of primary infection . Journal of Acquired Immune Deficiency Syndromes and Human Retrovirology1997; 16: 93-99 .
82.
Quinn TC , Wawer MJ , Sewankambo N , Serwadda D , Li C , Wabwire-Mangen F , Meehan MO , Lutalo T , Gray RH.Viral load and heterosexual transmission of human immunodeficiency virus type 1 . New England Journal of Medicine2000; 342: 921-929 .
83.
Ward RL , Bernstein DI , Young EC , Sherwood JR , Knowlton DR , Schiff GM.Human rotavirus studies in volunteers: determination of infectious dose and serological response to infection . Journal of Infectious Diseases1986; 154: 871-880 .
84.
Lanata CF , Black RE , del Aguila R , Gil A , Verastegui H , Gerna G , Flores J , Kapikian AZ , Andre FE.Protection of Peruvian children against rotavirus diarrhea of specific serotypes of one, two, or three doses of the RIT 4237 attenuated bovine rotavirus vaccine . Journal of Infectious Diseases1989; 159: 452-459 .
85.
Buyse M , Molenberghs G.Criteria for the validation of surrogate endpoints in randomized experiments . Biometrics1998; 54: 1014-1029 .
86.
Begg CB , Leung DHY.On the use of surrogate end points in randomized trials (pkg: P15-28) . Journal of the Royal Statistical Society, Series A, General2000; 163(1): 15-24 .
87.
Smit P , Oberholzer D , Hayden-Smith S , Koornhof HJ , Hilleman MR.Protective efficacy of pneumococcal polysaccharide vaccines . Journal of the American Medical Association1977; 238: 2613-2616 .
88.
Bruyn GRW , van Furth R.Pneumococcal polysaccharide vaccines: indications, efficacy and recommendations . European Journal of Clinical and Microbiological Infectious Diseases1991; 10: 897-910 .
89.
Gilbert PB , Self SG , Ashby MA.Statistical methods for assessing differential vaccine protection against human immunodeficiency virus types . Biometrics1998; 54: 799-814 .
90.
Masurel N , Laufer J.A one year study of trivalent influenza vaccines in primed and unprimed volunteers: immunogenicity, clinical reactions, and protection . Journal of Hygiene1984; 92: 263-275 .
91.
Longini IM , Koopman JS , Haber M , Cotsonis GA.Statistical inference for infectious diseases: risk-specific household and community transmission parameters . American Journal of Epidemiology1988; 128: 845-859 .
92.
Longini IM , Halloran ME , Nizam A , Wolff M , Mendelman PM , Fast PE , Belshe RB.Estimation of the efficacy of live, attenuated influenza vaccine from a two-year, multicenter vaccine trial: implications for influenza epidemic control . Vaccine2000; 18: 1902-1909 .
93.
Prentice RL , Kalbeisch JD , Peterson AV , Flournoy N , Farewell VT , Breslow NB.The analysis of failure times in the presence of competing risks . Biometrics1978; 34: 541-554 .
94.
Gross PA , Hermogenes AW , Sack HS , Lau J , Levandowski RA.The efficacy of influenza vaccine in elderly persons. A meta-analysis and review of the literature . Annals of Internal Medicine1995; 123: 518-527 .
95.
Sugaya N , Nerome K , Ishida M , Matsumoto M , Mitamura K , Nirasawa M.Efficacy of inactivated vaccine in preventing antigenicallydrifted influenza type Aand well-matched type B . Journal of the American Medical Association1994; 272: 1122-1126 .
96.
Clemens JD , Sack DA , Harris JR , Van Loon F , Chakraborty J , Ahmed F , Rao MR , Khan MR , Yunus MD , Huda N , Stanton BF , Kay BA , Walter S , Eeckels R , Svennerholm AM , Holmgren J.Field trial of oral cholera vaccines in Bangladesh: results from three-year follow-up . Lancet1990; 335: 270-273 .
97.
Kapikian AZ , Hoshino Y , Chanock RM , Perez-Schael I.Efficacy of quadrivalent rhesus rotavirus-based human rotavirus vaccine aimed at preventing severe rotavirus diarrhea in infants and young children . Journal of Infectious Diseases1996; 174(Suppl 1): S65-S72 .
98.
Andreasen V , Lin J , Levin SA.The dynamics of cocirculating influenza strains conferring partial cross-immunity . Journal of Mathematical Biology1997; 35: 825-842 .
99.
Clemens JD , van Loon F , Sack DA , Rao MR , Ahmed F , Chakraborty J , Kay BA , Khan MR , Yunus MD , Harris JR , Svennerholm AM , Holmgren J.Biotype as determinant of natural immunising effect of cholera . Lancet1991; 337: 883-884 .
100.
Travers K , Mboup S , Marlink R , Gueye-Nidaye A , Siby T , Thior I , Traore I , Dieng-Sarr A , Sankale JL , Mullins C , Ndoye I , Hsieh C-C , Essex M , Kanki P.Natural protection against HIV-1 infection provided by HIV-2 . Science1995; 268: 1612-1615 .
101.
Gilbert PB.Comparison of competing risks failure time methods and time-independent methods for assessing strain variations in vaccine protection . Statistics in Medicine2000; 19(22): 3065-3086 .
102.
UNAIDS Report from a meeting of the WHO-UNAIDS Vaccine Advisory Committee Geneva , 21-23 February 2000. Approaches to the development of broadly protective HIV vaccines: challenges posed by genetic, biological and antigenic variability of HIV-1 . AIDS2001; 15: W1-W25 .
103.
Lukashov VV , Goudsmit J , Paxton WA.The genetic diversity of HIV-1 and its implications for vaccine development. In: Wong-Staal F , Gallo RC , eds. AIDS vaccine research. New York: Marcel Dekker , 2002, pp 93-120.
104.
van Loon F.Cholera: developments in prevention and cure . Tropical and Geographical Medicine1993; 45: 269-273 .
105.
Hogan CM , Hammer SM.Host determinants in HIV infection and disease Part II: genetic factors and implications for antiretroviral therapeutics . Annals of Internal Medicine2001; 134: 978-996 .
106.
Gilbert P , Self S , Rao M , Naficy A , Clemens J.Sieve analysis: methods for assessing how vaccine efficacy depends on genotypic and phenotypic pathogen variation from vaccine trial data . Journal of Clinical Epidemiology2001; 54: 68-85 .
107.
Anderson RM , Garnett GP.Low-efficacy HIV vaccines: potential for community-based intervention programmes . Lancet1996; 348: 1010-1013 .
108.
Anderson RM , Swinton J , Garnett GP.Potential impact of low-efficacy HIV-1 vaccines in populations with high rates of infection . Proceedings of the Royal Society of London B1995; 261: 1010-1013 .
109.
Mossong J , O’Callaghan CJ , Rantnam S.Modelling antibody response to measles vaccine and subsequent waning of immunity in a low exposure population . Vaccine2001; 19: 523-529 .
110.
PHLS Whooping-Cough Committee and Working Party . Efficacy of whooping-cough vaccines used in the United Kingdom before 1968 . British Medical Journal1973; 1: 259-263 .
111.
World Health Organization . Recommended composition of influenza virus vaccines for use in the 2003-2004 influenza season . Weekly Epidemiological Record2003; 78: 57-64 .
112.
Durham LK , Longini IM , Halloran ME , Clemens JD , Nizam A , Rao M.Estimation of vaccine efficacy in the presence of waning: application to cholera vaccines . American Journal of Epidemiology1998; 147: 948-959 .
113.
Durham LK , Halloran ME , Longini IM , Manatunga AK.Comparison of two smoothing methods for exploring waning vaccine effects . Applied Statistics1999; 48: 395-407 .
114.
Gilbert PB , Wei LJ , Kosorok MR , Clemens JD.Simultaneous inference on the contrast of two hazard functions with censored observations . Biometrics2002; 58: 773-780 .
115.
Dorrell L , Dong T , Ogg SG , Lister S , McAdam S , Rostron T , Conlon C , McMichael AJ , Rowland-Jones SL.Distinct recognition of non-clade B human immunodeficiency virus type 1 epitopes by cytotoxic T lymphocytes generated from donors infected in Africa . Journal of Virology1999; 73: 1708-1714 .
116.
Halloran ME , Haber M , Longini IM.Interpretation and estimation of vaccine efficacy under heterogeneity . American Journal of Epidemiology1992; 136: 328-343 .
117.
Anderson RM , May RM.Infectious diseases in humans: dynamics and control. Oxford: Oxford University Press , 1991.
118.
Longini IM , Sagatelian K , Rida WN , Halloran ME.Optimal vaccine trial design when estimating vaccine efficacy for susceptibility and infectiousness from multiple populations (corr: 1999 v18 p890) . Statistics in Medicine1998; 17: 1121-1136 .
119.
Hayes RJ , Alexander NDE , Bennett S , Cousens SN.Design and analysis issues in cluster-randomized trials of interventions against infectious diseases . Statistical Methods in Medical Research2000; 9(2): 95-116 .
120.
Longini IM , Hudgens MG , Halloran ME.Estimation of vaccine efficacy for both susceptibility to infection and reduction in infectiousness for prophylactic HIV vaccines with partner augmentation. In: Kaplan E , Brookmeyer R , eds. The quantitative evaluation of HIV prevention programs. New Haven: Yale University Press , 2002, pp 241-259.
121.
Trach DD , Clemens JD , Ke NT , Thuy HT , Son ND , Canh DG , Hang PVD , Rao MR.Field trial of a locally produced, killed, oral cholera vaccine in Vietnam . Lancet1997; 349: 231-235 .
122.
Bjune G , Hoiby EA , Gronnesby JK , Arnesen O , Holst-Fredriksen J , Halstensen A , Holten E , Lindbak A , Nokleby H , Rosenqvist E , Solberg LK , Closs O , Eng J , Froholm LO , Lystad A , Bakketeig LS , Hareide B.Effect of outer membrane vesicle vaccine against group B meningococcal disease in Norway . Lancet1991; 338: 1093-1096 .
123.
Jaffar S , Leach A , Hall AJ , Obaro S , McAdam KPWJ , Smith PG , Greenwood BM.Preparation for a pneumococcal vaccine trial in The Gambia: individual or community randomization . Vaccine1999; 18: 633-640 .
124.
Pollock TM.Trials of prophylactic agents for the control of communicable diseases . World Health Organization Monograph Series1966; 52: 1-92 .
125.
Moulton LH , O’Brien KL , Kohberger R , Chang I , Reid R , Weatherholtz R , Hackell JG , Siber GR , Santosham M.Design of a group-randomized Streptococcus pneumoniae vaccine trial . Controlled Clinical Trials2001; 22: 438-452 .
126.
Longini IM , Halloran ME , Nizam A.Model-based estimation of vaccine effects from community vaccine trials . Statistics in Medicine2002; 21(4): 481-495 .
127.
Halloran ME , Struchiner CJ.Study designs for dependent happenings . Epidemiology1991; 2: 331-338 .
128.
Halloran ME , Struchiner CJ.Causal inference in infectious diseases . Epidemiology1995; 6: 142-151 .
129.
Halloran ME , Struchiner CJ , Longini IM.Study designs for evaluating different efficacy and effectiveness aspects of vaccines . American Journal of Epidemiology1997; 146: 789-803 .
130.
Halloran ME.Vaccine studies. In: Armitage P , Colton T , eds. Encyclopedia of biostatistics. New York: Wiley , 1998, pp 4687-4694.
131.
Halloran ME , Longini IM , Cowart DM , Nizam A.Community interventions and the epidemic prevention potential . Vaccine2002; 20: 3254-3262 .
132.
Lagos R , Horwitz I , Toro J , Martin OS , Abrego P , Bustamante C , Wasserman SS , Levine OS , Levine MM.Large scale, postlicensure, selective vaccination of Chilean infants with PRP-T conjugate vaccine: practicality and effectiveness in preventing invasive Haemophilus influenzae type b infections . Pediatric Infectious Diseases1996; 15: 216-222 .
133.
Koenig MA , Khan MA , Wojtyniak B , Clemens JD , Chakraborty J , Fauveau V , Phillips JF , Akbar J , Barua US.Impact of measles vaccination on childhood mortality in rural Bangladesh . Bulletin of the World Health Organization1990; 68: 441-447 .
134.
Orenstein WA , Berner RH , Hinman AR.Assessing vaccine efficacy in the field . Epidemiologic Reviews1988; 10: 212-241 .
135.
Potema AS , Myers MG , Breiman RF.Challenges in the development, licensure, and use of combination vaccines . Clinical Infectious Diseases2001; 33: S261-S266 .