The research reported in this paper aimed to determine how different search strate gies for identifying primary studies, and different inclusion criteria linked to study design, may alter the recommendations of reviews about health promotion inter ventions to change cholesterol levels. Varying search strategies have an effect on the overall number of studies that can be included and on the relative numbers of different study designs. Differences in inclusion criteria result in reviews similar in focus being different in their recommendations. Thus, methodological differences between effectiveness reviews are of substantive concern; the way a review is done affects its 'findings'. (This paper is the second in a series of three. The first was published in the previous issue of the HEJ.)
Deeks J., Glanville J., Sheldon T.Undertaking Systematic Reviews of Research on Effectiveness. CRD Guidelines for those Carrying out or Commissioning Reviews. York: University of York NHS Centre for Reviews and Dissemination, CRD Report 4, 1996.
2.
Dickersin K., Berlin JAMeta-analysis: State-of-the-Science. Epidemiological Reviews1992: 14: 154-76.
3.
Mulrow CD, Oxman AD (eds). Cochrane Collaboration Handbook [updated September 1997]. In: The Cochrane Library [database on disk and CD-ROM]. The Cochrane Collaboration. Oxford: Update Software , Issue 4, 1997.
4.
Peersman G., Harden A., Oliver S., Oakley A.Effectiveness Reviews in Health Promotion. London: EPI-Centre, Social Science Research Unit, 1998.
5.
Oliver S., Peersman G.Harden A.Oakley A.Discrepancies in findings from effectiveness reviews: the case of health promotion for older people. Health Education Journal1999: 58: 77-88.
6.
Begg CB, Berlin JAPublication bias: a problem in interpreting medical data. Journal of the Royal Statistical Society1998: 151: 419-63.
7.
Cooper H., Ribble RGInfluence on the outcome of literature searches for integrative research reviews . Knowledge1989: 10: 179-201.
8.
Hedges LVModelling publication selection effects in meta-analysis. Statistics in Science1992: 7: 246-55.
9.
Eiser JR, Eiser C.Effectiveness of Video for Health Education. London: Health Education Authority, 1996.
10.
Ebrahim S., Davey Smith G.Health Promotion in Older People for the Prevention of Coronary Heart Disease and Stroke. London: Health Education Authority, 1996.
11.
Dickersin K.Scherer R., Lefebvre C.Identifying relevant studies for systematic reviews. British Medical Journal1994: 309: 1286-92.
12.
Peersman G.Oliver S., Oakley A.EPI-Centre Review Guidelines. Data Collection for the EPIC Database. London: EPI-Centre, Social Science Research Unit. 1997.
13.
France-Dawson M., Holland J.Fullerton D., Kelley P., Arnold S., Oakley A.Review of the Effectioeness of Workplace Health Promotion Interventions. London: Social Science Research Unit, 1994.
14.
Holland J., Arnold S., Fullerton D., Oakley A., Hart G.Review of Effectiveness of Health Promotion Interventions for Men who have Sex with Men. London: Social Science Research Unit, 1994.
15.
Oakley A., Fullerton D.Risk. Knowledge and Behaviour: HIV/AIDS Education Programmes and Young People . London: Social Science Research Unit, 1994.
16.
Oakley A., Fullerton D.Young People and Smoking: a Report for North Thames Regional Health Authority . London: Social Science Research Unit, 1995.
17.
Oakley A., Fullerton D., Holland J., et al. Reviews of Effectiveness: Sexual Health Interventions for Young People. London: Social Science Research Unit, 1994.
18.
Oakley A., Fullerton D., Holland J., et al. Reviews of Effectiveness: HIV Prevention and Sexual Health Education Interventions. London: Social Science Research Unit, 1994.
19.
Oakley A., France-Dawson M., Fullerton D., et al. Review of Effectiveness of Health Promotion Interventions to Prevent Accidents in Older People. London: Social Science Research Unit, 1995.
20.
Oakley A., Fullerton D., Holland J.Behavioural interventions for HIV/AIDS prevention. AIDS1995: 9: 449-86.
21.
Oakley A., Fullerton D., Holland J., et al. Sexual health education interventions for young people: a methodological review. British Medical Journal1995: 310: 158-62.
22.
Oakley A., France-Dawson M., Holland J., et al. Preventing falls and subsequent injury in older people. NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Effective Health Care1996: 2: 1-16.
23.
Oakley A., Oliver S., Peersman G., Mauthner M.Review of Effectiveness of Hoalth Promotion Interventions for Men who have Sex with Men. London: EPI-Centre, Social Science Research Unit, 1996.
24.
Peersman G., Oakley A., Oliver S., Thomas J.Review of Effectiveness of Sexual Health Promotion Interventions for Young People. London: EPI-Centre, Social Science Research Unit, 1996.
25.
Peersman GV, Levy JAFocus and effectiveness of HIV-prevention efforts for young people. AIDS1998: 12(suppl A): S191-6.
26.
Peersman G., Harden A., Oliver S.Effectiveness of Health Promotion Interventions in the Workplace: a Review . London: Health Education Authority , 1998.
27.
Chalmers I, Sackett D, Silagy C.The Cochrane Collaboration. In: Maynard A.Chalmers I (eds), Non-Random Reflections on Health Services Research. London: British Medical Journal Publishing, 1997.
28.
Schnaps E., De Bartolo R., Moskowitz J., Pally CS, Churgin S.A review of 127 drug abuse prevention program evaluations. Journal of Drug Issues1981: 11: 17-43.
29.
Biglan A., Severson H., Ary A., et al. Do smoking prevention programs really work? Attrition and the internal and external validity of an evaluation of a refusal skills program. Journal of Behavioral Medicine1987: 10: 159-71.
30.
Loevinsohn BPHealth education interventions in developing countries: a methodological review of published articles. International Journal of Epidemiology1990: 4: 788-94.
31.
MacDonald G. , Sheldon B.Gillespie J. Contemporary studies of the effectiveness of social work. British Journal of Social Work1992: 22: 615-43.
32.
Chalmers I. , Haynes B.Reporting, updating and correcting systematic reviews of effects of health care. British Medical Journal1994: 309: 862-5.
33.
Knipschild P.Some examples. British Medical Journal1994: 309: 719-721.
34.
Mulrow CDRationale for systematic reviews. British Medical Journal1994: 309: 597-9.
35.
Crouch M., Sallis JF, Farquhar JW, Haskell WL, Ellsworth NM, King ABPersonal and mediated health counseling for sustained dietary reduction of hypercholesterolemia. Preventive Medicine1986: 15: 282-91.
36.
Francisco VT , Paine AL, Fawcett SB, Johnston J., Banks D.An experimental evaluation of an incentive program to reduce serum cholesterol levels among health fair participants . Archives of Family Medicine1994: 3: 246-51.
37.
Hanlon P., McEwen J., Carey L., Gilmour H., Tannahill C.Health checks and coronary risk: further evidence from a randomised controlled trial. British Medical Journal1995: 311: 1609-13.
38.
Ostwald SKChanging employees' dietary and exercise practices: an experimental study in a small company. Journal of Occupational Medicine1989: 31: 90-97.
39.
Rastam L., Frick JONurses counseling for hypercholesterolemia: efficient strategy in middle-aged men. Cardiovascular Risk Factors1996: 6: 36-41.
40.
Shi L.The impact of increasing intensity of health promotion intervention on risk reduction. Evaluation and the Health Professions1992: 15: 3-25.
41.
World Health Organization European Collaborative Group.European collaborative Trial of Multifactorial Prevention of Coronary Heart Disease: Final Report on the 6-year Results. Lancet1986: April: 869-72.
42.
Blanke K., Stanek K., Stacy RDComparison of the success of nutrition education to lower dietary cholesterol and fat with and without spouse support for individuals with elevated blood cholesterol. Health Values1990: 14: 33-7.
43.
Gemson DH, Sloan RP, Messeri P.Goldbera IJA public health model for cardiovascular risk reduction. Archives of International Medicine1990: 150: 985-9.
44.
Glasgow RE, Terborg JR, Hollis JF, Severson H., Fisher KJ, Boles SMModifying dietary and tobacco use patterns in the worksite: the Take Heart Project. Health Education Quarterly1994: 21: 69-82.
45.
Glasgow RE, Terborg JR, Strycker LA, Boles SM, Hollis JFTake Heart II: replication of a worksite health promotion trial. Journal of Behavioral Medicine1997: 20: 143-61.
46.
Puska P., Niemensivu H., Puhakka P., et al. Results of a one-year worksite and mass media based intervention on health behaviour and chronic disease risk factors. Scandinavian Journal of Social Medicine1988: 16: 241-50.
47.
Briley ME, Montgomery DH, Blewett J.Worksite nutrition education can lower total cholesterol levels and promote weight loss among police department employees. Journal of the American Dietetic Association1992: 92: 1382-4.
48.
Goetzel RZ, Kahr TY, Aldana SG, Kenny GMAn evaluation on Duke University's Live for Life health promotion program and its impact on employee health. American Journal of Health Promotion1996: 10: 340-41.
49.
Barnard RJ, Anthony DFEffect on health maintenance programs on Los Angeles City firefighters. Journal of Occupational Medicine1989: 22: 667-9.
50.
Elton PJ, Ryman A., Hammer M., Page F.Randomised controlled trial in northern England of the effect of a person knowing their own serum cholesterol concentration. Journal of Epidemiology and Community Health1994: 48: 22-5.
51.
Fielding JE, Mason T., Knight K., Klesges P., Pelletier KRA randomized trial of the IMPACT worksite cholesterol reduction program. American Journal of Preventive Medicine1995: 11: 120-23.
52.
Peersman G., White M.Key issues in conducting reviews of effectiveness of health promotion interventions . In: Meyrick J (ed), Reviews of Effectiveness: their Contribution to Evidence-Based Practice & Purchasing in Health Promotion. Workshop Proceedings. London: Health Education Authority, 1997.
53.
Pawson R., Tilley N.Realistic Evaluation. Thousand Oaks, California: Sage, 1997.
54.
Speller V., Learmonth A., Harrison D.The search for evidence of effective health promotion. British Medical Journal1997: 315: 361-3.
55.
Ziglio E.How to Move Towards Evidence-Based Health Promotion Interventions. Paper presented at the 3rd European Conference on Effectiveness , Turin, Italy, 1996.
56.
Chalmers I. , Enkin M., Keirse M.Preparing and updating systematic reviews of randomized controlled trials of health care. The Milbank Quarterly1993: 71: 411-33.
57.
Dickersin K. , Min YINIH clinical trials and publication bias. Online Journal of Current Clinical Trials [serial online] 1993: Doc No. 50.
58.
Dickersin K. , Chan S., Chalmers TC, Sacks HS, Smith H., Jr. Publication bias and clinical trials . Controlled Clinical Trials1987: 8: 343-53.
59.
Simes RJPublication bias: the case for an international registry of clinical trials . Journal of Clinical Oncology1986: 4: 1529-41.
