Evidence-informed policy and practice call on research addressing a broad range of research questions: evaluating the need for, and development, implementation, acceptability and effectiveness of interventions. Synthesizing this evidence requires methods that integrate the findings from diverse study designs. This article reports the development of a new model of research synthesis for this purpose. On completion of a series of substantive reviews, methodological reflections addressed: the interrelationship between review questions, relevant theory and values within the review process; methodological similarities and differences with more conventional reviews of effectiveness; the added value in terms of conclusions and specific recommendations; and the relevance to public policy.
Booth, A. (2001) ‘Cochrane or Cock-eyed? How Should We Conduct Systematic Reviews of Qualitative Research?’ Presentation at ‘Qualitative Evidence-based Practice Conference’, Coventry University, 14-16 May [www.leeds.ac.uk/educol/documents/00001724.doc]
2.
Boruch, R. F. (1997) Randomised Experiments for Planning and Evaluation. Thousand Oaks, CA: SAGE .
3.
Campbell, D. T. and J. Stanley (1966) Experimental and Quasi-Experimental Designs for Research. Boston, MA: Houghton Mifflin Co .
4.
Cooper, H. and L. Hedges (1994) The Handbook of Research Synthesis. New York: Russell Sage Foundation .
5.
Department of Health (2000) National Service Framework for Coronary Heart Disease: Modern Standards and Service Models. London: DoH .
6.
Dixon-Woods, M. , R. Fitzpatrick and K. Roberts (2001) ‘Including Qualitative Research in Systematic Reviews: Opportunities and Problems’ , Journal of Evaluation and Clinical Practice7(2): 125-133 .
7.
Dixon-Woods, M. , R. L. Shaw , S. Agarwal and J. A. Smith (2004) ‘The Problem of Appraising Qualitative Research’ , Quality and Safety in Health Care13: 223-225 .
8.
Egger, M. and G. Davey-Smith (1995) ‘Misleading Meta-Analysis’ , British Medical Journal310: 752-754 .
9.
Egger, M. , G. Davey-Smith and D. Altman , eds (2001) Systematic Reviews in Health Care: Meta-Analysis in Context. London: BMJ Publishing .
10.
Green, L. and M. Kreuter (1991) Health Promotion Planning: An Educational and Environmental Approach. Mountain View, CA: Mayfield Publishing Co .
11.
Greenhalgh, T. , P. Toon , J. Russell , G. Wong , L. Plumb and F. Macfarlane (2003) ‘Transferability of Principles of Evidence Based Medicine to Improve Educational Quality: Systematic Review and Case Study of an Online Course in Primary Health Care’ , British Medical Journal326: 142-145 .
12.
Haines, A. and A. Donald , eds (1998) Getting Research Findings into Practice. London: BMJ Publishing .
13.
Harden, A. , G. Peersman , S. Oliver , M. Mauthner and A. Oakley (1999) ‘A Systematic Review of the Effectiveness of Health Promotion Interventions in the Workplace’ , Occupational Medicine49: 1-9 .
14.
Harden, A. , A. Oakley and S. Oliver (2001a) ‘Peer-Delivered Health Promotion for Young People: A Systematic Review of Different Study Designs’ , Health Education Journal60: 339-353 .
15.
Harden, A. , R. Rees , J. Shepherd , G. Brunton , S. Oliver and A. Oakley (2001b) Young People and Mental Health: A Systematic Review of Barriers and Facilitators. London: EPPI-Centre, Social Science Research Unit .
16.
Harden, A. , J. Garcia , S. Oliver , R. Rees , J. Shepherd , G. Brunton and A. Oakley (2004) ‘Applying Systematic Review Methods to Studies of People’s Views: An Example from Public Health Research’ , Journal of Epidemiology and Community Health58: 795-800 .
17.
Hawe, P. , D. Degeling and J. Hall (1990) Evaluating Health Promotion. Sydney: MacLennan & Petty .
18.
Jensen, L. A. and M. N. Allen (1996) ‘Meta-synthesis of Qualitative Findings’ , Qualitative Health Research6: 553-560 .
19.
Juni, P. , D. Altman and M. Egger (2001) ‘Assessing the Quality of Controlled Clinical Trials’ , British Medical Journal323: 42-46 .
20.
Kleijnen, J. , P. Gotzsche , R. Kunz , A. Oxman and I. Chalmers (1997) ‘So What’s So Special about Randomisation?’, in A. Maynard and I. Chalmers (eds) Non-Random Reflections on Health Services Research, pp. 93-106. London: BMJ Publishing Group .
21.
McDonald, G. (1997) ‘Social Work: Beyond Control?’, in A. Maynard and I. Chalmers (eds) Non-Random Reflections on Health Services Research, pp. 122-146. London: BMJ Publishing Group .
22.
Macintyre, S. (2001) ‘Good Intentions and Received Wisdom are Not Enough’ , Presentation at ‘Evidence into Practice: Challenges and Opportunities for UK Public Health’, The Royal College of Physicians, London, April.
23.
Mayall, B. (2002) Toward a Sociology for Childhood: Thinking from Children’s Lives. Buckingham: Open University Press .
24.
Moon, A. M. , M. A. Mullee , L. Rogers , R. L. Thompson , V. Speller and P. Roderick (1999a) ‘Helping Schools to Become Healthy Environments: An Evaluation of the Wessex Healthy Schools Award’ , Health Promotion International14(2): 111-112 .
25.
Moon, A. M. , M. A. Mullee , R. L. Thompson , V. Speller and P. Roderick (1999b) ‘Health Related Research and Evaluation in Schools’ , Health Education99(1): 27-34 .
26.
Moore, H. and L. Kindness (1998) ‘Establishing a Research Agenda for the Health and Well Being of Children and Young People in the Context of Health Promotion’, in Promoting the Health of Children and Young People: Setting a Research Agenda, pp. 1-17. London: Health Education Authority .
27.
Mulrow, C. D. and D. Cook (1998) Systematic Reviews: Synthesis of Best Evidence for Health Care Decisions. Philadelphia, PA: American College of Physicians .
28.
Noblit, G. W. and R. D. Hare (1988) Meta-ethnography: Synthesizing Qualitative Studies, Beverley Hills, CA: Sage .
29.
Oakley, A. (2000) Experiment in Knowing: Gender and Methods in the Social Sciences. Cambridge: Polity Press .
30.
Oakley, A. , D. Fullerton , J. Holland , S. Arnold , M. France-Dawson , P. Kelley and S. McGrellis (1995) ‘Sexual Health Education Interventions for Young People: A Methodological Review’ , British Medical Journal310: 158-162 .
31.
Oakley, A. , S. Oliver , G. Peersman and M. Mauthner (1996) Review of Effectiveness of Health Promotion Interventions for Men who have Sex with Men. London: EPPI-Centre, Social Science Research Unit
32.
Oliver, S. (2001) ‘Making Research More Useful: Integrating Different Perspectives and Different Methods’, in S. Oliver and G. Peersman (eds) Using Research for Effective Health Promotion, pp. 167-179. Buckingham: Open University Press .
33.
Oliver, S. and G. Peersman , eds (2001) Using Research for Effective Health Promotion. Buckingham: Open University Press .
34.
Oliver, S. , L. Oakley , J. Lumley and E. Waters (2001) ‘Smoking Cessation Programmes in Pregnancy: Systematically Addressing Development, Implementation, Women’s Concerns and Effectiveness’ , Health Education Journal60: 362-370 .
35.
Pawson, R. (2002) ‘Evidence-Based Policy: The Promise of Realist Synthesis’ , Evaluation8: 340-358 .
36.
Pawson, R. and N. Tilley (1997) Realistic Evaluation. Thousand Oaks, CA: SAGE .
37.
Peersman, G. , A. Oakley , S. Oliver and J. Thomas (1996) Review of Effectiveness of Sexual Health Promotions Intervention for Young People (Updated). London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London .
38.
Peersman, G. , S. Oliver and A. Oakley (1997) EPPI-Centre Review Guidelines: Data Collections for the EPIC Database. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London .
39.
Peersman, G. , A. Harden and S. Oliver (1998) Effectiveness of Health Promotion Intervention in the Workplace: A Review. London: Health Education Authority .
40.
Peersman, G. , S. Oliver and A. Oakley (2001) ‘Systematic Reviews of Effectiveness’, in S. Oliver and G. Peersman (eds) Using Research for Effective Health Promotion, pp. 96-108. Buckingham: Open University Press .
41.
Perry, C. L. , C. I. Klepp , A. Halper , B. Dubovitz , D. Golden , G. Griffin and M. Smyth (1987) ‘Promoting Healthy Eating and Physical Activity Patterns amongst Adolescents: A Pilot Study of “Slice of Life”’ , Health Education Research2(2): 93-103 .
42.
Popay, J. , A. Rogers and G. Williams (1998) ‘Rationale and Standards for the Systematic Review of Qualitative Literature in Health Services Research’ , Qualitative Health Research8: 341-351 .
43.
Rees, R. , A. Harden , J. Shepherd , G. Brunton , S. Oliver and A. Oakley (2001) Young People and Physical Activity: A Systematic Review of Barriers and Facilitators. London: EPPI-Centre, Social Science Research Unit .
44.
Roberts, K. A. , M. Dixon-Woods , R. Fitzpatrick , K. R. Abrams and D. R. Jones (2002) ‘Factors Affecting Uptake of Childhood Immunisation: A Bayesian Synthesis of Qualitative and Quantitative Evidence’ , Lancet360: 1596-1599 .
45.
Schreiber, R. , D. Crooks and P. N. Stein (1997) ‘Qualitative Meta-analysis’, in J. M. Morse (ed.) Completing a Qualitative Project: Details and Dialogue, Thousand Oaks, CA: Sage , pp. 311-326.
46.
Shadish, W. R. and R. B. Sweeney (1991) ‘Mediators and Moderators in Meta-analysis’ , Journal of Consulting and Clinical Psychology59: 883-893 .
47.
Shepherd, J. , A. Harden , R. Rees , G. Brunton , S. Oliver and A. Oakley (2001) Young People and Healthy Eating: A Systematic Review of Barriers and Facilitators. London: EPPI-Centre, Social Science Research Unit .
48.
Shepherd, J. , J. Garcia , S. Oliver , A. Harden , R. Rees , G. Brunton and A. Oakley (2002) Barriers and Facilitators to the Health of Young People: A Systematic Review of Evidence on Young People’s Views and on Interventions in Mental Health, Physical Activity and Healthy Eating. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London .
49.
Shucksmith, J. and L. Hendry (1998) Health Issues and Adolescents: Growing up and Speaking out. London: Routledge .
50.
Thomas, J. , A. Harden , A. Oakley , S. Oliver , K. Sutcliffe , R. Rees , G. Brunton and J. Kavanagh (2004) ‘Integrating Qualitative Research with Trials in Systematic Reviews: An Example from Public Health’ , British Medical Journal328: 1010-1012 .
51.
Tones, K. and S. Tilford (1994) Health Education: Effectiveness, Efficiency and Equity, London: Chapman & Hall .
52.
Walter, H. J. (1989) ‘Primary Prevention of Chronic Disease among Children: The School Based “Know your Body” Intervention Trials’ , Health Education Quarterly16: 201-214 .
53.
White, D. (2001) ‘Evaluating Evidence and Making Judgements of Study Quality: Loss of Evidence and Risks to Policy and Practice Decisions’ , Critical Public Health11: 3-17 .
