The aim of this paper is to develop an evaluation framework which will offer some guidance in evaluating health-related policies at the city level. The emphasis of the framework lies on the evaluation of the processes and conditions under which health-related policies are formulated, implemented, facilitated or restrained. Several key issues that underpin the proposed evaluation framework are discussed, such as the politics associated with the evaluation process, the use of indicators, participation of city inhabitants, validity issues and the skills evaluators should have. It is argued that the evaluation process itself is an important element in the formulation and the implementation of these policies and that the particular nature of health- related urban policy demands an open, negotiated and process-orientated approach.
Get full access to this article
View all access options for this article.
References
1.
Barnekov, T., D. Hart and W. Benfer (1990) US Experience in Evaluating Urban RegenerationLondon: HMSO.
2.
Barrett, S. and C. Fudge , eds (1981) 'Examining the Policy-Action Relationship' , in Policy and Action, 3-32. London: Methuen.
3.
Baum, F. (1992) 'Research for Healthy Cities: Some Experiences from Down-under', in E. de Leeuw, M. O'Neill, M. Goumans and F. de Bruijn (eds) Healthy Cities Research Agenda. Proceedings of an Expert Panel. RHC Monograph Series No. 2. Maastricht.
4.
Beattie, A. (1991) 'The Evaluation of Community Development Initiatives in Health Promotion: a Review of Current Strategies', in Roots and Branches, papers from the OU/HEA 1990 Winter School on Community Development and Health . Milton Keynes: The Open University .
5.
Blackman, T. (1995) Urban Policy in Practice. London : Routledge.
6.
Chen, H.T. (1988) 'Validity in Evaluation Research: a Critical Assessment of Current Issues', Policy and Politics16(1): 1-16.
7.
Chen, H.T. (1990) Theory-driven Evaluations. Newbury Park, CA: Sage.
8.
Considme, M. (1994) Public Policy, a Critical Approach. Melbourne: Macmillan.
9.
Denzin, N. K. and Y. S. Lincoln , eds (1994) Handbook of Qualitative Research . London: Sage.
10.
Doh (1995) Policy Appraisal and Health: A Guide from the Department of Health. London: UK Department of Health.
11.
Downie, R.S., C. Fyfe and A. Tannahill (1990) Health Promotion, Models and Values, pp. 65-82. Oxford : Oxford University Press.
12.
Fetterman, D.M., S.J. Kaftanan and Wandersman, eds (1996) Empowerment Evaluation, Knowledge and Tools for Self Assessment and AccountabilityLondon: Sage.
13.
Flynn, R. (1993) 'Restructuring Health Systems: a Comparative Analysis of England and the Netherlands', in M. Hill (ed.) New Agendas in the Study of the Policy Process. London: Harvester Wheatsheaf.
14.
Fuerstein, M.T. (1986) Partners in Evaluation. New York: Macmillan.
15.
Gill, M. and M. Thrasher (1985) 'Problems in Administering Community Policing: Some Lessons from Implementation Analysis', Policy and Politics13(1): 37-52.
16.
Goumans, M. (1995) 'Putting Concepts into Health Policy', in N. Bruce, J. Springett, J. Hodgkiss and A. Scott Samuel (eds) Research and Change in Urban Community Health. Aldershot: Avebury.
17.
Goumans, M. and J. Springett (forthcoming) When Projects Become Policies: the Experience of Healthy Cities in the UK and the Netherlands.
18.
Greene, J.C. (1994) 'Qualitative Program Evaluation, Practice and Promise' , in N. K. Denzin and Y. S. Lincoln (eds) Handbook of Qualitative Research. London: Sage.
19.
Guba, E.G. and Y.S. Lincoln (1989) Fourth Generation Evaluation. London: Sage.
20.
Gustavsen, B. (1992) Dialogue and Development. Assen : Van Gorcum.
21.
Ham, C. ( 1991) 'Analysis of Health Policy; Principles and Practice', Scandinavian Journal of Social Medicine Supplement No 46: 62-6.
22.
Hancock, T. (1993) 'The Healthy City from Concept to Application. Implications for Research', in J. K. Davies and M. P. Kelly (eds) Healthy Cities, Research and Practice. London: Routledge.
23.
Hart, D. (1992) 'US Urban Policy Evaluation in the 1980s: Lessons from Practice', Regional Studies25(3): 255-65.
24.
Hoggart, R., S. Jeffries and L. Harrison (1994) 'Reflexivity and Uncertainty in the Research Process' , Policy and Politics22(1): 59-70.
25.
Hupe, P.L. (1990) 'Implementing a Meta-policy: The Case of Decentralization in the Netherlands', Policy and Politics18(3): 181-91.
26.
Knox, C. and D. McAlister (1994) 'Evaluation: Incorporating User Views', Public Administration73: 413-15.
27.
Kolb, D.A. (1984) Experiential Learning: Experience as a Source of Learning and Development. Englewood Cliffs, NJ:Prentice Hall.
28.
Leeuw, E. de (1989) Health Policy; an Exploratory Inquiry into the Development of Policy for the New Public Health in the Netherlands. Maastricht: Savannah.
29.
Leeuw, E. de (1993) 'Epiloog: Wat is goed Gezonde Steden-onderzoek ?', in J. Ten Dam and E. de Leeuw (eds) Gezonde Steden en onderzoek: reikwijdte, methoden, toepassingen. Assen/ Maastncht: Van Gorcum.
30.
Long, R.J. and W.E. Wilkinson (1984) 'A Theoretical Framework for Occupational Health Program Evaluation', Occupational Health Nursing, May, pp. 257-9.
31.
Mathison, S. (1994) 'Rethinking the Evaluator Role: Partnerships Between Organizations and Evaluators', Evaluation and Planning17(3): 299-304.
32.
Means, R. and R. Smith (1988) 'Implementing a Pluralistic Approach to Evaluation in Health Education', Policy and Politics16(1): 17-28.
33.
Milio, N. (1988) 'Making Healthy Public Policy; Developing The Science by Learning the Art: an Ecological Framework for Policy Studies', Health Promotion: an International Journal2(3): 263-74.
34.
Minogue, M. (1983) 'Theory and Practice in Public Policy and Administration' , Policy and Politics11(2): 63-85.
35.
O'Neill, M. and A.P. Pederson (1992) 'Building a Methods Bridge Between Public Policy Analysis and Healthy Public Policy', Canadian Journal of Public Health Supplement183: S25-30.
36.
O'Neill, M. (1993) 'Building Bndges between Knowledge and Action: the Canadian Process of Healthy Communities Indicators', in J. K. Davies and M. P. Kelly (eds) Healthy Cities, Research and Practice. London: Routledge.
37.
O'Toole, L.J. (1986) 'Policy Recommendations for Multi-actor Implementation: an Assessment of the Field', Journal of Public Policy6(2): 181-210.
38.
Patton, M.Q. (1982) Practical Evaluation. London : Sage.
39.
Pederson, A.P., R.K. Edwards, M. Kelner, K.R. Allison and V.W. Marshall (1988) Coordinating Healthy Public Policy: An Analytic Literature Review and Annotated Bibliography, working paper. Ottawa: Minister of Supply and Services; Health Services and Promotion Branch.
40.
Pirie, P.L. (1990) 'Evaluation', in N. Bracht (ed.) Health Promotion at the Community Level . London: Sage.
41.
Quellet, F., D. Durand and G. Forget (1994) 'Preliminary Results of an Evaluation of Three Healthy Cities Initiatives in the Montreal Area', Health Promotion International9(3):153-9.
42.
Reason, P. (1994) 'Three Approaches to Participative Inquiry', in N. K. Denzin and Y. S. Lincoln (eds) Handbook of Qualitative Research. London: Sage.
43.
Richardson, L. (1994) 'Writing: a Method of Inquiry', in N. K. Denzin and Y. S. Lincoln (eds) Handbook of Qualitative Research. London: Sage.
44.
Rist, R.C. (1994) 'Influencing the Policy Process with Qualitative Research', in N. K. Denzin and Y. S. Lincoln (eds) Handbook of Qualitative Research. London: Sage.
45.
Rootman, I., M. Goodstadt, L. Potvin and J. Springett (1996) 'A Framework for Health Promotion Evaluation', a background paper for the WHO/Euro Working Group on Evaluation of Health Promotion Approaches.
46.
Sabatier, P.A. (1986) 'Top-down and Bottom-up Approaches to Implementation Research: a Cntical Analysis and Suggested Synthesis', Journal of Public Policy6: 21-48.
47.
Smithies, J. and L. Adams (1993) 'Walking the Tightrope. Issues in Evaluation and Community Participation for Health for All', in J. K. Davies and M. P. Kelly (eds) Healthy Cities, Research and Practice. London : Routledge.
48.
Springett, J., C. Costongs and L. Dugdill (1995) 'Towards a Framework for Evaluation in Health Promotion: the Importance of Process', Journal of Contemporary Health2: 61-5.
49.
Springett, J. and C. Leavey (1995) 'Participatory Action Research: The Development of a Paradigm, Dilemmas and Prospects', in N. Bruce, J. Springett, J. Hodgkiss and A. Scott Samuel (eds) Research and Change in Urban Community Health . Aldershot: Avebury.
50.
Starmans, I. (1993) 'Migranten en gezondheid', in J. Ten Dam and E. de Leeuw (eds) Gezonde Steden en onderzoek: reikwijdte, methoden, toepassingen. Assen/Maastncht: Van Gorcum.
51.
Sweep, A. (1993) 'Process-evaluatie', in J. Ten Dam and E. de Leeuw (eds) Gezonde Steden en onderzoek: reikwijdte, methoden, toepassingen. Assen/Maastricht: Van Gorcum .
52.
Thompson, J.C. (1992) 'Program Evaluation within a Health Promotion Framework' , Canadian Journal of Public Health Supplement183: 67-71.
53.
Tsouros, A. and R.A. Draper (1993) 'The Healthy City Project: New Developments and Research Needs', in J. K. Davies and M. P. Kelly (eds) Healthy Cities, Research and Practice. London: Routledge.
54.
Weiss, C.H. (1972) Evaluation Research. Methods for Assessing Program EffectivenessNew York: Prentice Hall.
55.
Who (1987) 'Ottawa Charter for Health Promotion (1986)', in Health Promotion1(4): iii-v.
56.
Who (1994) Auditing Health Promotion, Quality Standards and Check-lists. Working paper, Granada, 23-24 October. WHO Regional Office for Europe, Health Promotion Unit.
57.
Winje, G. and H. Wewell (1992) 'Influencing Public Health Policy through Action Research', Journal of Drug Issues22: 169-78.
58.
Winter, R. (1990) Action Research and the Nature of Social Inquiry . Aldershot: Avebury.
59.
Ziglio, E. (1991) 'Indicators of Health Promotion Policy: Directions for Research', in B. Badura and J. Kickbush (eds) Health Promotion Research; Towards a New Social Epidemiology. Copenhagen: WHO Regional Publications. European Series No. 37.
