Because when a policy process starts, nobody knows what line of action will eventually be implemented, policy evaluation has to continuously examine the content of different policy components. In order to understand and explain public policy, different stakeholders' perceptions of the policy problem need to be scrutinized. A policy evaluation should also facilitate the interpretation of policy in a broader context. What values and order does the policy or programme promote? Using an open evaluation framework and a mix of criteria can facilitate a broader interpretation of the policy process. In this article, problems undertaking policy evaluation are discussed in relation to a Swedish medical informatics programme.
Albaek, E. (1989-90) 'Policy Evaluation: Design and Utilization', Knowledge in Society:' The International Journal of Knowledge Transfer2 (4).
2.
Albaek, E. (1995) 'Between Knowledge and Power: Utilization of Social Science in Public Policymaking', Policy Sciences28: 79-100.
3.
Benson, J. K. (1983) 'Interorganizational Networks and Policy Sectors', in D. Rogers and D. Whetton (eds) Interorganizational Coordination. Ames, IA: Iowa State University Press.
4.
Bernstein, R. (1983) Beyond Objectivism and Relativism: Science, Hermeneutics, and Praxis. Philadelphia, PA: University of Pennsylvania Press.
5.
Chelimsky, E. (1997) 'The Coming Transformations in Evaluation', in E. Chelimsky and R. S. Shadish (eds) Evaluation for the 21st Century - A Handbook. Thousand Oaks, CA: Sage Publications.
6.
Cobb, R. W. and C. D. Elder (1983) Participation in American Politics. The Dynamics of Agenda Building. Baltimore, MD: Johns Hopkins University Press.
7.
Cook, T. D. (1997) 'Lessons Learned in Evaluation Over the Past 25 Years', in E. Chelimsky and R. S. Shadish (eds) Evaluation for the 21st Century - A Handbook. Thousand Oaks, CA: Sage.
8.
Costongs, C. and J. Springett (1997) 'Towards a Framework for the Evaluation of Healthrelated Policies in Cities', Evaluation3(3): 345-362.
9.
Deleon, P. (1994) 'Reinventing the Policy Sciences: Three Steps Back to the Future', Policy Sciences27: 77-95.
10.
Dery, D. (1984) Problem Definition in Policy Analysis. Lawrence, KS: University Press of Kansas.
11.
Dryzek, J. and D. Torgerson (1993) 'Democracy and the Policy Sciences: A Progress Report', Policy Sciences26: 127-137.
12.
Elmore, R. (1978) 'Organisational Models of Social Program Implementation', Public Policy26: 185-228.
13.
Fischer, F. (1987) 'Policy Expertise and the "New Class": A Critique of the Neoconservative Thesis', in F. Fischer and J. Forester (eds) Confronting Values in Policy Analysis.: The Politics of Criteria. London: Sage.
14.
Fischer, F. (1993) 'Reconstructing Policy Analysis: A Postpositivist Perspective', Policy Sciences25: 333-339.
15.
Fischer, F. (1995) Evaluating Public Policy. Chicago, IL: Nelson Hall Publishers.
16.
Fischer, F. (1998) 'Beyond Empiricism: Policy Inquiry in Postpositivist Perspective', Policy Studies Journal26: 129-146.
17.
Fischer, F. and J. Forester (eds) (1987) Confronting Values in Policy Analysis: The Politics of Criteria. London: Sage.
18.
Geva-May, Iris with Aaron B. Wildavsky (1997) An Operational Approach to Policy Analysis: The Craft.: Prescriptions for Better Analysis. Boston, MA: Kluwer Academic Publishers.
19.
Guba, Egon G. and Yvonna S. Lincoln (1989) Fourth Generation Evaluation. Newbury Park, CA: Sage.
20.
Hanberger, A. (1997) Prospects for Local Politics. Umei, Sweden: Department of Political Science, Ume A University.
21.
Hanberger, Anders (1999) wwwinfomedica.nuFinal report from. the evaluation of the medical information system Info Medica. (In Swedish.) Evaluation Reports No 1, September 1999. Umea: Ume Ai University, Ume Ai Centre for Evaluation Research.
22.
Hansen, P. (2000) 'Europeans Only? Essays on Identity Politics and the European Union', paper for Department of Political Science, Umefi University, Umefi.
23.
Heclo, H. (1972) 'Review Article: Policy Analysis', British Journal of Political Science2: 83-108.
24.
Hill, M. (1997a) The Policy Process. A Reader, 2nd edn.London: Harvester Wheatsheaf.
25.
Hill, M. (1997b) The Policy Process in the Modern State, 3rd edn.London: Harvester Wheatsheaf.
26.
Hjern, B. and D. Porter (1983) 'Implementation Structures: A New Unit of Administrative Analysis', in B. Holzner (ed.) Realizing Social Science Knowledge. Vienna: Physica-Verlag.
27.
Hogwood, B. W. and L. A. Gunn (1984) Policy Analysis for the Real World. London: Oxford University Press.
28.
House, Ernest R. and Kenneth R. Howe (1999) Values in Evaluation and Social Research. Thousand Oaks, CA: Sage.
29.
Hukkinen, J. and G. Rochlin (1994) 'A Salt on the land: Finding the Stories, Nonstories, and Metanarrative in the Controversy over Irrigation-Related Salinity and Toxicity in California's San Joaquin Valley', in R. Emery (ed.) Narrative Policy Analysis. Durham, NC: Duke University Press.
30.
Hull, C. and B. Hjern (1987) Helping Small Firms Grow.' An Implementation Approach. London: Croom Helm.
31.
Jennings, B. (1987) 'Interpretation and the Practice of Policy Analysis', in F. Fischer and J. Forester (eds) Confronting Values in Policy Analysis: The Politics of Criteria. London: Sage.
32.
Lasswell, H. D. (1958) Politics.: Who gets What, When and How?New York: Meridians Books.
33.
Lasswell, H. D. (1971) A Pre-view of the Policy Sciences. New York: American Elsevier.
34.
Parsons, W. (1995) Public Policy. An Introduction to the Theory and Practice of Policy Analysis. Cheltenham: Edward Elgar.
35.
Pawson, R. and N. Tilley (1997) Realistic Evaluation. London: Sage.
36.
Peterson, A. (1997) 'Risk, Governance and New Public Health', in A. Peterson and R. Bunton (eds) Foucault, Health and Medicine, pp. 189-206. London: Routledge.
37.
Rist, R. C. (1995) Policy Evaluation. Linking Theory to Practice. Aldershot: Edward Elgar.
38.
Rochefort, D. and R. Cobb (1993) 'Problem Definition, Agenda Access, and Policy Choice', Policy Studies Journal21: 56-71.
39.
Rossi, P. H. and H. Freeman (1993) Evaluation: A Systematic Approach, 5th edn.Beverly Hills, CA: Sage.
40.
Sabatier, P. (1986) 'Top-Down and Bottom-Up Approaches to Implementation: A Critical Analysis and Suggested Synthesis', Journal of Public Policy6: 21-48.
41.
Schram, S. F. (1993) 'Postmodern Policy Analysis: Discourse and Identity in Welfare Policy', Policy Sciences26: 249-270.
42.
Spector, M. and J. I. Kitsuse (1987) Constructing Social Problems. New York: Aldine De Gruyter.
43.
Stake, R. (1998) 'When Policy is Merely Promotion, by what Ethic Lives an Evaluator?', Studies in Educational Evaluation24: 203-212.
44.
Torgerson, D. (1985) 'Contextual Orientation in Policy Analysis: The Contribution of Harald D. Lasswell', Policy Sciences18: 241-261.
45.
Torgerson, D. (1986) 'Between Knowledge and Politics: Three Faces of Policy Analysis', Policy Sciences19: 33-59.
46.
Torgerson, D. (1992) 'Reuniting Theory and Practice', Policy Sciences25: 225-235.
47.
Torgerson, D. (1995) 'Policy Analysis and Public Life: The Restoration of Phronesis?' in J. Farr, J. Dryzek and S. Leonard (eds) Political Science in History-Research Programs and Political Traditions. Cambridge: Cambridge University Press.
48.
Torgerson, D. (1996) 'Power and Insight in Policy Discourse: Post-Positivism and Problem Definition', in L. Dobuzinskis, M. Howlett and D. Laycock (eds) Policy Studies in Canada: The State of the Art. Toronto: University of Toronto.
49.
Weiss, C. (1972) Evaluation Research: Methods of Assessing Program Effectiveness. Englewood Cliffs, NJ: Prentice-Hall.
50.
Wildavsky, A. (1980) The Art and Craft of Policy Analysis. London: Macmillan.
