In Europe, impact assessment is an essential element of evaluation. Impact cannot usually be
measured directly but has to be explored in view of a set of both quantitative and qualitative
impact dimensions. The impact needs also to be placed in the relevant context. At present, a
range of established methods is available for use by evaluators. The methods can be grouped
into three categories: those providing framework for assessment, those concerned with data
collection, and those concerned with data analysis. Panels are used extensively to complement
the other methods. European evaluations have so far been mainly concerned with quality and
direct impact. Assessments of the medium- or long-term impact are still rare.
Get full access to this article
View all access options for this article.
References
1.
Annerstedt, J.1990. Evaluating technology development programmes and lugh-tech priorities. Nordic Center for Innovation Report.
2.
Bach, L., and G. Lambert.1993. Evaluation of the economic effects of large R&D programmes: The case of the European space programme. Research Evaluation2:17-26.
3.
Bobe, B., and H. Viala.1993. Le modèle communautaire, le recours à des panels extemes comme mode d' action. In Le management de la recherche, tome 1; les programmes technologiques, edited by M. Callon, P. Laredo, and P. Mustar.Paris: Economica.
4.
Georghiou, L., and F. Meyer-Krahmer .1993. Evaluation of socio-economic effects of community R&D programmes in the SPEAR network. Research Evaluation2:5-14.
5.
Georghiou, L., J.A. Stein, M. Janes, J. Senker, M. Pifer, H. Cameron, M. Nedeva, J. Yates, and M. Boden.1993. The impact of European Community policies for research and technological development upon science and technology in the United Kingdom. A report prepared for the Commission of the European Communities and the United Kingdom Office of Science and Technology. United Kingdom: University of Manchester, Programme of Policy Research in Engineering, Science and Technology (PREST).
6.
Gibbons, M., and L. Georghiou.1987. Evaluation of research; a selection of current practices. OECD Publications. Paris: Organization for Economic Co-Operation and Development .
7.
Guy, K., L. Georghiou, P. Quintas, M. Hobday, H. Cameron, and T. Ray.1991. Evaluation of the ALVEY programme for advanced information technology. London: HMSO.
8.
Hornschild, K., and F. Meyer-Krahmer .1992. Evaluation of economic effects: Relevance and impacts of EC programmes promoting industrial R&D with special emphasis on small and medium sized enterprises. Commission of the European Communities (CEC) Report EUR 14.197 EN. Brussels: CEC.
9.
Krull, W., D. Sensi, and D. Sotiriou.1991. Evaluation of research & development current practice and guidelines. Commission of the European Communities (CEC) Report EUR 1333. Brussels: CEC.
10.
Laredo, P.1991. State intervention on innovation, the role of technological programmes in the emergence of a new composite economic agent: The techno-economic network. Paper presented at the Second International Workshop "Policies and strategies on technology in industrialized countries ," May 6, Moscow.
11.
Massimo, L.1993. Les leçons de l'expérience de la Commission des Communautés Européennes. In Le management de la recherche, tome1; les programmes technologiques, edited by M. Callon, P. Laredo, and P. Mustar.Paris: Economica.
12.
Metcalfe, J.S., L. Georghiou, P. Cunningham, and H.M. Cameron.1992. Evaluation of the impact of European Community Research programmes upon the competitiveness of European industry—Concepts and approaches. Commission of the European Communities (CEC) Report EUR 14.198 EN. Brussels: CEC.
13.
Meyer-Krahmer, F.1992. Technology policy evaluation in Germany. Paper presented at the SPRU International Conference on Science and Technology Policy Evaluation, October 2-3, London.
14.
Meyer-Krahmer, F., and P. Montigny.1989. Evaluations of innovation programmes in selected European countries. Research Policy18:313-32.
15.
Meyer-Krahmer, F., and T. Reiss.1993. Ex ante evaluation and technology assessment—Two emerging elements of technology policy evaluation. Research Evaluation2:47-54.
16.
Olds, B.J.1992. Technological Eur-phoria; An analysis of European Community science and technology programme evaluation reports. BTE Policy Studies. The Hague: The Dutch Ministry of Economic Affairs.
17.
Organization for Economic Corporation and Development (OECD).1990. Evaluation of programmes promoting research, technology and innovation; checklist of principles. OECD Report. Paris: Author.
18.
Ormala, E.1987. Evaluation of research institutions. In Evaluation of technical research and development, edited by E. Ormala, 49-73. Helsinki: Nordic Cooperative Organization for Applied Research.
19.
—. 1989. Nordic experiences of the evaluation of technical research and development. Research Policy18:313-42.
20.
—. 1993. Un canevas pour l'évaluation des programmes de R&D de petite dimension. In Le management de la recherche, tome1; les programmes technologiques, edited by M. Callon, P. Laredo, and P. Mustar.Paris: Economica.
