Shaping Evaluation Practice through Consultation and Debate: Implications for Information Programmes

Abstract

Contribution to a special issue on ‘Developing Evaluation Practice in the Information Sector’. Reviews the key messages from six international workshops dealing with evaluation strategies and methods in the development community. The main issues highlighted relate to: (1) strategies for institutionalizing evaluation in development organizations; (2) the debate surrounding the evaluation goals of accountability and learning; (3) clarification of evaluation concepts and terms; (4) review of evaluation frameworks; and (5) an ‘Evaluation Road Map for Information’ (ERMi), proposed by the author. Concludes that the workshop proceedings constitute a wealth of new ideas and knowledge on evaluation practice. Recommends the testing and use of ERMi as an operational model for planning evaluation exercises.

Get full access to this article

View all access options for this article.

References

Baark, E. and Heeks, R. (1998) Evaluation of donor-funded information technology transfer projects in China: a life cycle approach. Manchester, Institute for Development Policy Management . (Development Informatics Working Paper Series, Paper No. 1).

CGIAR (1999) Impact assessment of agricultural research: context and state of the art . In: ECART, ASARECA, CTA and GTZ. 2000. Workshop on impact assessment of agricultural research in Eastern and Central Africa (Entebbe, Uganda, 16-19 November 1999).

Correa, A. F.et al. (1997) Rural information provision in developing countries - measuring impact and performance. Paris, UNESCO .

CTA (1998) Assessing the impact of information and communication on institutional performance . Proceedings of a CTA workshop. Wageningen, The Netherlands, 27-29 January 1998.

CTA (2002) Technical consultation on assessing the performance and impact of agricultural information products and services . Proceedings of a CTA/IICD/LEAP IMPACT Technical Consultation. Bonn, Germany, 9-12 October 2001. (CTA Working paper 8027) Wageningen, Technical Centre for Agricultural and Rural Cooperation (CTA), p. 169.

Cummings, S. (2002) Inventory: conceptual frameworks and methodologies used for evaluating agricultural information products and services. In: CTA (2002) op.cit., pp. 130-156.

Daly, J. (n.d.) A conceptual framework for the study of the impacts of the Internet. http://www.cidcm.umd.edu/library/papers/jdaly/concept.htm

ECARTet al. (2000) Workshop on impact assessment of agricultural research in Eastern and Central Africa (Entebbe, Uganda, 16-19 November 1999).

Horton, D.et al. (1993) Monitoring and evaluating agricultural research: a source book. CAB International in association with ISNAR .

10.

Horton, F. W. Jr., ed. (2000) Defining and assessing the impact of information on development: building research and action agendas. Ottawa; International Development Research Council; The Hague, International Federation for Information and Documentation, p. 136. (FID Occasional Paper 16). Annex 4: Report on the impact meetings in London, December 1999.

11.

Khadar, I. (2002) Evaluation concepts and terminology: a discussion note. In: CTA (2002) op.cit., pp. 51-55.

12.

Los Alamos National Laboratory (1999) Evaluation framework at Science Education Team. http://set.lanl.gov/programs/evaluation/Framework/Framework.htm

13.

McConnell, P. (2000) Building on IDRC’s research program on ‘Assessing the impact of information on decision-making’. In: Horton, F. W. Jr., ed., op.cit.., pp. 73-97.

14.

Menou, M. ed. (1993) Measuring the impact of information on development. Ottawa, IDRC .

15.

Mook, B. (2001) Evaluating information: a letter to a project officer. (CTA Working Document Number 8025). p. 53.

16.

OECD (2001) Evaluation feedback for effective learning and accountability (report of DAC Tokyo workshop on ‘Evaluation feedback for effective learning and accountability’, 26-28 September 2000).

17.

OECD (2001a) DAC evaluation criteria. http://www.oecd.org/dac/

18.

South African Northern Province’s Hospital Information System Evaluation. (1998) http://www.sghms.ac.uk/depts/phs/hceu/safrica.htm

19.

World Bank (2001) Evaluation approach. ( Evaluation Operations Department ) http://www.worldbank.org/oed/eta-approach.html

20.

Young, V. (1997) ICTs and development: testing a framework for evaluation. http://www.acid-cida.gc.ca/cida