Design of a Basic System of Indicators for Monitoring and Evaluating Spanish Cooperation’s Culture and Development Strategy

Abstract

Objective:

This article describes the process implemented in order to define and build up a Basic Monitoring and Evaluation System for Spanish Cooperation’s Culture and Development Strategy (CD-S).

Research Design:

Delphi techniques were used to assess a wide catalogue of indicators for each of the strategic areas included in the CD-S. Afterward, those indicators considered most suitable for monitoring and evaluating purposes were selected based on the assessments provided by a panel of experts.

Results:

As a consequence, the resulting system, made up by a total of 80 indicators, was designed to be a practical, manageable, and targeted tool for its potential users, who include managers and technical officers who map out strategy together with stakeholders involved in its implementation, and specifically with staff at cultural centers abroad and in technical aid offices.

Keywords

basic system of indicators monitoring and evaluation system Delphi technique culture and development strategy

Get full access to this article

View all access options for this article.

References

AECID (Agencia Española de Cooperación Internacional para el Desarrollo). 2007. Spanish Strategy for Culture and Development Cooperation. Madrid, Spain: AECID.

AECID (Agencia Española de Cooperación Internacional para el Desarrollo). 2009. Cómo Evaluar Proyectos de Cultura Para el Desarrollo: Una Aproximación Metodológica a la Construcción De Indicadores. Madrid, Spain: AECID.

Bakewell

Garbutt

. 2005. The Use and Abuse of the Logical Framework Approach. Accessed February 14, 2012, www.intrac.org/data/files/resources/518/The-Use-and-Abuse-of-the-Logical-Framework-Approach.pdf.

Beech

1997. “Studying the Future: A Delphi Study of How Multidisciplinary Clinical Staff View the Likely Development of Two Community Mental Health Centres over the Course of the Next 2 years.” Journal of Advanced Nursing 25:331–38.

Bonefoy

J. C.

Armijo

. 2005. Indicadores de Desempeño En El Sector Público. Series Manuales, nº 45. Santiago de Chile: Instituto Latinoamericano y del Caribe de Planificación Económica y Social.

Camacho

Cámara

Cascante

Sainz

. 2001. El enfoque del Marco Lógico: 10 Casos Prácticos. Cuaderno Para la Identificación y Diseño de Proyectos de Desarrollo. Madrid, Spain: Fundación CIDEAL y Acciones de Desarrollo y Cooperación.

Carrasco

. 2006. “Medir la Cultura: Una tarea inacabada.” Periférica 7:140–168.

Dalkey

1969. The Delphi Method: An Experimental Study of Group Opinion. Research Memorandum, RM-5888-PR. Santa Monica, CA: The Rand Corporation.

Dalkey

Brown

Cochan

. 1969. The Delphi Method III: Use of Self Rating to Improve Group Estimates. Research Memorandum, RM-6115-PR. Santa Monica, CA: The Rand Corporation.

10.

Dalkey

N. C.

Helmer

. 1963. “An Experimental Application of the Delphi Method to the Use of Experts.” Management Science 9:458–67.

11.

Drucker

1954. The Practice of Management. New York: Harper and Row.

12.

Duffield

. 1993. “The Delphi Technique: a comparison of results obtained using two expert panels.” International Journal of Nursing Studies 30:227–237.

13.

Eseryel

2002. “Approaches to Evaluation of Training: Theory & Practice.” Journal of Educational Technology and Society 5:93–98.

14.

European Commission. 2004. Aid Delivery Methods. Vol. 1. Project Cycle Management Guidelines. Brussels, Belgium: EuropeAid Cooperation Office.

15.

Gasper

2000. “Evaluating the ‘Logical Framework Approach' towards Learning-oriented Development Evaluation.” Public Administration and Development 20:17–28.

16.

Gibson

J. M. E.

1998. “Using the Delphi Technique to Identify the Content and Context of Nurses’ Continuing Professional Development Needs.” Journal of Clinical Nursing 7:451–59.

17.

Gordon

T. J.

1994. The Delphi Method. AC/UNU Millennium Project. Accessed February 14, 2012, http://www.gerenciamento.ufba.br/Downloads/delphi%20(1).pdf.

18.

Gordon

T. J.

Helmer

. 1964. Report on a Long Range Forecasting Study. Research Memorandum, RM-2982. Santa Monica, CA: The Rand Corporation.

19.

Grandzol

Gershon

. 1994. “Multiple Criteria Decision Making.” Quality Progress 27:69–73.

20.

Hallowell

M. R.

Gambatese

J. A.

. 2010. “Qualitative Research: Application of the Delphi Method to CEM Research.” Journal of Construction Engineering and Management 136:99–107.

21.

Hanafin

Brooks

A.-M.

Carroll

Fitzgerald

Gabhainn

S. N.

Sixsmith

. 2007. “Achieving Consensus in Developing a National Set of Child Well-being Indicators.” Social Indicators Research 80:79–104.

22.

High Level Forum on Aid Effectiveness. 2008. Accra Agenda for Action. Accessed February 14, 2012, http://siteresources.worldbank.org/ACCRAEXT/Resources/4700790-1217425866038/AAA-4-SEPTEMBER-FINAL-16h00.pdf.

23.

Jones

Hunter

. 1995. “Consensus Methods for Medical and Health Services Research.” Journal of British Medical 311:379–80.

24.

Jones

2007. Project Management Survival: A Practical Guide to Leading, Managing & Delivering Challenging Projects. London, UK: Kogan Page.

25.

King

J. A.

2007. “Developing Evaluation Capacity through Process Use.” New Directions for Evaluation 116:45–59.

26.

Kresten

Green

Armstrong

Graefe

. 2007. “Methods to Elicit Forecasts from Groups: Delphi and Prediction Markets Compared.” Foresight: The International Journal of Applied Forecasting 8:17–20.

27.

Landeta

2002. El Método Delphi: Una Técnica De Previsión Del Futuro. Barcelona, Spain: Ariel.

28.

Linston

Turoff

. 1975. The Delphi Method. Techniques and Applications. Reading, MA: Addison-Wesley.

29.

Loo

2002. “The Delphi Method: A Powerful Tool for Strategic Management.” Policing: An International Journal of Police Strategies and Management 25:762–69.

30.

McCallister

A. D.

1992. Determining Characteristics of the Forest Industry in the 21st Century: A Delphi Study with Implications for Agriculture Education Programs. Unpublished doctoral dissertation, University of Georgia, Athens, GA.

31.

OECD (Organization for Economic Co-operation and Development). 2005. Paris Declaration on Aid Effectiveness. Paris, France: OECD. Accessed August 13, 2012, http://www.oecd.org/development/aideffectiveness/34428351.pdf.

32.

OECD (Organization for Economic Co-operation and Development). DAC (Development Assistance Committee). 2010. Evaluating Development Co-Operation. Summary of Key Norms and Standards. París, France. Accessed February 14, 2012, http://www.maec.es/es/MenuPpal/CooperacionInternacional/Evaluacion/Documents/2010Principios%20y%20Estandares%20CAD.pdf.

33.

Powell

2003. “The Delphi Technique: Myths and Realities.” Journal of Advanced Nursing 41:376–82.

34.

Sartorius

R. H.

1991. “The Logical Framework Approach to Project Design and Management.” American Journal of Evaluation 12:139–47.

35.

Smith

D. K.

1999. Make Success Measurable! A Mindbook-Workbook for Setting Goals and Taking Action. New York: John Wiley.

36.

Stufflebeam

D. L.

1983. “The CIPP Model for Program Evaluation.” In Evaluation Models: Viewpoints on Educational and Human Services Evaluation (pp. 117–141), edited by Madaus

G. F.

Scriven

Stufflebeam.Boston, MA

D. L.

: Kluwer Nijhof.

37.

Tague

N. R.

2004. The Quality Toolbox. Milwauke, WI: ASQ Quality Press.

38.

Van Zolingen

S. J.

Klaasen

C. A.

. 2003. “Selection Process in a Delphi Study about Key Qualifications in Senior Secondary Vocational Education.” Technological Forecasting and Social Change 70:317–40.

39.

Weatherman

Swenson

. 1974. “Delphi Technique”. In Futurism in Education: Methodologies (pp. 97–114), edited by Hencley

S. P.

Yates

J. R.

. Berkeley, CA: McCutchan.

40.

Wilhelm

W. J.

2001. “Alchemy of the Oracle: The Delphi Technique.” The Delta Pi Epsilon Journal 43:6–26.

41.

Worthen

B. R.

Sanders

J. R.

. 1987. Educational Evaluation. New York: Longman.

42.

Yong

Wenhao

. 2011. “Developing a City Governance Index: Based on Surveys in Five Major Chinese Cities.” Social Indicators Research. Published online first, August 2, 2011.