Evaluation capacity building (ECB) has become an area in the evaluation field that is attracting both scholarly attention and the practical work of evaluators. Despite some recent contributions, differing conceptions still exist concerning what constitutes ECB, let alone the nature of the capacity being built. Responding to an earlier call on the need for conceptual clarity regarding evaluation capacity (EC), this article discusses a model and a measurement tool used to map EC in Danish public sector organizations. Using empirical evidence as its basis, this article discusses the strengths and limitations of the conceptual model in relation to its face, content, and construct validity. Finally, the article discusses the implications arising from empirical findings and recent theoretical developments and suggests potential steps for improving conceptual clarity in the future.
AllenM.YenW. (2002). Introduction to measurement theory. London: Waveland Press.
2.
BaizermanM.ComptonD. W.StockdillS. H. (2002a). Editors' notes–the art, craft, and science of evaluation capacity building. New Directions for Evaluation, 93, 1–6.
3.
BaizermanM.ComptonD. W.StockdillS. H. (2002b). Summary and analysis of the case studies: Themes across the cases. New Directions for Evaluation, 93, 101–108.
4.
BaizermanM.ComptonD. W.StockdillS. H. (2002c). New directions for ECB. New Directions for Evaluation, 93, 109–119.
5.
BoyleR.,LemaireD. (Eds.), (1999) Building effective evaluation capacity: Lessons from practice. London: Transaction.
6.
ComptonD.BaizermanM. (2007). Defining evaluation capacity building. American Journal of Evaluation, 28(1):118–119.
7.
CousinsJ. B.GohS. C.ClarkS.LeeL. E. (2004). Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge base. The Canadian Journal of Program Evaluation, 19(2):99–141.
8.
CousinsJ. B.GohS. C.ElliottC. (2007, June). Organizational capacity to do and use evaluation: Preliminary results of a Pan-Canadian Survey of evaluators. Conference paper presented at the annual meeting of the Canadian Evaluation Society, Winnipeg, MB.
9.
de Lancer JulnesP. (2006). Performance measurement: An effective tool for government accountability? The debate goes on. Evaluation, 12(2):219–235.
10.
FuruboJ-E.SandahlR. (2002). A diffusion perspective on global developments in evaluation. In FuruboJ-E.RistR. C.SandahlR. (Eds.), International atlas of evaluation (pp. 1–23). New Brunswick, NJ: Transaction.
11.
HuffmanD.ThomasK.LawrenzF. (2008). A collaborative immersion approach to evaluation capacity building. American Journal of Evaluation, 29(3):358–368.
12.
KingJ. A.VolkovB. (2005). A framework for building evaluation capacity based on the experiences of three organizations. CURA Reporter, 35(3):10–16.
13.
KREVI—Danish Evaluation Institute for Local Governments. (2008). Evaluering i danske kommuner. En kvantitativ kortlægning af kommunernes evalueringskapacitet[Evaluation in Danish local governments. A quantitative mapping of evaluation capacity in local government]. Retrieved fromhttp://www.krevi.dk/files/Evaluering%20i%20danske%20kommuner.pdf
14.
LeavittH. J. (1978). Managerial psychology. Chicago, IL: University of Chicago Press.
15.
MackayK. (2002). The World Bank’s ECB experience. New Directions for Evaluation, 93, 81–99.
16.
MayneJ.DivorskiS.LemaireD. (1999). Locating evaluation: Anchoring evaluation in the executive or the legislature, or both or elsewhere?. In BoyleR.LemaireD. (Eds.), Building evaluation capacity: Lessons from practice (pp. 23–52). New Brunswick, NJ: Transaction.
17.
MayneJ.RistR. (2006). Studies are not enough: The necessary transformation of evaluation. Canadian Journal of Program Evaluation, 21(3):93–120.
18.
McDonaldB.RogersP.KeffordB. (2003). Teaching people to fish? Building the evaluation capability of public sector organizations. Evaluation, 9(1):9–29.
MilsteinB.CottonD. (2000). Defining concepts for the presidential strand on building evaluation capacity. Fairhaven, MA: American Evaluation Association.
21.
NaccarellaL.PirkisJ.KohnF.MorleyB.BurgessP.BlashkiG. (2007). Building evaluation capacity: Definitional and practical implications from an Australian case study. Evaluation and Program Planning, 30(3):231–236.
22.
NielsenS. B.BjørnkildeT. (2005). Opbygning af evalueringskapacitet i den offentlige sektor. Et policy implementeringsperspektiv. Dansk Evalueringsselskab Nyt, 8, 17–25.
23.
NielsenS. B.EjlerN. (2008). Improving performance? Exploring the complementarities between evaluation and performance. Evaluation, 14(2):171–192.
24.
PreskillH.BoyleS. (2008). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation, 29(4):443–459.
25.
PreskillH.Martinez-PapponiB.TorresR. T. (2001, February–March). Organizational readiness for learning and evaluation. Academy of Human Resource Development, conference proceedings, Tulsa, OK.
26.
PreskillH.TorresR. (1999). Evaluative inquiry for learning in organizations. Thousand Oaks, CA: Sage.
27.
RistR. C. (2006). The “E” in monitoring and evaluation: Using evaluative knowledge to support a results-based management system. In RistR. C.StameN. (Eds.), From studies to streams: Managing evaluative systems (pp. 3–22). London: Transaction.
28.
Russ-EftD.PreskillH. (2009). Evaluation in organizations. A systematic approach to enhancing, learning, performance, and change. New York: Basic Books.
29.
SalganikM. J.HeckathornD. D. (2004). Sampling and estimation in hidden populations using respondent-driven sampling. Sociological Methodology, 34, 193–239.
30.
SchreiberJ.NoraA.StageF.BarlowE.KingJ. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99(6):323–337.
31.
StameN. (2006). Introduction. Streams of evaluative knowledge. In RistR. C.StameN. (Eds.), From studies to streams: Managing evaluative systems (pp. vii–xxi). London: Transaction.
32.
StevensJ. (2002). Applied multivariate statistics for the social sciences (4th ed.). Mahwah, NJ: Lawrence Erlbaum.
33.
StockdillS. H.BaizermanM.ComptonD. W. (2002). Toward a definition of evaluation capacity building process: A conversation with the evaluation capacity building literature. New Directions for Evaluation, 93, 7–26.
StufflebeamD. L.WingateL. A. (2005). A self-assessment procedure for use in evaluation training. American Journal of Evaluation, 26, 544–561.
36.
SuhrD. D. (n.d.). Exploratory of confirmatory factor analysis. SUGI 31 Statistics and Data Analysis (Paper 200–31). Retrieved October 15, 2010, formhttp://www2.sas.com/proceedings/sugi31/200–31.pdf
37.
TautS. (2007a). Studying self-evaluation capacity building in a large international development organization. American Journal of Evaluation, 28(1):45–59.
38.
TautS. (2007b). Defining evaluation capacity building: Utility considerations. American Journal of Evaluation, 28(1):120.
39.
Taylor-PowellE.BoydH. H. (2008). Evaluation capacity building in complex organizations. New Directions for Evaluation, 120, 55–69.
40.
World Bank, Operations Evaluation Department. (1999). Evaluation capacity development: A diagnostic guide and action framework. ECD Working Paper Series (6). Washington, DC: Author.
