Evaluation capacity building (ECB) has become a popular approach for helping community-based organizations (CBOs) to meet their funders’ demands for accountability. This case study reports the ECB process with one staff member using a catalyst-for-change approach. The authors analyzed the role of the catalyst in diffusing evaluation knowledge and skills and in promoting evaluation mainstreaming and use within the CBO; and the outcomes achieved as a result of the catalyst’s role in the process of building evaluation capacity. Implications based on the study findings are discussed.
Alkin, M.C., & Christie, C.A. (2004). An evaluation theory tree . In M. Alkin (Ed.), Evaluation roots: Tracing theorists views and influences (pp. 12-65). Thousand Oaks, CA: Sage.
2.
Arnold, M.E. ( 2006). Developing evaluation capacity in extension 4-H field faculty. American Journal of Evaluation, 27, 257-269. doi:10.1177/1098214006287989.
3.
Baizerman, M., Compton, D., & Stockdill, S.C. (2002). New directions for ECB . New Directions for Evaluation, 93, 109-120. Retrieved from http://www.3.interscience.wiley.com/cgi-bin/fulltext/92013256/PDFSTART
4.
Behrens, T.R., & Kelly, T. ( 2008). Paying the piper: Foundation evaluation capacity calls the tune. In J. G. Carman & K. A. Fredericks (Eds.), Nonprofits and evaluation . New Directions for Evaluation, 119, 35-70. Retrieved from http://www.3.interscience.wiley.com/journal/121397489/issue
5.
Carman, J. ( 2007). Evaluation practice among CBOs. American Journal of Evaluation, 28, 60-75. doi:10.1177/ 1098214006296245.
6.
Carman, J. C., & Fredericks, K. A. (Eds.). (2008). Nonprofits and evaluation. Empirical evidence from the field. In J. G. Carman & K. A. Fredericks (Eds.), Nonprofits and evaluation. New Directions for Evaluation, 119, 51-71. Retrieved from http://www.3.interscience.wiley.com/cgi-bin/fulltext/121397495/PDFSTART
7.
Carman, J.G. & Fredericks, K.A. ( 2010). Evaluation capacity and nonprofit organizations: Is the glass half-empty or half-full? American Journal of Evaluation , 31(1), 84-104. doi: 10.1177/1098214009352361.
8.
Compton, D., Baizerman, M., Preskill, H., Rieker, P., & Miner, K. ( 2001). Developing evaluation capacity while improving evaluation training in public health: The American Cancer Society’s Collaborative Evaluation Fellows Project. Evaluation and Program Planning , 24, 33-40. Retrieved from http://www.sciencedirect.com/science/journal/01497189
9.
Compton, D.W., Glover-Kudon, R., Smith, I.E., & Avery, E. ( 2002). Ongoing capacity building in the American Cancer Society (ACS) 1995-2001. In D. W. Compton, M. Baizerman, & S. H. Stockdill (Eds.), The art, craft, and science of evaluation capacity building (New Directions for Evaluation93, pp.47-61). San Francisco, CA: Jossey-Bass. Retrieved from http://www.eric.ed.gov/
10.
Connolly, P., & York, P. ( 2002). Evaluating capacity-building efforts for nonprofit organizations . OD Practitioner, 34, 33-39. Retrieved from http://www.tccgrp.com/pdfs/per_art_evaluating.pdf
11.
Cousins, J.B., Goh, S.C., Eliott, C., & Aubry, T. (May, 2008). Government and voluntary sector differences in organizational capacity to do and use evaluation. Presented at the annual meeting of the Canadian Evaluation Society, Québec. Retrieved from http://evaluationcanada.ca/site.cgi?s=1
12.
Drucker, P.F. ( 1954). The practice of management. New York, NY: HarperCollins Publishers.
13.
Duignan, P. ( 2003). Mainstreaming evaluation or building evaluation capability? Three key elements. New Directions for Evaluation, 99, 7-21. Retrieved from http://www.3.interscience.wiley.com/journal/105561513/abstract
14.
Fawcett, S.B., Boothroyd, R., Schultz, J.A., Francisco, V.T., Carson, V., & Bremby, R. ( 2003). Building capacity for participatory evaluation within community initiatives. In Y. Suarez-Balcazar & G. W. Harper (Eds.), Empowerment & participatory evaluation of community interventions: Multiple benefits (pp. 21-36). New York, NY: The Haworth Press. Retrieved from http://www.informaworld.com/smpp/content~content=a903437371&db=all
15.
Fetterman, D.M., & Wandersman, A. (2005). Empowerment evaluation principles in practice. New York, NY: Guilford Publications.
16.
Gibbs, D., Napp, D., Jolly, D., Westover, B., & Uhl, G. ( 2002). Increasing evaluation capacity within community-based HIV prevention programs. Evaluation and program Planning, 25, 261-269. Retrieved from http://www.sciencedirect.com/science?
17.
Gugiu, P.C., & Rodriguez-Campos, L. (2007). Semi-structured interview protocol for constructing logic models. Evaluation and Program Planning, 30, 339-350. Retrieved from http://www.sciencedirect.com/science?
18.
Hoole, E., & Patterson, T.E. (2008). Voices from the field: Evaluation as part of a learning culture. In J. G. Carman & K. A. Fredericks (Eds.), Nonprofits and evaluation. New Directions for Evaluation, 119, 93-113. Retrieved from http://www.3.interscience.wiley.com/journal/121397500/abstract
19.
Huffman, D., Thomas, K., & Lawrenz, F. ( 2008). A collaborative immersion approach to evaluation capacity building. American Journal of Evaluation, 29, 358-368. doi:10.1177/1098214008318798.
20.
Kaplan, S.A., & Garrett, K.E. ( 2005). The use of logic models by community-based initiatives . Evaluation and Program Planning, 28, 167-172. Retrieved from http://www.sciencedirect.com/science?
21.
Kapucu, N., Augustin, M., & Krause, M. ( 2007). Capacity building for community-based small nonprofit minority health agencies in Central Florida. The International Journal of Volunteer Administration, 24, 10-17. Retrieved from http://www.ijova.org/PastIssues/xxiv_3.htm
22.
Keener, D., Snell-Johns, J., Livet-Dye, M., & Wandersman, A. (2005). Lessons that influenced the current conceptualization of empowerment evaluation: Reflections from two evaluation projects. In D. M. Fetterman & A. Wandersman (Eds.), Empowerment evaluation: Principles in Practice (pp. 73-91). New York, NY: Guilford Press.
23.
King, J.A. ( 2002). Building the evaluation capacity of a school district . New Directions for Evaluation, 93, 63-79. Retrieved from http://www.3.interscience.wiley.com/cgi-bin/fulltext/92013254/PDFSTART
24.
Mackay, K. ( 2002). The World Bank’s ECB experience. New Directions for Evaluation, 93, 81-100. Retrieved from http://www.3.interscience.wiley.com/cgi-bin/fulltext/92013252/PDFSTART .
25.
Merriam, S.B., Caffarella, R.S., & Baumgartner, L.M. (2007). Learning in adulthood: A comprehensive guide (3rd ed.). San Francisco, CA: Jossey-Bass.
26.
Milstein, B., Chapel, T.J., Wetterhall, S.F., & Cotton, D.A. ( 2002). Building capacity for program evaluation at the Centers for Disease Control and Prevention. New Directions for Evaluation , 93, 27-46. Retrieved from http://www.3.interscience.wiley.com/cgi-bin/fulltext/92013258/PDFSTART
27.
Naccarella, L., Pirkis, J., Kohn, F., Morley, B., Burgess, P., & Blashki, G. ( 2007). Building evaluation capacity: Definitional and practical implications for an Australian case study. Evaluation and Program Planning, 30, 231-236. Retrieved from http://www.sciencedirect.com/science?
28.
Preskill, H., & Boyle, S. ( 2008). A multidisciplinary model of evaluation capacity building . American Journal of Evaluation, 29, 443-459. . doi:10.1177/1098214008324182.
29.
Sobeck, J., & Agius, E. ( 2007). Organizational capacity building: Addressing a research and practice gap. Evaluation and Program Planning, 30, 237-246. Retrieved from http://www.sciencedirect.com/science?
30.
Stevenson, J.F., Florin, P., Mills, D.S., & Andrade, M. ( 2002). Building evaluation capacity in human service organizations: A case study. Evaluation and Program Planning, 25, 233-243. Retrieved from http://www.3.interscience.wiley.com/cgi-bin/fulltext/92013258/PDFSTART
31.
Stockdill, S., Baizerman, M., & Compton, D. ( 2002). Toward a definition of the ECB process: A conversation with the ECB literature. New Directions for Evaluation, 93, 1-25, 233-243. Retrieved from http://www.3.interscience.wiley.com/cgi-bin/fulltext/92013257/PDFSTART.
32.
Suarez-Balcazar, Y., Taylor-Ritzler, T., Garcia-Iriarte, E., Keys, C.B., Kinney, L., Ruch-Ross, H., & . . . Curtin, G. (2010). Evaluation capacity building: A culturally- and contextually-grounded interactive framework and exemplar . In F. Balcazar, Y. Suarez-Balcazar, T. Taylor-Ritzler, & C. B. Keys, (Eds.), Race, culture and disability: Rehabilitation science and practice (pp. 307-324). Boston, MA: Jones and Bartlett.
33.
Taut, S. ( 2007). Studying self-evaluation capacity building in a large international development organization. American Journal of Evaluation, 28, 45-59. doi:10.1177/1098214006296430.
34.
Trevisan, M. ( 2002). Evaluation capacity in K-12 school counseling programs . American Journal of Evaluation, 23, 291-305. . doi:10.1177/109821400202300305.
35.
United Way of America. (1996). Outcome and measurement resource network. Retrieved from http://www.liveunited.org
36.
Valery, R., & Shakir, S. ( 2005). Evaluation capacity building and humanitarian organization . Journal of Multidisciplinary Evaluation, 3, 87-112. Retrieved from http://preval.org/documentos/2205.pdf#page=87
