Growth in the use of evaluation within the United States (US) philanthropic sector since the late 1990s has been driven by an increasing focus on program outcomes and increased demands for evidenced-informed decision-making. With similar developments now apparent within the New Zealand philanthropic sector, it is timely to consider what has been learnt from the US experience and how this may inform local efforts to build evaluation use and capacity. Recent literature on the US experience is reviewed to identify drivers of US developments, progress made, issues arising, and lessons learnt. With attention to the current stage of capacity building within the New Zealand sector, implications and direction for local development are considered.
Get full access to this article
View all access options for this article.
References
1.
BehrensT., & KellyT.2008, ‘Paying the piper: foundation evaluation capacity calls the tune’, in CarmanJ, & FredericksK (eds), Nonprofits and evaluation: New directions for evaluation, 119, Jossey-Bass, San Francisco.
2.
BickelW., MillettR., & NelsonC.2002, ‘Challenges to the role of evaluation in supporting organizational learning in foundations’, ‘Web extra’, Foundation News and Commentary, vol. 43, no. 2, viewed 12 October 2007, <http://www.foundationnews.org/webextra/learningweb.htm>.
3.
BotchevaL., WhiteC., & HuffmanL.2002, ‘Learning culture and outcomes measurement practices in community agencies’, American Journal of Evaluation, vol. 23, no. 4, pp. 421–434.
4.
BravermanM., ConstantineN., & SlaterJ. (eds) 2004, Foundations and evaluation: contexts and practices for effective philanthropy, Jossey-Bass, San Francisco.
5.
BuckmasterN.1999, ‘Associations between outcome measurement, accountability and learning for nonprofit organisations’, International Journal of Public Sector Management, vol. 12, no. 2, pp. 186–197.
6.
CampbellM., & McClintockC.2002, ‘Shall we dance? Program evaluation meets OD in the nonprofit sector’, OD Practitioner, vol. 34, no. 4, pp. 3–7.
7.
CarmanJ., & FredericksK.2008, ‘Editors’ notes’, in CarmanJ, & FredericksK (eds) Nonprofits and evaluation: New directions for evaluation, 119, Jossey-Bass, San Francisco.
8.
CarmanJ., FredericksK., & IntrocasoD.2008, ‘Government and accountability: paving the way for nonprofits and evaluation’, in CarmanJ, & FredericksK (eds), Nonprofits and evaluation: New directions for evaluation, 119, Jossey-Bass, San Francisco.
9.
CarterJ.1992, ‘Evaluation in foundations’, American Journal of Evaluation, vol. 13, no. 1, pp. 33–35.
10.
ChelimskyE.2001, ‘What evaluation could do to support foundations: a framework with nine component parts’, American Journal of Evaluation, vol. 22, no. 1, pp. 13–28.
11.
ChinJ.2006, The power of learning: funders and grantees getting smarter together, Blueprint Research & Design, San Francisco, viewed 11 December 2008, <http://www.blueprintrd.com/text/power.pdf>.
12.
ChinmanM., ImmP., & WandersmanA.2004, Getting to outcomes: promoting accountability through methods and tools for planning, implementation and evaluation, Rand Corporation, Santa Monica, California.
13.
ConnerR., KuoV., MeltonM., & MillettR.2004, ‘Adapting evaluation to accommodate foundations’ structural and cultural characteristics’, in BravermanM, ConstantineN, & SlaterJ (eds), Foundations and evaluation: contexts and practices for effective philanthropy, Jossey-Bass, San Francisco.
14.
CunninghamC.2003, ‘Application of the TPK guidelines for conducting evaluation research with Maori’, in LuntN, DavidsonC, & McKeggK (eds), Evaluating policy and practice: a New Zealand reader, Pearson Education, Auckland.
15.
DavidsonC.2003, ‘The mix of methods: common research techniques used in evaluation’, in LuntN, DavidsonC, & McKeggK (eds), Evaluating policy and practice: a New Zealand reader, Pearson Education, Auckland.
16.
DavidsonC., LuntN., & McKeggK.2003, ‘Towards a conclusion: where to now for evaluation in New Zealand’, in LuntN, DavidsonC, & McKeggK (eds), Evaluating policy and practice. a New Zealand reader, Pearson Education, Auckland.
17.
DuignanP.2003, ‘Approaches and terminology in programme and policy evaluation’, in LuntN, DavidsonC, & McKeggK (eds), Evaluating policy and practice. a New Zealand reader, Pearson Education, Auckland.
18.
Foundation Center2003, Foundation yearbook: facts and figures on private and community foundations, Foundation Center, New York.
19.
Grantmakers for Effective Organisations2005, Evaluation as a pathway to learning. current topics on evaluation for grantmakers, GEO, Washington, DC.
20.
Grantmakers for Effective Organisations2007, General operating support: a GEO action guide, GEO, Washington, DC.
21.
GrayS. (ed.) 1993, Leadership is—a vision of evaluation: a report of learnings from the Independent Sector's work on evaluation, Independent Sector, Washington, DC.
22.
GuthrieK., LouieJ., DavidT., & FosterC.2005, The challenge of assessing policy and advocacy activities—strategies for a prospective evaluation approach: report for the California Endowment, Blueprint Research & Design, San Francisco.
23.
HallP.2004, ‘A historical perspective on evaluation in foundations’, in SlaterJ, ConstantineN, & BravermanM (eds.), Foundations and evaluation, Jossey-Bass, San Francisco.
24.
HamiltonR., BrownP., ChaskinR., FiesterL., RichmanH., SojournerA., & WeberJ.2005, Learning for community change: core components of foundations that learn, Chapin Hall discussion paper, Chapin Hall, Center for Children, Chicago.
25.
HendricksM., PlantzM., & PritchardK.2008, ‘Measuring outcomes of United Way-funded programs: expectations and reality’, in CarmanJ, & FredericksK (eds), Nonprofits and evaluation, Jossey-Bass, San Francisco.
26.
HernandezG., & VisherM.2001, Creating a culture of inquiry: changing methods—and minds—on the use of evaluation in nonprofit organizations, The James Irvine Foundation, San Francisco, viewed 11 December 2008, <http://www.irvine.org/assets/pdf/pubs/evaluation/Creating_Culture.pdf>
27.
HoeferR.2000, ‘Accountability in action? Program evaluation in nonprofit human service agencies’, Nonprofit Management and Leadership, vol. 11, no. 2, pp. 167–177.
HooleE.2007, ‘Evaluation capacity building and the role of funders’, paper presented at the annual meeting of the American Evaluation Association, Portland, Oregon, November.
30.
HooleE., & PattersonT.2008, ‘Voices from the field: evaluation as part of a learning culture’, in CarmanJ, & FredericksK (eds), Nonprofits and evaluations: New directions for evaluation, 119, Jossey-Bass, San Francisco.
31.
IrwinK.1994, ‘Maori research methods and processes: an exploration’, Sites, vol. 28, Autumn, pp. 25–43.
32.
KramerM., & BickelW.2004, ‘Foundations and evaluation as uneasy partners in learning’, in BravermanM, ConstantineN, & SlaterJ (eds), Foundations and evaluation: contexts and practices for effective philanthropy, Jossey-Bass, San Francisco.
33.
KramerM., GravesR., HirschhornJ., & FiskeL.2007, From insight to action: new directions in foundation evaluation, FSG Social Impact Advisors, Boston, Massachusetts.
34.
LevitonL., & BassM.2004, ‘Using evaluation to advance a foundation's mission’, in BravermanM, ConstantineN, & SlaterJ (eds), Foundations and evaluation: contexts and practices for effective philanthropy, Jossey-Bass, San Francisco.
35.
MarkM., & BeeryW.2004, ‘Making judgements about what to evaluate and how intensely’, in BravermanM, ConstantineN, & SlaterJ (eds), Foundations and evaluation: contexts and practices for effective philanthropy, Jossey-Bass, San Francisco.
36.
McNelisR., & BickelW.1996, ‘Building formal knowledge bases: understanding evaluation use in the foundation community’, American Journal of Evaluation, vol. 17, no. 2, pp. 19–41.
37.
MillettR.2006, ‘Evaluation use within foundations’, unpublished paper, Millett & Associates, Chicago.
38.
Moewaka BarnesH.2003, ‘Maori and evaluation: some issues to consider’, in LuntN, DavidsonC, & McKeggK (eds), Evaluating policy and practice: a New Zealand reader, Pearson Education, Auckland.
PatriziP., & McMullanB.1998, ‘Evaluation in foundations: the unrealised potential’, unpublished manuscript, WK Kellogg Foundation, Battle Creek, Michigan.
44.
Philanthropy New Zealand2008, Evaluation collaboration project—building knowledge in evaluation: briefing notes, Philanthropy New Zealand, Wellington.
45.
PlantzM., GreenwayM., & HendricksM.1997, ‘Outcome measurement: showing results in the non-profit sector’, in NewcomerK (ed.), Using performance measurement to improve public and nonprofit programs: New directions for program evaluation, 75, Jossey-Bass, San Francisco.
46.
PorterM., & KramerM.1999, ‘Philanthropy's new agenda: creating value’, Harvard Business Review, vol. 77, no. 6, pp. 121–131.
47.
PreskillH., & TorresR.1999, Evaluative inquiry for learning in organizations, Sage, Thousand Oaks, California.
48.
PutnamK.2004, Measuring foundation performance: examples from the field, report prepared for the California Healthcare Foundation, Oakland, California.
49.
SandersJ., O'BrienM., TennantM., SokolowskiS., & SalamonL.2008, The New Zealand non-profit sector in comparative perspective, Office for the Community and Voluntary Sector, Wellington.
50.
ScrivenM.1994, ‘Evaluation and the do-gooder fallacy’, American Evaluation Association Newsletter, vol. 1, no. 1, pp. 6–7.
51.
SlackA., & Leung-WaiJ.2007, Giving New Zealand 2006, Business and Economic Research Ltd (BERL), Wellington.
52.
SlaterJ., ConstantineN., & BravermanM.2004, ‘Introduction: putting evaluation to work for foundations’, in BravermanM, ConstantineN, & SlaterK (eds), Foundations and evaluation: contexts and practices for effective philanthropy, Jossey-Bass, San Francisco.
53.
SmithL.1996, Kaupapa Maori Research, Department of Education, University of Auckland.
54.
SmithL.1999, Decolonizing methodologies: research and indigenous peoples, Zed Books, London.
55.
SnibbeA.2006, ‘Drowning in data’, Stanford Social Innovation Review, Fall, pp. 39–45.
56.
United Way of America1996, Measuring program outcomes: a practical approach, United Way of America, Alexandria, Virginia.
Urban Institute & The Center for What Works2006, Building a common outcome framework to measure non-profit performance, Urban Institute, Washington, DC, and The Center for What Works, Chicago, viewed 18 December 2008, <http://www.urban.org/UploadedPDF/411404_Nonprofit_Performance.pdf>.
60.
WiselyD.2002, ‘Parting thoughts on foundation evaluation’, American Journal of Evaluation, vol. 23, no. 2, pp. 159–164.
