The current debate around the emergence of participatory approaches in evaluation practice suggests that participatory evaluation may be considered an organizational learning praxis, one which facilitates the development of a holistic process of intentional change. Through critical reflection on how participatory evaluation has been conceptualized, this article offers an overview of some of the contextual challenges encountered when using participatory evaluation to enable the creation of learning environments. Given the pluralistic nature of modern organizations and some contextual constraints, evaluators appear to have largely developed a more instrumental type of learning, which may, paradoxically, result in a significant source of resistance to intentional change. This article proposes a process of capacity building for evaluative research (CBER). This process offers a collaborative way of overcoming unforeseen resistance to intentional change by overcoming the challenges found in the relationship between participatory evaluation and organizational learning. The article concludes by suggesting some epistemological and organizational issues that evaluators should take into account when enabling the implementation of a process of CBER in pluralistic organizations.
Abma, T.A. (2001b) `Reflexive Dialogues: A Story about the Development of Injury Prevention in Two Performing-Arts Schools', Evaluation7(2): 238-52.
3.
Abma, T.A. (2007) `Situated Learning in Communities of Practice: Evaluation of Coercion in Psychiatry as a Case', Evaluation13(1): 32-47.
4.
Alkin, M.C. and S.M. Taut (2002) `Unbundling Evaluation Use', Studies in Educational Evaluation29(1): 1-12.
5.
Andrews, A.B., P.S. Motes, V.C. Flerx, A. Lopez-De Fede and A.G. Floyd (2006) `Building Evaluation Capacity in Community-Based Organizations: Reflections of an Empowerment Evaluation Team', Journal of Community Practice13: 85-104.
Argyris, C. and D. Schön (1978) Organizational Learning: A Theory of Action Perspective . Reading, MA: Addison Wesley.
8.
Argyris, C. and D. Schön (1996) Organizational Learning II: Theory, Method and Practice. Reading, MA: Addison Wesley .
9.
Bartunek, J.M. (1993) `Scholarly Dialogues and Participatory Action Research' , Human Relations46(10): 1221-33.
10.
Bianchi, P.V. and L.M. Miller (1996) `Innovation and Collective Action: The Dynamics of Change', Structural Change and Economic Dynamics7(2): 193-206.
11.
Billett, S. (2004) `Workplace Participatory Practices: Conceptualising Workplaces as Learning Environments ', Journal of Workplace Learning16(6): 312-24.
12.
Boutilier, M., R. Mason and I. Rootman (1997) `Community Action and Reflective Practice in Health Promotion Research', Health Promotion International12(1): 69-78.
13.
Boyatzis, R.E. (2006) `An Overview of Intentional Change from a Complexity Perspective', Journal of Management Development25(7): 607-23.
14.
Brisolara, S. (1998) `The History of Participatory Evaluation and Current Debates in the Field', New Directions for Evaluation80: 25-41.
15.
Burke, B. (1998) `Evaluating for a Change: Reflections on Participatory Methodology', New Directions for Evaluation80: 43-56.
16.
Capwell, E.M., F. Butterfoss and V.T. Francisco (2000) `Why Evaluate?', Health Promotion Practice1(1): 15-20.
17.
Cassell, C. and P. Johnson (2006) `Action Research: Explaining the diversity', Human Relations59(6): 783-814.
18.
Chisholm, R.F. and M. Elden (1993) `Features of Emerging Action Research', Human Relations46(2): 275-98.
19.
Cooke, B. and U. Kothari (2002) Participation: The New Tyranny?London: Zed Books.
20.
Costongs, C. and J. Springett (1997) `Towards a Framework for the Evaluation of Health-Related Policies in Cities', Evaluation3(3): 345-62.
21.
Cousins, J.B. and E. Whitmore (1998) `Framing Participatory Evaluation', New Directions for Evaluation80: 5-23.
22.
Crishna, B. (2007a) `Participatory Evaluation (I): Sharing Lessons from Fieldwork in Asia', Child: Care, Health and Development33: 217-23.
23.
Crishna, B. (2007b) `Participatory Evaluation (II): Translating Concepts of Reliability and Validity in Fieldwork', Child: Care, Health and Development33: 224-9.
24.
Cullen, J. (1999) `Socially Constructed Learning: A Commentary on the Concept of the Learning Organisation', The Learning Organization6(1): 45-52.
25.
Dehler, G.E. and R.K. Edmonds (2006) `Using Action Research to Connect Practice to Learning: A Course Project for Working Management Students', Journal of Management Education30(5): 636-69.
26.
Denis, J.-L., A. Langley and L. Rouleau (2007) `Strategizing in Pluralistic Contexts: Rethinking Theoretical Frames', Human Relations60(1): 179-215.
27.
Diez, M.A. (2001) `The Evaluation of Regional Innovation and Cluster Policies: Towards a Participatory Approach', European Planning Studies9(7): 907-23.
28.
Diez, M.A. (2002) `Evaluating New Regional Policies: Reviewing the Theory and Practice', Evaluation, 8(3): 285-305.
29.
Diez, M.A., E. Malagón and B. Izquierdo (2005) `Using Evaluation for Collective Learning and Improving Regional Policies: A Case Study in the Basque Country', International Conference: Regional Growth Agendas, Alborg, Denmark.
30.
Easterby-Smith, M., M. Crossan and D. Nicolini (2000) `Organizational Learning: Debates Past, Present and Future', Journal of Management Studies37(6): 783-96.
31.
Edelenbos, J. and M. Van Eeten (2001) `The Missing Link: Processing Variation in Dialogical Evaluation', Evaluation7(2): 204-10.
32.
Elden, M. and R.F. Chisholm (1993) `Emerging Varieties of Action Research: Introduction to the Special Issue', Human Relations46(2): 121-42.
33.
Feldman, M.S. (2004) `Resources in Emerging Structures and Processes of Change', Organization Science15(3): 295-309.
34.
Floc'hlay, B. and E. Plottu (1998) `Democratic Evaluation: From Empowerment Evaluation to Public Decision-Making', Evaluation4(3): 261-77.
35.
Forss, K., C.C. Rebien and J. Carlsson (2002) `Process Use of Evaluations: Types of Use that Precede Lessons Learned and Feedback', Evaluation8(1): 29-45.
36.
Forss, K., S.-E. Kruse, S. Taut and E. Tenden (2006) `Chasing a Ghost? An Essay on Participatory Evaluation and Capacity Development', Evaluation12(1): 128-44.
37.
Garaway, G.B. (1995) `Participatory Evaluation', Studies in Educational Evaluation21(1): 85-102.
38.
Gaventa, J., V. Creed and J. Morrissey (1998) `Scaling up: Participatory Monitoring and Evaluation of a Federal Empowerment Program', New Directions for Evaluation80: 81-94.
39.
Geva-May, I. and W. Thorngate (2003) `Reducing Anxiety and Resistance in Policy and Programme Evaluations: A Socio-Psychological Analysis', Evaluation9(2): 205-27.
40.
Greene, J.G. (1988) `Stakeholder Participation and Utilization in Program Evaluation', Evaluation Review12(2): 91-116.
41.
Greenwood, D.J., W.F. Whyte and I. Harkavy (1993) `Participatory Action Research as a Process and as a Goal', Human Relations46(2): 175-92.
42.
Gregory, A. (2000) `Problematizing Participation: A Critical Review of Approaches to Participation in Evaluation Theory', Evaluation6(2): 179-99.
43.
Herman, J.L., L.L. Morris and C.T. Fitz-Gibbon (1987) Evaluator's Handbook. Newbury Park, CA: SAGE.
44.
Kalliola, S., R. Nakary and I. Pesonen (2006) `Learning to Make Changes: Democratic Dialogue in Action', Journal of Workplace Learning18(7/8): 464-77.
45.
Karlsson, O. (2001) `Critical Dialogue: Its Value and Meaning', Evaluation7(2): 211-27.
46.
Keast, R. and J. Waterhouse (2006) `Participatory Evaluation: A Missing Component in the Sustainable Social Change Equation for Public Services', Strategic Change15(1): 23-35.
47.
Khan, M.A. (1998) `Evaluation Capacity Building: An Overview of Current Status, Issues and Options', Evaluation4(3): 310-28.
48.
King, J.A. (1998) `Making Sense of Participatory Evaluation Practice' , New Directions for Evaluation80: 57-67.
49.
Kirkhart, K.E. (2000) `Reconceptualizing Evaluation Use: An Integrated Theory of Influence', New Directions for Evaluation88: 5-23.
50.
Lawrenz, F. and D. Huffman (2003) `How can Multi-Site Evaluations be Participatory?' , American Journal of Evaluation24(4): 471-82.
51.
Lennie, J. (2005) `An Evaluation Capacity-Building Process for Sustainable Community IT Initiatives: Empowering and Disempowering Impacts', Evaluation11(4): 390-414.
52.
Levin-Rozalis, M. and B. Rosenstein (2005) `The Changing Role of the Evaluator in the Process of Organizational Learning', Canadian Journal of Program Evaluation20(1): 81-104.
53.
Lick, D.W. (2006) `A New Perspective on Organizational Learning: Creating Learning Teams', Evaluation and Program Planning29(1): 88-96.
54.
Limerick, D., R. Passfield and B. Cunnington (1994) `Transformational Change: Towards an Action Learning Organization', The Learning Organization: An International Journal1: 29-40.
55.
Lines, R. (2005) `How Social Accounts and Participation during Change Affect Organizational Learning', Journal of Workplace Learning17(3): 157-77.
56.
Mcintyre, A., N. Chatzopoulos, A. Politi and J. Roz (2007) `Participatory Action Research: Collective Reflections on Gender, Culture, and Language', Teaching and Teacher Education23(5): 748-56.
57.
McKie, L. (2003) `Rhetorical Spaces: Participation and Pragmatism in the Evaluation of Community Health Work', Evaluation9(3): 307-24.
58.
Macrì, D.M., M.R. Tagliaventi and F. Bertolotti (2002) `A Grounded Theory for Resistance to Change in a Small Organization', Journal of Organizational Change Management15: 292-310.
59.
Mark, M.M. and G.T. Henry (2004) `The Mechanisms and Outcomes of Evaluation Influence' , Evaluation10(1): 35-57.
60.
Marra, M. (2000) `How Much Does Evaluation Matter? Some Examples of the Utilization of the Evaluation of the World Bank's Anti-Corruption Activities' , Evaluation6(1): 22-36.
61.
Nicolini, D. and M.B. Meznar (1995) `The Social Construction of Organizational Learning: Conceptual and Practical Issues in the Field', Human Relations48(7): 727-46.
62.
Owen, J.M. and F.C. Lambert (1995) `Roles for Evaluation in Learning Organizations' , Evaluation1(2): 237-50.
63.
Papineau, D. and M.C. Kiely (1996) `Participatory Evaluation in a Community Organization: Fostering Stakeholder Empowerment and Utilization', Evaluation and Program Planning19: 79-93.
64.
Patton, M.Q. (1997) Utilization-Focused Evaluation: The New Century Text, 3rd edn. Thousand Oaks, CA: SAGE.
65.
Patton, M.Q. (1998) `Discovering Process Use', Evaluation4(2): 225-33.
66.
Preskill, H. and V. Caracelli (1997) `Current and Developing Conceptions of Use: Evaluation Use TIG Survey Results', American Journal of Evaluation18(1): 209-25.
67.
Preskill, H., B. Zuckerman and B. Matthews (2003) `An Exploratory Study of Process Use: Findings and Implications for Future Research', American Journal of Evaluation24(4): 423-42.
68.
Preskill, H.S. and R.T. Torres (1999) `Building Capacity for Organizational Learning through Evaluative Inquiry', Evaluation5(1): 42-60.
69.
Quaghebeur, K., J. Masschelein and H.H. Nguyen (2004) `Paradox of Participation: Giving or Taking Part?' , Journal of Community and Applied Social Psychology14(3): 154-65.
70.
Rebien, C.C. (1996) `Participatory Evaluation of Development Assistance: Dealing with Power and Facilitative Learning', Evaluation2(2): 151-71.
71.
Rebolloso, E., B. Fernandez-Ramirez and P. Canton (2005) `The Influence of Evaluation on Changing Management Systems in Educational Institutions', Evaluation11(4): 463-79.
72.
Robinson, T.T. and J.B. Cousins (2004) `Internal Participatory Evaluation as an Organizational Learning System: A Longitudinal Case Study', Studies in Educational Evaluation30(1): 1-22.
73.
Rosenstein, B. and M. Levin-Rozalis (2002) `Program Evaluation and Organization Learning: A Theoretical Perspective', 5th biennial conference of the EES, Seville, Spain.
74.
Russ-Eft, D., R. Atwood and T. Egherman (2002) `Use and Non-Use of Evaluation Results: Case Study of Environmental Influences in the Private Sector', American Journal of Evaluation23(1): 19-31.
75.
Sanders, J. R. (ed.) (1994) The Program Evaluation Standards: Joint Committee on Standards for Educational Evaluation. London: SAGE.
76.
Schwandt, T.A. (1997) `Evaluation as Practical Hermeneutics', Evaluation3(1): 69-83.
77.
Schwandt, T.A. (2001) `Understanding Dialogue as Practice', Evaluation7(2): 228-37.
78.
Shulha, L.M. and J.B. Cousins (1997) `Evaluation Use: Theory, Research, and Practice since 1986', American Journal of Evaluation18(1): 195-208.
79.
Smith, M.L. (2006) `Social Capital and Intentional Change: Exploring the Role of Social Networks on Individual Change Efforts', Journal of Management Development25(7): 718-31.
80.
Smith, N.L. (2007) `Empowerment Evaluation as Evaluation Ideology' , American Journal of Evaluation28(2): 169-78.
81.
Springett, J. (2001a) `Appropriate Approaches to the Evaluation of Health Promotion', Critical Public Health11(2): 139-51.
82.
Springett, J. (2001b) `Participatory Approaches to Evaluation in Health Promotion', in I. Rootman, M. Goodstadt, B. Hyndman , et al. (eds) Evaluation in Health Promotion: Principles and Perspectives, pp. 83-105. Copenhagen: World Health Organization.
83.
Stubbs, M. and M. Lemon (2001) `Learning to Network and Networking to Learn: Facilitating the Process of Adaptive Management in a Local Response to the UK's National Air Quality Strategy', Environmental Management27(3): 321-34.
84.
Symon, G. (2005) `Exploring Resistance from a Rhetorical Perspective' , Organization Studies26(11): 1641-63.
85.
Taut, S. and D. Brauns (2003) `Resistance to Evaluation: A Psychological Perspective' , Evaluation9(3): 247-64.
86.
Taylor, D. (2005) `Governing through Evidence: Participation and Power in Policy Evaluation', Journal of Social Policy34(4): 601-18.
87.
Themessl-Huber, M.T. and M.A. Grutsch (2003) `The Shifting Locus of Control in Participatory Evaluations', Evaluation9(1): 92-111.
88.
Thoenig, J.-C. (2000) `Evaluation as Usable Knowledge for Public Management Reforms', Evaluation6(2): 217-29.
89.
Torres, R.T. and H. Preskill (2001) `Evaluation and Organizational Learning: Past, Present, and Future', American Journal of Evaluation22(3): 387-95.
90.
Weaver, L. and J.B. Cousins (2004) `Unpacking the Participatory Process', Journal of Multidisciplinary Evaluation1: 19-40.
91.
Weiss, C.H. (1998) `Have we Learned Anything New About the Use of Evaluation?', American Journal of Evaluation19(1): 21-33.
92.
Wenger, E. and W. Snyder (2000) `Communities of Practice: The Organizational Frontier' , Harvard Business Review (Jan.-Feb.): 139-45.
93.
Zajac, G. and J.G. Bruhn (1999) `The Moral Context of Participation in Planned Organizational Change and Learning', Administration Society30(6): 706-33.
