While participatory evaluation (PE) constitutes an important trend in the field of evaluation, its ontology has not been systematically analyzed. As a result, the concept of PE is ambiguous and inadequately theorized. Furthermore, no existing instrument accurately measures stakeholder participation. First, this article attempts to overcome these problems by using the works of G. Goertz (2006) and J. Gerring (1999) on concept formation and evaluation to assess current conceptualizations of PE. Second, an amended version of the framework developed by J. B. Cousins and E. Whitmore (1998) is proposed as an alternative to current conceptualizations. This amended framework is then operationalized and adapted in a participation measurement instrument. The proposed conceptualization and instrument have the potential to contribute to the production of sound empirical knowledge about evaluation and to reflections on PE practice.
American Evaluation Association. (2004). Guiding principles for evaluators. Fairhaven, MA: AEA.
2.
Babbie, E.R., & Benaquisto, L. (2002). Fundamentals of social research (1st Canadian ed.). Scarborough, Ontario: Nelson Thomson Learning.
3.
Brunner, I., & Guzman, A. ( 1989). Participatory evaluation: A tool to assess projects and empower people. New Directions for Program Evaluation, 42, 9-18.
4.
Burke, B. ( 1998). Evaluating for a change: Reflections on participatory methodology. New Directions for Evaluation, 80, 43-56.
5.
Butterfoss, F.D., Francisco, V., & Capwell, E.M. ( 2001). Stakeholder participation in evaluation. Health Promotion Practice, 2, 114-119.
6.
Christie, C.A. ( 2003). What guides evaluation? A study of how evaluation practice maps onto evaluation theory. New Directions for Evaluation , 97, 7-35.
7.
Cousins, J.B. ( 2001). Do evaluator and program practitioner perspective converge in collaborative evaluation? Canadian Journal of Program Evaluation , 16, 113-133.
8.
Cousins, J.B. ( 2003). Utilization effects of participatory evaluation. In T. Kellaghan & D. L. Stufflebeam (Eds.), International handbook of educational evaluation (Vol. 9, pp. 245-265). Dordrecht, The Netherlands: Kluwer Academic.
9.
Cousins, J.B. ( 2005). Will the real empowerment evaluation please stand up? A critical friend perspective. In D. M. Fetterman & A. Wandersman (Eds.), Empowerment evaluation in practice (pp. 183-208). New York: Guilford Press.
10.
Cousins, J.B., Donohue, J.J., & Bloom, G.A. ( 1996). Collaborative evaluation in North America: Evaluators’ self-reported opinions, practices and consequences. Evaluation Practice, 17, 207-226.
11.
Cousins, J.B., & Earl, L.M. ( 1992). The case for participatory evaluation. Educational Evaluation and Policy Analysis, 14, 397-418.
12.
Cousins, J.B., & Earl, L.M. ( 1995). Participatory evaluation in education: What do we know? Where do we go? In J. B. Cousins & L. M. Earl (Eds.), Participatory evaluation in education: Studies in evaluation use and organizational learning (pp. 159-180). London: Falmer Press.
13.
Cousins, J.B., & Earl, L.M. ( 1999). When the boat gets missed: Response to M. F. Smith. American Journal of Evaluation, 20, 309-317.
14.
Cousins, J.B., & Whitmore, E. ( 1998). Framing participatory evaluation. New Directions for Evaluation, 80, 5-23.
15.
Daniels, N. ( 2003). Reflective equilibrium. The Stanford encyclopedia of philosophy (Summer 2003 ed.). Retrieved May 23, 2008, from http://plato.stanford.edu/entries/reflective-equilibrium/
Gerring, J. ( 1999). What makes a concept good? A criterial framework for understanding concept formation in the social sciences. Polity , 31, 357-393.
18.
Goertz, G. ( 2006). Social science concepts: A user’s guide. New Jersey: Princeton University Press.
19.
Greene, J.C. ( 1987). Stakeholder participation in evaluation design: Is it worth the effort? Evaluation and Program Planning, 10, 379-394.
20.
Greene, J.C. ( 2005). Stakeholders. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 397-398). Thousand Oaks, CA: Sage.
21.
Gregory, A. ( 2000). Problematizing participation: A critical review of approaches to participation in evaluation theory. Evaluation, 6, 179-199.
22.
Huberman, M. ( 1995). The many modes of participatory evaluation. In J. B. Cousins & L. M. Earl (Eds.), Participatory evaluation in education: Studies in evaluation use and organizational learning (pp. 103-111). London: Falmer Press.
23.
Jackson, E.T., & Kassam, Y. ( 1998). Introduction. In E. T. Jackson & Y. Kassam (Eds.), Knowledge shared: Participatory evaluation in development cooperation (pp. 1-20). Ottawa, ON/West Hartford, CT: International Development Research Centre/Kumarian Press.
24.
Jacob, S. ( 2005). Réflexions autour d’une typologie des dispositifs institutionnels d’évaluation [Reflections around a typology of evaluation institutional mechanisms]. Canadian Journal of Program Evaluation, 20, 49-68.
25.
King, J.A. ( 2005). Participatory evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 291-294). Thousand Oaks, CA: Sage.
26.
King, J.A. ( 2007). Making sense of participatory evaluation. New Directions for Evaluation, 114, 83-86.
27.
Mark, M.M. ( 2001). Evaluation’s future: Furor, futile, or fertile?American Journal of Evaluation, 22, 457-479.
28.
Mathie, A., & Greene, J.C. ( 1997). Stakeholder participation in evaluation: How important is diversity? Evaluation and Program Planning, 20, 279-285.
29.
Mathison, S. (Ed.). (2005). Encyclopedia of evaluation. Thousand Oaks, CA: Sage.
30.
McAllister, K. ( 1999). Understanding participation: Monitoring and evaluating process, outputs and outcomes. Ottawa, ON: International Development Research Centre.
31.
Murray, R. ( 2002). Citizens’ control of evaluations: Formulating and assessing alternatives. Evaluation, 8, 81-100.
32.
O’Sullivan, R.G., & D’Agostino, A. (2002). Promoting evaluation through collaboration: Findings from community-based programs for young children and their families. Evaluation, 8, 372-387.
33.
Ragin, C.C. ( 2000). Fuzzy-set social science. University of Chicago Press.
34.
Rebien, C.C. ( 1996). Participatory evaluation of development assistance: Dealing with power and facilitative learning. Evaluation, 2, 151-171.
35.
Ridde, V. ( 2006). Suggestions d’améliorations d’un cadre conceptuel de l’évaluation participative [Suggestions for improving a conceptual framework for participatory evaluation]. Canadian Journal of Program Evaluation, 21, 1-23.
Singleton, R., Straits, B.C., & Straits, M.M. ( 1993). Approaches to social research (2nd ed.). New York: Oxford University Press.
38.
Smith, N.L. ( 1993). Improving evaluation theory through the empirical study of evaluation practice. American Journal of Evaluation, 14, 237-242.
39.
Themessl-Huber, M.T., & Grutsch, M.A. ( 2003). The shifting locus of control in participatory evaluations . Evaluation, 9, 92-111.
40.
Torres, R.T., Stone, S.P., Butkus, D.L., Hook, B.B., Casey, J., & Arens, S.A. ( 2000). Dialogue and reflection in a collaborative evaluation: Stakeholder and evaluator voices. New Directions for Evaluation , 85, 27-38.
41.
VanderPlaat, M., Samson, Y., & Raven, P. ( 2001). The politics and practice of empowerment evaluation and social interventions: Lessons from the Atlantic Community Action Program for Children regional evaluation. Canadian Journal of Program Evaluation, 16, 79-98.
42.
Weaver, L., & Cousins, J.B. ( 2004). Unpacking the participatory process [Electronic Version] . Journal of MultiDisciplinary Evaluation (JMDE), 1, 19-40. Retrieved July 15, 2008, from http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/144/159
43.
Weiss, C.H. ( 1983). The stakeholder approach to evaluation: Origins and promise . New Directions for Program Evaluation, 17, 3-14.
44.
Weiss, C.H. ( 1986). The stakeholder approach to evaluation: Origins and promise . In E. R. House (Ed.), New directions in educational evaluation (pp. 145-157). London: Falmer Press.
45.
Weiss, C.H. ( 1998). Evaluation: Methods for studying programs and policies (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
46.
Whitmore, E. ( 1998). Editor’s notes. New Directions for Evaluation, 80, 1-3.
