Multi-site evaluations are becoming increasingly common in federal funding portfolios. Although much thought has been given to multi-site evaluation, there has been little emphasis on how it might interact with participatory evaluation. Therefore, this paper reviews several National Science Foundation educational, multi-site evaluations for the purpose of examining the extent to which these evaluations are participatory. Based on this examination, the paper proposes a model for implementing multi-site, participatory evaluation.
Get full access to this article
View all access options for this article.
References
1.
Baizerman, M., Compton, D., & Stockdill, S. (2002). New directions for ECB. In D. Compton, M. Baizerman, & S. Stockdill (Eds.), The art, craft, and science of evaluation capacity building (pp. 109-120). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 93.
2.
Boruch, R. (1991). Sharing confidential and sensitive data. In J. E. Sieber (Ed.), Sharing social science data: Advantages and challenges. Thousand Oaks, CA: Sage.
3.
Burke, B. (1998). Evaluating for a change: Reflections on participatory methodology. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation (pp. 43-56). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 80.
4.
Cook, J., Carey, M., Razzano, L., Burke, J., & Blyler, C. (2002). The pioneer: The employment intervention demonstration program. In J. Herrell & R. Straw (Eds.), Conducting multiple site evaluations in real-world settings (pp. 31-44). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 94.
5.
Cousins, J., & Whitmore, E. (1998). Framing participatory evaluation. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation (pp. 5-24). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 80.
6.
Fetterman, D. (1997). Empowerment evaluation: A response to Patton and Scriven. Evaluation Practice, 18, 253-266.
7.
Feuer, M., Towne, L., & Shavelson, R. (2002). Scientific culture and educational research. Educational Researcher, 31(8), 4-14.
8.
Hamilton, L., McCaffrey, D., Stecher, B., Klein, S., Bobyn, A., & Bugliari, D. (2003). Studying large-scale reforms of instructional practice: An example from mathematics and science. Educational Evaluation and Policy Analysis, 25(1), 1-29.
9.
King, J. (1998). Making sense of participatory evaluation practice. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation (pp. 57-68). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 80.
10.
Leff, H., & Mulkern, V. (2002). Lessons learned about science and participation from multisite evaluations. In J. Herrell & R. Straw (Eds.), Conducting multiple site evaluations in real-world settings (pp. 89-100). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 94.
11.
Mowbray, C., & Herman, S. (1991). Using multiple sites in mental health evaluations: Focus on program theory and implementation issues. In R. Turpin & J. Sinacore (Eds.), Multisite evaluations (pp. 45-58). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 50.
12.
Nightingale D., & Rossman S. (1994). Managing field data collection from start to finish. In J. Wholey, H. Hatry, & K. Newcomer (Eds.), Handbook of practical program evaluation (pp. 350-373). San Francisco, CA: Jossey-Bass.
Patton, M. (1997b). Of vacuum cleaners and toolboxes: A response to Fetterman’s response. Evaluation Practice, 18, 267-270.
15.
Scriven, M. (1997). Comments on Fetterman’s response. Evaluation Practice, 18, 271-272.
16.
Sinacore, J., & Turpin, R. (1991). Multiple sites in evaluation research: A survey of organizational and methodological issues. In R. Turpin & J. Sinacore (Eds.), Multisite evaluations (pp. 5-18). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 50.
17.
Straw, R., & Herrell, J. (2002). A framework for understanding and improving multi-site evaluations. In J. Herrell & R. Straw (Eds.), Conducting multiple site evaluations in real-world settings (pp. 5-16). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 94.
18.
Stufflebeam, D. (1994). Empowerment evaluation, objectivist evaluation and evaluation standards: Where the future of evaluation should not go and where it needs to go. Evaluation Practice, 15, 321-338.
19.
Whitmore, E. (1998). Final commentary. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation (pp. 95-99). San Francisco, CA: Jossey-Bass. New Directions for Evaluation, 80.
