Sage Journals: Discover world-class research

Abstract

This article describes an attempt to evaluate the transition systems change initiative under trying but typical circumstances. Given a large number of geographically dispersed sites, each with quite different goals, activities, and impacts, the evaluators were charged with the task of describing and assessing the impact of the entire initiative. Though each of the funded sites were conducting their own evaluations, the scope and focus of these evaluations varied greatly. The evaluation described in this paper was designed to assess the common impacts and unique accomplishments of this array of projects, making maximum use of existing data and minimizing the burden on project directors for new data collection. The design was participatory, involving project directors in planning the evaluation, reporting and reflecting on their own project impact, and validating the evaluation findings. It is hoped that the design of the evaluation might be applicable to similar large scale, multi-site initiatives.

Get full access to this article

View all access options for this article.

References

Banathy, B. (1995). Developing a system view of education. Educational Technology, May-June, 53-57.

Blank, R. (1993). Developing a system of educational indicators: Selecting, implementing, and reporting indicators. Educational Evaluation and Policy Analysis, 15 (1), 65-80.

Burstein, L. , & Winters, L. (1994). Workshop on models for collecting and using opportunity to learn at the state level. Albuquerque, NM.

Clune, W. (1993). The best path to systemic educational policy: Standard/centralized or differentiated/decentralized? Educational Evaluation and Policy Analysis, 15 (3), 233-254.

Cohen, D. (1995). What is the system in systemic reform? Educational Researcher, 24 (9), 11-17,31.

Craig, J. , & Pankratz, R. (1996). Evaluating broad-based educational reform innovations using a concerns based adoption model approach. Paper presented at the Annual Meeting of the American Evaluation Association , Atlanta, GA.

DeStefano, L. (1996). The use of key informants and cross case analysis in an evaluation of statewide systems change. Paper presented at the Annual Meeting of the American Evaluation Association , Atlanta, GA.

DeStefano, L. , Hasazi, S. , Cobb, B. , Johnson, D. , Guy, B. , & Schriner, K. (April 1995). Issues in the evaluation of a multisite federal systems change initiative. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.

Elmore, R. (1987). Instruments and strategy in public policy. Policy Studies Reuiew, 7, 174-186.

10.

Furney, K. , Hasazi, S. , & DeStefano, L. (1997). Transition policies, practices, and promises: Lessons from three states. Exceptional Children, 63 (3), 343-355.

11.

Heck, D. , & Webb, N. (1996). Purposes and issues of systemic evaluation in education as reflected in current evaluations and literature. National Institute for Science Education, University of Wisconsin. Unpublished manuscript.

12.

Holder, H. , Treno, A. , Saltz, R. , & Grube, J. (1997). Summing up: Recommendations and experiences for evaluation of community-level prevention programs. Evaluation Review, 21 (2), 268-278.

13.

Parsons, B. (1996). Developing a theory-based approach to evaluating systemic reform in education and social service systems. Paper presented at the annual meeting of the American Evaluation Association , Atlanta, GA.

14.

Ridgeway, J. (1997). Systemic reform: Issues in evaluation and modeling . Unpublished manuscript.

15.

Rowland, G. (1994). Designing and evaluating: Creating futures and appreciating error. Educational Technology, January, 10-22.

16.

Shavelson, R. , & Webb, N. (1995). On getting it right. Educational Evaluation and Policy Analysis, 17 (3), 275-279.

17.

Snauwaert, D. , & DeStefano, L. (1990). A comparative analysis of state level transition planning. In F. Rusch (Ed.), Supported Employment: Models, Methods, and Issues (pp. 409-425). Champaign, IL: Sycamore Press.

18.

Wegenke, G. (1994). Reflections on systemic change in the Des Moines Public Schools. Studies in Educational Evaluation, 20, 69-86.

19.

Weiss, C. (1975). Evaluation research in a political context. In E. Struening and M. Guttentag (Eds.), Handbook of Evaluation Research, Beverly Hills, CA: Sage.

Issues in the Evaluation of a Multi-site Federal Systems Change Initiative

Abstract

Get full access to this article

References