Recognizing school improvement networks as a leading strategy for large-scale high school reform, this analysis explores developmental evaluation as an approach to examining school improvement networks as “learning systems” able to produce, use, and refine practical knowledge in large numbers of schools. Through a case study of one leading school improvement network (the New Tech Network), the analysis provides evidence of the potential power of developmental evaluation for generating formative feedback for network stakeholders regarding the strengths and weaknesses of their networks as distributed, collaborative learning systems. At the same time, it raises issues and questions to be addressed in advancing the practice of developmental evaluation, chief among them being constraints on stakeholders in leveraging feedback in productive ways.
Get full access to this article
View all access options for this article.
References
1.
AdlerP. S., & BorysB. (1996). Two types of bureaucracy: Enabling and coercive. Administrative Science Quarterly, 41(1), 61–89).
2.
AndersonT., & ShattuckJ. (2012). Design-based research: A decade of progress in education research?Educational Researcher, 41(1), 16–25).
3.
ArgyrisC., & SchönD. (1978). Organizational learning: A theory of action perspective. Reading, MA: Addison Wesley.
4.
Baden-FullerC., & WinterS. G. (2012). Replicating organizational knowledge: Principles or templates?Philadelphia, PA: University of Pennsylvania, Wharton School.
5.
BlumenfeldP., FishmanB. J., KrajcikJ. S., MarxR. W., & SolowayE. (2000). Creating usable innovations in systemic reform: Scaling up technology-embedded project-based science in urban schools. Educational Psychologist, 35(3), 149–164).
6.
BorjaR. R. (2002, May 29). Improving the practice of large-scale school reform. Education Week, 21(38), 26–31).
7.
BrewerJ. D. (2004). Ethnography. In CassellC., & SymonG. (Eds.), Essential guide to qualitative methods in organizational research (pp. 312–322)). Thousand Oaks, CA: Sage.
8.
BrykA. S. (2009). Support a science of performance improvement. Phi Delta Kappan, 90(8), 597–600).
9.
BrykA. S., GomezL. M., & GrunowA. (2010). Getting ideas into action: Building networked improvement communities in education. Stanford, CA: Carnegie Foundation for the Advancement of Teaching.
10.
CameronK. S., & SpreitzerG. M. (Ed.). (2011). The Oxford handbook of positive organizational scholarship. New York, NY: Oxford University Press.
11.
CohenD. K. (1990). A revolution in one classroom: The case of Mrs. Oublier. Educational Evaluation and Policy Analysis, 12(3), 311–329).
12.
DatnowA., & ParkV. (2009). Towards the co-construction of educational policy: Large-scale reform in an era of complexity. In PlankD., SchneiderB., & SykesG. (Eds.), Handbook of education policy research (pp. 348–361)). New York, NY: Routledge.
13.
DozoisE., LangloisM., & Blanchet-CohenN. (2010). A practitioner's guide to developmental evaluation. Montreal, Quebec, Canada: The J.W. McConnell Family Foundation.
14.
DuttonJ. E., QuinnR. E., & CameronK. S. (Ed.). (2003). Positive organizational scholarship: Foundations of a new discipline. San Francisco, CA: Berrett-Koehler.
15.
FineG. A., MorrillC., & SurianarainS. (2008). Ethnography in organizational settings. In BuchananD., & BrymanA. (Eds.), The sage handbook of organizational research methods. Thousand Oaks, CA: Sage.
16.
GambleJ. A. A. (2008). A developmental evaluation primer. Montreal, Quebec, Canada: The J.W. McConnell Family Foundation.
17.
GlazerJ. L., & PeurachD. P. (2013). School improvement networks as a strategy for large-scale education reform: The role of environments. Educational Policy, 27(4), 676–710).
18.
HaskinsR., & BaronJ. (2011). Part 6: The Obama Administration's evidence-based social policy initiatives: An overview. In PuttickR. (Ed.), Evidence for social policy and practice: Perspectives on how research and evidence can influence decision making in public services (pp. 28–35)). London, England: Nesta.
19.
HatchT. (2000). What does it take to break the mold? Rhetoric and reality in New American Schools. Teachers College Record, 102(3), 561–589).
20.
Hmelo-SilverC. E. (2004). Problem-based learning: What and how do students learn?Educational Psychologist Review, 16(3), 235–266).
21.
KrajcikJ. S., & BlumenfeldP. (2006). Project-based learning. In SawyerR.K. (Ed.), The Cambridge handbook of the learning sciences (pp. 646–684)). New York, NY: Cambridge University Press.
22.
LeeT. W. (1999). Using qualitative methods in organizational research. Thousand Oaks, CA: Sage.
23.
LenhoffS. W. (2013). Co-construction, infrastructure, and purpose: Influences on implementation of hub-outlet school reform (Unpublished doctoral dissertation). Michigan State University, East Lansing, MI.
24.
MarchJ. G. (1996). Exploration and exploitation in organizational learning. In CohenM.D., & SproullL.S. (Eds.), Organizational learning (pp. 101–123)). Thousand Oaks, CA: Sage.
25.
MehtaJ., GomezL. M., & BrykA. S. (2012). Building on practical knowledge: The key to a stronger profession is learning in the field. In MehtaJ., SchwartzR.B., & HessF.M. (Eds.), The futures of school reform (pp. 35–64)). Cambridge, MA: Harvard Education Press.
26.
MilesM. B., & HubermanA. M. (1994). Qualitative data analysis. Thousand Oaks, CA: Sage.
PattonM. Q. (2006). Evaluation for the way we work. Nonprofit Quarterly (Spring), 13, 28–33).
30.
PattonM. Q. (2010). Developmental evaluation: Applying concepts to enhance innovation and use. New York, NY: Guilford Press.
31.
PenuelW., FishmanB., ChengB. H., & SabelliN. (2011). Organizing research and development at the intersection of learning, implementation, and design. Educational Researcher, 40, 331–337).
32.
PeurachD. J., & GlazerJ. L. (2012). Reconsidering replication: New perspectives on large-scale school improvement. Journal of Educational Change, 13(2), 155–190).
33.
PeurachD. J., GlazerJ. L., & LenhoffS. W. (2016). The developmental evaluation of school improvement networks. Educational Policy, 30(4), 606–648).
34.
PeurachD. J., LenhoffS. W., & GlazerJ. L. (2012, June). Large scale high school reform through school improvement networks: Examining possibilities for “developmental evaluation.” Paper presented at the 2012 Conference of the National Center on Scaling Up Effective Schools, Nashville, TN.
35.
ScholzR. W., & TietjeO. (2002). Embedded case study methods: Integrating quantitative and qualitative Knowledge. Thousand Oaks, CA: Sage.
36.
SheddJ. B., & BacharachS. B. (1991). Tangled hierarchies: Teachers as professionals and the management of schools. San Francisco, CA: Jossey-Bass.
37.
StebbinsR. A. (2001). Exploratory research in the social sciences. Thousand Oaks, CA: Sage.
38.
ThomasJ. W. (2000). A review of research on project-based learning. Retrieved from http://www.bie.org.
39.
Van de VenA. H., PolleyD. E., GarudR., & VenkataramanS. (1999). The innovation journey. Oxford, England: Oxford University Press.
40.
YinR. K. (2009). Case study research: Design and methods (4th ed.). Thousand Oaks, CA: Sage.
