Taking stock of complexity in evaluation: A discussion of three recent publications

Barnes M Matka E Sullivan H (2003) Evidence, understanding and complexity: Evaluation in non-linear systems. Evaluation 9(3): 265–84.

Bartels J (1987) Kennis, geschiedenis, objectiviteit. Een filosofische reflectie op enkele ontwikkelingen in de wetenschapstheorie [Knowledge, history, objectivism: a philosophical reflection on certain developments in the theory of sciences]. Groningen: Konstapel.

Bolinska A (2013) Epistemic representation, informativeness and the aim of faithful representation. Synthese 190(2): 219–34.

Byrne DS (1998) Complexity Theory and the Social Sciences: An Introduction. Abingdon: Routledge.

Byrne DS (2013) Evaluating complex social interventions in a complex world. Evaluation 19(3): 217–28.

Byrne DS Callaghan G (2014) Complexity Theory and the Social Sciences: The State of the Art. London: Routledge.

Callaghan G (2008) Evaluation and negotiated order: Developing the application of complexity theory. Evaluation 14(4): 399–411.

Castellani B (2009) Map of the complexity sciences. Art & Science Factory. Available at: http://www.art-sciencefactory.com/complexity-map_feb09.html

Checkland P (1981) Systems Thinking, Systems Practice. New York: Wiley.

Chettiparamb A (2006) Metaphors in complexity theory and planning. Planning Theory 5(1): 71–91.

Colander D Kupers R (2014) Complexity and the Art of Public Policy: Solving Society’s Problems from the Bottom Up. Princeton, NJ: Princeton University Press.

Davies R (2004) Scale, complexity and the representation of theories of change. Evaluation 10(1): 101–21.

Ehrlich PR Raven PH (1964) Butterflies and plants: A study in coevolution. Evolution 18(4): 586–608.

Epstein JM (2008) Why model? Journal of Artificial Societies and Social Simulation 11(4): 12. Available at: http://jasss.soc.surrey.ac.uk/11/4/12.html.

Flood RL (1999) Rethinking the Fifth Discipline: Learning Within the Unknowable. London: Routledge.

Forrester JW (1971) World Dynamics. Cambridge: Wright-Allen Press.

Forss K Marra M Schwartz R (eds) (2011) Evaluating the Complex: Attribution, Contribution, and Beyond. New Brunswick, NJ: Transaction Publishers.

François C (1999) Systemics and cybernetics in a historical perspective. Systems Research and Behavioral Science 16(3): 203–19.

Funnell SC Rogers PJ (2011) Purposeful Program Theory: Effective Use of Theories of Change and Logic Models. San Francisco, CA: Jossey-Bass.

Gerrits LM (2012) Punching Clouds: An Introduction to the Complexity of Public Decision-Making. Litchfield Park, AZ: Emergent Publications.

Gerrits LM Marks PK (2014) How fitness landscapes help further the social and behavioral sciences. Emergence: Complexity & Organization 16(3): 1–17.

Gunderson LH Holling CS (eds) (2002) Panarchy: Understanding Transformations in Human and Natural Systems. Washington, DC: Island Press.

Hargreaves MB Podems D (2012) Advancing systems thinking in evaluation: A review of four publications. American Journal of Evaluation 33(3): 462–70.

Juarrero A Rubino CA (eds) (2010) Emergence, Complexity, and Self-organization: Precursors and Prototypes. Litchfield Park, AZ: Emergent Publications.

Knuuttila T (2011) Modelling and representing: An artefactual approach to model-based representation. Studies in History and Philosophy of Science Part A 42(2): 262–71.

McKelvey B (1999) Complexity theory in organization science: Seizing the promise or becoming a fad? Emergence 1(1): 5–32.

Marion R (1999) The Edge of Organization: Chaos and Complexity Theories of Formal Social Systems. Thousand Oaks, CA: SAGE.

Mitchell M (2009) Complexity: A Guided Tour. Oxford: Oxford University Press.

Morell JA (2010) Evaluation in the Face of Uncertainty: Anticipating Surprise and Responding to the Inevitable. New York: The Guilford Press.

Mowles C (2014) Complex, but not quite complex enough: The turn to the complexity sciences in evaluation scholarship. Evaluation 20(2): 160–75.

Page SE (2011) Diversity and Complexity. Princeton, NJ: Princeton University Press.

Patton MQ (2011) Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. New York: The Guilford Press.

Patton MQ (2015) Book review: Evaluating the complex: attribution, contribution, and beyond. American Journal of Evaluation 36: 419–29.

Phelan SE (1999) A note on the correspondence between complexity and systems theory. Systemic Practice and Action Research 12(3): 237–45.

Prigogine I Stengers I (1984) Order Out of Chaos: Man’s New Dialogue with Nature. New York: Bantam.

Rescher N (1998) Complexity: A Philosophical Overview. New Brunswick, NJ: Transaction Publishers.

Rogers PJ (2008) Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation 14(1): 29–48.

Rogers PJ (2011) Implications of complicated and complex characteristics for key tasks in evaluation. In: Forss K Marra M Schwartz R (eds), Evaluating the Complex: Attribution, Contribution, and Beyond. New Brunswick, NJ: Transaction Publishers, 33–52.

Sanderson I (2000) Evaluation in complex policy systems. Evaluation 6(4): 433–54.

Senge PM (1990) The Fifth Discipline: The Art and Practice of the Learning Organization. New York: Doubleday Currency.

Simon HA (1962) The architecture of complexity. Proceedings of the American Philosophical Society 106(6): 467–82.

Stacey RD (1992) Managing the Unknowable: Strategic Boundaries between Order and Chaos in Organizations. San Francisco, CA: Jossey-Bass.

Stacey RD (2012) Tools and Techniques of Leadership and Management: Meeting the Challenge of Complexity. London: Routledge.

Swoyer C (1991) Structural representation and surrogative reasoning. Synthese 87(3): 449–508.

Verweij S (2015) Once the Shovel Hits the Ground: Evaluating the Management of Complex Implementation Processes of Public-Private Partnership Infrastructure Projects with Qualitative Comparative Analysis. Rotterdam: Erasmus University Rotterdam.

Verweij S Gerrits LM (2013) Understanding and researching complexity with qualitative comparative analysis: Evaluating transportation infrastructure projects. Evaluation 19(1): 40–55.

Vesterby V (2008) Origins of Self-organization: Emergence and Cause. Goodyear, AZ: ISCE Publishing.

Von Bertalanffy L (1968) General System Theory. Foundations, Development, Applications. New York: George Braziller.

Waldrop MM (1992) Complexity: The Emerging Science at the Edge of Order and Chaos. New York: Simon & Schuster Paperbacks.

Walton M (2014) Applying complexity theory: A review to inform evaluation design. Evaluation and Program Planning 45: 119–26.

Westhorp G (2012) Using complexity-consistent theory for evaluating complex systems. Evaluation 18(4): 405–20.

Westley F Zimmerman B Patton M (2007) Getting to Maybe: How the World Is Changed. Toronto: Vintage Canada

Williams B Hummelbrunner R (2010) Systems Concepts in Action: A Practitioner’s Toolkit. Stanford, CA: Stanford University Press.

Wolf-Branigin M (2013) Using Complexity Theory for Research and Program Evaluation. Oxford: Oxford University Press.

Zimmerman B Lindberg C Plsek P (1998) Edgeware: Lessons from Complexity Science for Health Care Leaders. London: V H A, Incorporated.