Developmental evaluation can often question the ethical basis of an intervention in terms of whether it’s ‘doing the right thing’ rather than merely ‘doing things right’. Drawing on ideas from critical systems thinking and critical systems heuristics, an evaluation framework with a pro-equity focus is suggested. The framework addresses issues of complexity. It invites theories of change associated with philosophical ethics, and provides a means of surfacing and potentially transforming debilitating relations of power in a complex evaluand. A case study of the long-standing Narmada project in India is used to sketch the workings of the framework. The article describes how the underpinning methodological ideas of critical systems thinking incorporating triple-loop learning can enhance the practice of developmental evaluation.
AckoffRLPourdehnadJ (2001) On misdirected systems. Systems Research and Behavioural Science18: 199–205.
2.
ArmsonR (2011) Growing Wings on the Way: Systems Thinking for Messy Situations. Axminster: Triarchy Press.
3.
BambergerMSegoneM (eds) (2012) Evaluation for Equitable Development Results. New York: UNICEF.
4.
ChecklandPPoulterJ (2006) Learning For Action: A Short Definitive Account of Soft Systems Methodology, and its Use Practitioners, Teachers and Students. Chichester: John Wiley.
5.
ChurchmanCW (1979) The Systems Approach and its Enemies. New York: Basic Books.
6.
ConnellJKubischAC (1998) Applying a theory of change approach to the evaluation of comprehensive community initiatives: progress, prospects, and problems. In: Fulbright-AndersonKKubischACConnellJP (eds) New Approaches to Evaluating Community Initiatives. Volume 2: Theory, Measurement, and Analysis. Washington, DC: The Aspen Institute, 15–44.
7.
Des JardinsJR (2001) Environmental Ethics: An Introduction to Environmental Philosophy. Belmont, CA: Wadsworth.
ForssKMarraMSchwartzR (eds) (2011) Evaluating the Complex: Attribution, Contribution and Beyond: Comparative Policy Evaluation. New Brunswick, NJ: Transaction Publishers.
10.
FreedenM (1991) Rights. Milton Keynes: Open University Press.
11.
GreeneJC (2001) Dialogue in evaluation: a relational perspective. Evaluation7(2): 181–7.
12.
HummelbrunnerR (2011) Systems thinking and evaluation. Evaluation17(4): 395–403.
13.
HummelbrunnerRReynoldsM (2013) Systems thinking, learning and values in evaluation. Evaluation Connections: Newsletter of the European Evaluation Society, June2013.
14.
MidgleyG (2007) Systems thinking for evaluation. In: WilliamsBImamI (eds), Systems Concepts in Evaluation: An Expert Anthology. Point Reyes, CA: Edgepress, 11–34.
15.
OesterleA (2002) Evaluating equity in social policy: a framework for comparative analysis. Evaluation8(1): 46–59.
PattonMQ (2010) Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. New York: Guilford Press.
18.
PattonMQ (2012) Developmental evaluation for equity-focused evaluations. In: BambergerMSegoneM (eds), Evaluation for Equitable Development Results. New York: UNICEF, 102–14.
ReynoldsM (2007) Evaluation based on critical systems heuristics. In: WilliamsBImamI (eds), Systems Concepts in Evaluation: An Expert Anthology. Point Reyes, CA: EdgePress, 101–22.
21.
ReynoldsM (2008) Getting a grip: a critical systems framework for corporate responsibility. Systems Research and Behavioural Science25(3): 383–95.
22.
ReynoldsM (2009) Environmental ethics. In: ReynoldsMBlackmoreCSmithM (eds), The Environmental Responsibility Reader. London, New York and Milton Keynes: Zed Books and the Open University, 40–51.
23.
ReynoldsM (2011) Critical thinking and systems thinking. In: HorvathCForteJM (eds), Critical Thinking. New York: Nova Science Publishers, 37–68.
24.
ReynoldsMHolwellS (2010) Introducing systems approaches. In: ReynoldsMHolwellS (eds), Systems Approaches to Managing Change. London: Springer and The Open University, 1–23.
25.
ReynoldsMWilliamsB (2012) Systems thinking and equity-focused evaluations. In: BambergerMSegoneM (eds), Evaluation for Equitable Development Results. New York: UNICEF. URL: http://oro.open.ac.uk/30711/
26.
RoyA (1999) The Cost of Living. London: Flamingo (Harper Collins).
27.
SenA (1981) Poverty and Famines: An Essay on Entitlement and Deprivation. Oxford: Clarendon Press.
28.
SenA (2009) The Idea of Justice. Cambridge, MA: Harvard University Press.
29.
ShivaV (2002) Water Wars: Privatization, Pollution, and Profit. New Delhi: India Research Press.
30.
UlrichW (1983) Critical Heuristics of Social Planning: A New Approach to Practical Philosophy. Chichester: John Wiley.
31.
UlrichW (1996) A Primer to Critical Systems Heuristics for Action Researchers. Hull: University of Hull.
32.
UlrichW (2003) Beyond methodology choice: critical systems thinking as critically systemic discourse. Journal of the Operational Research Society54(4): 325–42.
33.
UlrichWReynoldsM (2010) Critical systems heuristics. In: ReynoldsMHolwellS (eds), Systems Approaches to Managing Change. London: Springer and The Open University, 243–92.
34.
WilliamsB (2013) Three core concepts: inter-relationships, perspectives, boundaries. Evaluation Connections: Newsletter of the European Evaluation Society, June2013.
35.
World Commission on Dams (2000) Dams and Development: A New Framework for Decision-making: the Report of the World Commission on Dams, November 2000. London: Earthscan.
