With the advent of the United Nation’s 2030 Sustainable Development Agenda, and its 17 Sustainable Development Goals, there is a call for more methodologies to understand and evaluate combinations of these global challenges, their integrated nature and their complexities. Accordingly, UN Women Independent Evaluation Office along with Australian and American researchers have written and piloted a new evaluation guide: Inclusive Systemic Evaluation for Gender equality, Environments and Marginalized voices (ISE4GEMs): A new approach for the SDG era (2018). Referred to as the ‘ISE4GEMs’, this guide is an original piece of work that brings together transdisciplinary evaluation methods, re-thinks systemic evaluation methodology and introduces the Gender equality, Environments and Marginalized voices (GEMs) framework. This article provides a summary of the key theoretical concepts that have been synthesized from systems thinking, social and ecological sciences to produce process guidance.
AndersenLEVernerDWiebeltM (2017) Gender and climate change in Latin America: An analysis of vulnerability, adaptation and resilience based on household surveys. Journal of International Development29(7): 857–76.
2.
AnthiasF (2013) Hierarchies of social location, class and intersectionality: Towards a translocational frame. International Sociology28(1): 121–38.
3.
BambergerMPodemsDR (2002) Feminist evaluation in the international development context. New Directions for Evaluation2002(96): 83–96.
4.
BambergerMSegoneM (2011) How to design and manage equity-focused evaluations. Evaluation Working Paper, UNICEF, New York.
5.
BambergerMRughJMabryL (2008) Real world evaluation – Working under budget, time, data, and political constraints. Paper presented at the Prepared for the American Evaluation Association Professional Development Workshop Session.
6.
BatliwalaSPittmanA (2010) Capturing change in women’s realities. A Critical Overview of Current Monitoring & Evaluation Frameworks and Approaches. Toronto: Association for Women’s Rights in Development (AWID).
BrisolaraS (2014) Feminst theory: Its domains and applications. In: BrisolaraSSeigartDSenGuptaS (eds) Feminist Evaluation Research: Theory and Practice. London: Guilford Press, 3–41.
9.
BurnsD (2007) Systemic Action Research: A Strategy for Whole System Change. Bristol: Policy Press.
10.
BurnsDWorsleyS (2015) Navigating Complexity in International Development: Facilitating Sustainable Change at Scale. Rugby: Practical Action Publishing.
11.
ChambersR (2015) Inclusive rigour for complexity. Journal of Developmental Effectiveness7(3): 327–35.
12.
ClarkWC (2007) Sustainability science: A room of its own. Proceedings of the National Academy of Sciences104(6): 1737–8.
13.
CloverDE (1995) Gender transformative learning and environmental action. Gender and Education7(3): 243–58.
14.
CostanzaRDalyLFioramontiLet al. (2016) Modelling and measuring sustainable wellbeing in connection with the UN Sustainable Development Goals. Ecological Economics130(Supplement C): 350–5.
15.
CrenshawK (1989) Demarginalizing the intersection of race and sex: A black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum1989(1): 139–67.
16.
CrenshawK (1991) Mapping the margins: Intersectionality, identity politics, and violence against women of color. Stanford Law Review, 43: 1241–99.
EspinosaJ (2013) Moving towards gender-sensitive evaluation? Practices and challenges in international-development evaluation. Evaluation19(2): 171–82.
19.
EybenRGuijtIRocheCet al. (2015) The Politics of Evidence and Results in International Development: Playing the Game to Change the Rules?Rugby: Practical Action Publishing.
20.
FettermanDMWandersmanA (2005) Empowerment Evaluation Principles in Practice. New York: Guilford Press.
21.
FooteJAhuriri-DriscollAHepiMet al. (2016) Systemic evaluation of a community environmental management programme. Research Memorandum 97: Systemic Evaluation of a Community Environmental Management Programme. Available at: http://www2.hull.ac.uk/hubs/pdf/memorandum%2097.pdf
22.
ForssKMarraMSchwartzR (2011) Evaluating the Complex: Attribution, Contribution, and Beyond, Vol. 1. New Jersey: Transaction Publishers.
23.
FrankenbergR (1993) White Women, Race Matters: The Social Construction of Whiteness. London: Routledge.
24.
Fukuda-ParrS (2016) From the Millennium Development Goals to the Sustainable Development Goals: Shifts in purpose, concept, and politics of global goal setting for development. Gender & Development24(1): 43–52.
25.
GaglianoM (2015) In a green frame of mind: Perspectives on the behavioural ecology and cognitive nature of plants. AoB Plants7: plu075.
26.
GregoryAJ (1996) The road to integration: Reflections on the development of organizational evaluation theory and practice. Omega24(3): 295–307.
27.
GregoryAJJacksonMC (1992a) Evaluating organizations: A systems and contingency approach. Systems Practice5(1): 37–60.
28.
GregoryAJJacksonMC (1992b) Evaluation methodologies: A system for use. Journal of the Operational Research Society43(1): 19–28.
29.
GriggsDStafford-SmithMGaffneyOet al. (2013) Policy: Sustainable development goals for people and planet. Nature495(7441): 305–7.
30.
HardingSG (2004) Introduction: Standpoint theory as a site of political, philosophic, and scientific debate. In: HardingSG (ed.) The Feminist Standpoint Theory Reader: Intellectual and Political Controversies. New York: Routledge.
31.
HayK (2012) Engendering policies and programmes through feminist evaluation: Opportunities and insights. Indian Journal of Gender Studies19(2): 321–40.
32.
ICSU (2015) Review of the Sustainable Development Goals: The Science Perspective. Paris: International Council for Science (ICSU).
IsonR (2010) Systems Practice: How to Act in a Climate Change World. London: Springer Science & Business Media.
35.
IsonRL (2008) Systems thinking and practice for action research. In: ReasonPBradburyH (eds) The SAGE Handbook of Action Research Participative Inquiry and Practice (2nd edition). London: SAGE, 139–58.
36.
JacksonMC (1991) The origins and nature of critical systems thinking. Systems Practice4(2): 131–49.
37.
KaijserAKronsellA (2014) Climate change through the lens of intersectionality. Environmental Politics23(3): 417–33.
KirkhartKE (2011) Culture and influence in multisite evaluation. New Directions for Evaluation2011(129): 73–85.
40.
KirkhartKE (2015) Unpacking the evaluator’s toolbox: Observations on evaluation, privilege, equity and justice. Evaluation Matters/He To Te Aromatawai1: 7–24.
41.
LairdS (2017) Learning to live in the Anthropocene: Our children and ourselves. Studies in Philosophy and Education36(3): 265–82.
42.
LangDJWiekABergmannMet al. (2012) Transdisciplinary research in sustainability science: Practice, principles, and challenges. Sustainability Science7(1): 25–43.
43.
LiuJDietzTCarpenterSRet al. (2007a) Complexity of coupled human and natural systems. Science317(5844): 1513–16.
44.
LiuJDietzTCarpenterSRet al. (2007b) Coupled human and natural systems. AMBIO: A Journal of the Human Environment36(8): 639–49.
45.
LuYNakicenovicNVisbeckMet al. (2015) Policy: Five priorities for the UN Sustainable Development Goals-comment. Nature520(7548): 432–3.
46.
McNamaraP (2009) Feminist ethnography: Storytelling that makes a difference. Qualitative Social Work8(2): 161–77.
47.
MarraM (2011) Some insights from complexity science for the evaluation of complex policies. In: ForssKSchwartzRMarraM (eds) Evaluating the Complex: Attribution, Contribution, and Beyond. New Jersey: Transaction Publishers, 315–34.
48.
MasudaJRZupancicTPolandBet al. (2008) Environmental health and vulnerable populations in Canada: Mapping an integrated equity-focused research agenda. The Canadian Geographer52(4): 427–50.
49.
MertensDM (2009) Transformative Research and Evaluation. New York; London: Guilford Press.
50.
MertensDM (2010) Philosophy in mixed methods teaching: The transformative paradigm as illustration. International Journal of Multiple Research Approaches4(1): 9–18.
51.
MidgleyG (2000) Systemic intervention: Philosophy, Methodology, and Practice. New York: Kluwer Academic.
52.
MidgleyG (2006) Systems thinking for evaluation. In: WilliamsBImamI (eds) Systems Concepts in Evaluation: An Expert Anthology. Point Reyes: EdgePress, 11–34.
53.
MorchainDPratiGKelseyFet al. (2015) What if gender became an essential, standard element of Vulnerability Assessments?Gender & Development23(3): 481–96.
PattonMQ (2011) Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. New York: The Guilford Press.
56.
PelizzonAGaglianoM (2015) The sentience of plants: Animal rights and the rights of plants intersecting?Australian Animal Protection Law Journal11: 5–13.
57.
PerkinsEKuiperEQuiroga-MartínezRet al. (2005) Introduction: Exploring feminist ecological economics / Gender, development, and sustainability from a Latin American perspective / African peasants and global gendered class struggle for the commons / Ecofeminist political economy: Integrating feminist economics and ecological economics / Habits of thought, agency, and transformation: An institutional approach to feminist ecological economics / The network vorsorgendes wirtschaften / Engendering organic farming. Feminist Economics11(3): 107–50.
58.
PodemsD (2014a) Evaluator competencies and professionalizing the field: Where are we now. Canadian Journal of Program Evaluation28(3): 127–36.
59.
PodemsD (2014b) Feminist evaluations for nonfeminists. In: BrisolaraSSeigartDSenGuptaS (eds) Feminist Evaluation and Research: Theory and Practice. New York: Guilford Publications.
60.
PodemsDR (2010) Feminist evaluation and gender approaches: There’s a difference?Journal of MultiDisciplinary Evaluation6(14): 1–17.
61.
ReynoldsM (2014) Equity-focused developmental evaluation using critical systems thinking. Evaluation20(1): 75–95.
62.
ReynoldsMWilliamsB (2012a) Systems Thinking and Equity-focused Evaluations. New York: UNICEF.
63.
ReynoldsMWilliamsB (2012b) Systems thinking and equity-focused evaluations. In: SegoneM (ed.) Evaluation for Equitable Development Results. New York: UNICEF, 115–41.
64.
ReynoldsMGatesEHummelbrunnerRet al. (2016) Towards systemic evaluation. Systems Research and Behavioral Science33(5): 662–73.
65.
RogersPJWilliamsB (2006) Evaluation for practice improvement and organizational learning. In: ShawIGreeneJCMarkMM (eds) The Sage handbook of evaluation. London: SAGE, 76–97.
66.
RoweA (2012) Evaluation of natural resource interventions. American Journal of Evaluation33(3): 384–94.
67.
SchwandtTOfirZD’ErricoSet al. (2016a) Realising the SDGs by reflecting on the way(s) we reason, plan and act: The importance of evaluative thinking. IIED Briefing Papers. Available at: http://pubs.iied.org/pdfs/17380IIED.pdf
68.
SchwandtTOfirZLucksDet al. (2016b) Evaluation: A crucial ingredient for SDG success. IIED Briefing Papers. Available at: http://pubs.iied.org/pdfs/17357IIED.pdf
69.
SegoneM (2016) A call for action to leave no one behind. TransformMarch(6): 4–5.
70.
Sielbeck-BowenKABrisolaraSSeigartDet al. (2002) Exploring feminist evaluation: The ground from which we rise. New Directions for Evaluation2002(96): 3–8.
71.
StephensALewisEDReddySM (2018) Inclusive Systemic Evaluation for Gender equality, Environments and Marginalized voices (ISE4GEMs): A New Approach for the SDG Era. New York: UN Women.
72.
StoneSBAlmadaAAMyersSS (2017) A call for planetary health case studies. The Lancet390(10107): 2024.
73.
SudarshanMRMurthyKRChigateriS (2015) Engendering Meta-Evaluations: Towards Women’s Empowerment. New Delhi: Institute of Social Studies Trust.
74.
SwillingM (2016) Africa’s game changers and the catalysts of social and system innovation. Ecology and Society21(1): 37.
TorgglerBMurphyRFranceCet al. (2015) UNESCO’s Work on Culture and Sustainable Development Evaluation of a Policy Theme, Final Report. Available at: Internal Oversight Service Evaluation Section, UNESCO. Available at: http://unesdoc.unesco.org/images/0023/002344/234443E.pdf.
77.
UittoJI (2014a) Evaluating environment and development: Lessons from international cooperation. Evaluation: The International Journal of Theory, Research and Practice20(1): 44–57.
78.
UittoJI (2014b) Evaluating Environment in International Development. New York: Routledge.
79.
UittoJPuriJVan den BergR (eds) (2017) Evaluating Climate Change Action for Sustainable Development. New York: Springer.
80.
UlrichW (1988) Systems thinking, systems practice, and practical philosophy: A program of research. Systems Practice1(2): 137–63.
