This article considers the role of context in ‘theory-based’ evaluations, particularly those that use chain-type path or logic models. Reflecting on the use of causal models in the school professional development field, a set of underlying features of context is developed: the article proposes that context can be dynamic, agentic, relational, historically located, immanent and complex. These features are applied to a consideration of a commonly observed contextual factor: senior leader support for an intervention. The article argues that actively considering these underlying features can allow for a more sophisticated approach to context and concludes with a set of related interrogatory questions for evaluators, aiming to improve learning in future evaluation.
AllenTDEbyLTLentzE (2006) Mentorship behaviors and mentorship quality associated with formal mentoring programs: Closing the gap between research and practice. Journal of Applied Psychology91(3): 567–78.
2.
AstburyBLeeuwFL (2010) Unpacking black boxes: Mechanisms and theory building in evaluation. American Journal of Evaluation31(3): 363–81.
3.
AuW (2007) High-stakes Testing and curricular control: A qualitative metasynthesis. Educational Researcher36(5): 258–67.
4.
BallSJ (2003) The teacher’s soul and the terrors of performativity. Journal of Education Policy18(2): 215–28.
5.
BlameyAMackenzieM (2007) Theories of change and realistic evaluation: Peas in a pod or apples and oranges. Evaluation13(4): 439–55.
6.
BourdieuP (1993) Sociology in Question. London: SAGE.
7.
ChenH-T (1990) Theory-Driven Evaluations. Newbury Park, CA: SAGE.
8.
ClarkeDHollingsworthH (2002) Elaborating a model of teacher professional growth. Teaching and Teacher Education18(8): 947–76.
9.
ColdwellM (2016) Career orientations and career cultures: individual and organisational approaches to beginning teachers’ careers. Teachers and Teaching: Theory and Practice22(5): 610–624.
10.
ColdwellM (2017) Exploring the influence of professional development on teacher careers: A path model approach. Teaching and Teacher Education61: 189–198.
11.
ColdwellMSimkinsT (2011) Level models of continuing professional development evaluation: A grounded review and critique. Professional Development in Education37(1): 143–157.
12.
ConnellJKubischA (1998) Applying a theory of change approach to the evaluation of comprehensive community initiatives: Progress, prospects and problems. In: Fulbright-AndersonKKubischAConnellJ (eds) New Approaches to Evaluating Community Initiatives: Theory, Measurement, and Analysis, vol. 2. Washington, DC: Aspen Institute, 1–13.
13.
ConnellJKubischASchorrLet al. (1995) New Approaches to Evaluating Community Initiatives: Concepts, Methods and Contexts, vol. 2. Washington, DC: Aspen Institute.
14.
CronbachL (1982) Designing Evaluations of Educational and Social Programs. San Francisco, CA: Jossey-Bass.
15.
DayCGuQ (2010) The New Lives of Teachers. London: Routledge.
16.
DesimoneL (2009) Improving impact studies of teachers’ professional development: Toward better conceptualizations and measures. Educational Researcher38(3): 181–99.
17.
Easterby-SmithM (1994) Evaluating Management Development, Training and Education. Brookfield, VT: Gower.
18.
FitzpatrickJL (2012) An introduction to context and its role in evaluation practice. New Directions for Evaluation135: 7–24.
GuskeyTR (1999) Evaluating Professional Development. London: Corwin Press.
21.
GuskeyTR (2002) Professional development and teacher change. Teachers and Teaching8(3): 381–91.
22.
HallDT (2002) Careers In and Out of Organizations. Glenview, IL: Scott Foreman.
23.
HargreavesALiebermanAFullanMet al. (eds) (2014) International Handbook of Educational Change: Part Two. London: Springer.
24.
HarrisADayCHopkinsDet al. (2013) Effective Leadership for School Improvement. London: Routledge.
25.
HeifetzRAGrashowALinskyM (2009) The Practice of Adaptive Leadership: Tools and Tactics for Changing Your Organization and the World. Cambridge, MA: Harvard Business Press.
26.
HubermanM (1995) Professional careers and professional development: Some intersections. In: GuskeyTRHubermanM (eds) Professional Development in Education: New Paradigms and Practices. New York: Teachers College Press, 193–224.
27.
KirkpatrickD (1998) Evaluating Training Programmes: The Four Levels, 2nd edn.San Francisco, CA: Berrett-Koehler.
28.
KünzleBKolbeMGroteG (2010) Ensuring patient safety through effective leadership behaviour: A literature review. Safety Science48(1): 1–17.
29.
LeithwoodKLevinB (2005) Assessing School Leadership and Leadership Programme Effects on Pupil Learning. Nottingham: Department for Education and Skills.
30.
MasonPBarnesM (2007) Constructing theories of change: Methods and sources. Evaluation13(2): 151–70.
31.
OpferVDPedderD (2011) Conceptualizing teacher professional learning. Review of Educational Research81(3): 376–407.
32.
PawsonR (2002) Evidence-based policy: The promise of realist synthesis. Evaluation8(3): 340–58.
33.
PawsonR (2013) The Science of Evaluation: A Realist Manifesto. London: SAGE.
34.
PawsonR (2016) The ersatz realism of critical realism: A reply to Porter. Evaluation22(1): 49–57.
PollittCBouckaertG (2011) Public Management Reform: A Comparative Analysis-new Public Management, Governance, and the Neo-Weberian State. Oxford: Oxford University Press.
37.
ReayD (2004) ‘It’s all becoming a habitus’: Beyond the habitual use of habitus in educational research. British Journal of Sociology of Education25(4): 431–44.
38.
RogDJ (2012) When background becomes foreground: Toward context-sensitive evaluation practice. New Directions for Evaluation135: 25–40.
39.
RogersP (2008) Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation14(1): 29–48.
40.
RogersPHacsiTPetrosinoAet al. (eds) (2000) Program Theory in Evaluation: Challenges and Opportunities. San Francisco, CA: Jossey-Bass.
41.
ScrivenM (1994) The fine line between evaluation and explanation. Evaluation Practice15: 75–7.
42.
SikesPMeasorLWoodsP (1985) Teacher Careers: Crises and Continuities. London: Falmer Press.
43.
SimkinsTColdwellMClosePMorganA (2009) Outcomes of in-school leadership development work: a study of three NCSL programmes. Educational Management Administration & Leadership37(1): 29–50.
44.
SmethemL (2007) Retention and intention in teaching careers: Will the new generation stay?Teachers and Teaching: Theory and Practice13(5): 465–480.
45.
StameN (2004) Theory-based evaluation and types of complexity. Evaluation10(1): 58–76.
46.
StufflebeamDL (1983) The CIPP model for programme evaluation. In: MadausGScrivenMStufflebeamDL (eds) Evaluation Models: Viewpoints on Educational and Human Services Evaluation. Boston, MA: Kluwer-Nijhoff, 279–318.
47.
VanderkruikRMcPhersonME (2017) A contextual factors framework to inform implementation and evaluation of public health initiatives. American Journal of Evaluation38(3): 348–59.
48.
WaltonM (2014) Applying complexity theory: A review to inform evaluation design. Evaluation and Program Planning45: 119–126.
49.
WaltonM (2016) Expert views on applying complexity theory in evaluation: Opportunities and barriers. Evaluation22(4): 410–23.
50.
Webster-WrightA (2009) Reframing professional development through understanding authentic professional learning. Review of Educational Research79(2): 702–39.
51.
WeissCH (1995) Nothing as practical as good theory: Exploring theory-based evaluation for comprehensive community initiatives for children and families. New Approaches to Evaluating Community Initiatives1: 65–92.
52.
YuklG (2006) Leadership in Organizations, 6th edn.Upper Saddle River, NJ: Pearson Prentice Hall.
