In this article we discuss the evaluation of a particular type of health promotion programme where social change is a central theme of programme development, implementation and evaluation. Evaluation of social change programmes requires a politics of accountability and a utilization focus. These require a process of planning evaluations that mirrors the process of programme planning and implementation. Such an approach must be open to the possibility that the demands on evaluation research may change over the lifecycle of the programme. We propose an evaluability assessment framework as a participatory tool for planning evaluations that meet the need for credible evaluative accounts of social change and contribute to social change. This framework is a tool that can be used at any time to plan and review evaluations.
AlcockP., and ChristensenL. (1995) ‘In and Against the State: Community-based Organisations in Britain and Denmark in the 1990s’, Community Development Journal30(2): 110–20.
2.
BaloghR. (1996) ‘Exploring the Role of Localities in Health Commissioning: A Review of the Literature’, Social Policy and Administration30(2): 99–113.
3.
BergJ. A. (1999) ‘Gaining Access to Underresearched Populations in Women's Health Research’, Health Care for Women International20(3): 237–43.
4.
BlackwellB. L., and CartwrightL. K. (1988). Program Consultation with Human Services Programs: A Clinical Perspective.Oakland, CA: Third Party Publishing.
5.
BriskinL. (1999) ‘Mapping Women's Organizing in Sweden and Canada: Some Thematic Considerations’, in BriskinL., EliassonM. (eds) Women's Organizing and Public Policy in Canada and Sweden, pp. 3–47. Montreal, QC: McGill-Queen's University Press.
6.
CasebeerA., and ThurstonW. E. (1995) ‘Evaluability Assessment in Health Care: An Example of the Patient Care and Outcome Proces's’, Canadian Journal of Program Evaluation10(1): 89–102.
7.
CastellsM. (1997). The Power of Identity.Oxford: Blackwell.
8.
ChelimskyE. (1995) ‘Politics, Policy and Research Synthesis’, Evaluation1(1): 97–104.
9.
ChenH. T. (1990). Theory-driven Evaluation.Newbury Park, CA: Sage.
10.
DonaldsonC., and GerardK. (1993). Economics of Health Care Financing: The Visible Hand.London: Macmillan.
11.
DuranP., MonnierE., and SmithA. (1995) ‘Evaluation à la française: Towards a New Relationship between Social Science and Public Action’, Evaluation1(1): 45–63.
12.
FawcettS. B., Paine-AndrewsA., FranciscoV. T., SchultzJ. A., RichterK. P., LewisR. K., WilliamsE. L., HarrisK. J., BerkleyJ. Y., FisherJ. L., and LopezC. M. (1995) ‘Using Empowerment Theory in Collaborative Partnerships for Community Health and Development’, American Journal of Community Psychology23(5): 677–9.
13.
FettermanD. M., KaftarianS. J., and WandersmanA. (1996). Empowerment Evaluation: Knowledge and Tools for Self-assessment and Accountability.Thousand Oaks, CA: Sage.
14.
FinneH., LevinM., and NilssenT. (1995) ‘Trailing Research: A Model for Useful Program Evaluation’, Evaluation1(1): 11–31.
15.
GrahamK., and BoisC. (1997) ‘The Complexity of Roles in Community Action Projects: The Example of the Evaluation of “Alternatives”’, Evaluation and Program Planning20(4): 432–42.
16.
GreeneJ.C., BenjaminL., and GoodyearL. (2001) ‘The Merits of Mixed Methods’, Evaluation7(1): 25–44.
17.
GregoryA. (2000) ‘Problematizing Participation: A Critical Review of Approaches to Participation in Evaluation Theory’, Evaluation6(2): 179–99.
18.
GubaE. G., and LincolnY. S. (1989). Fourth Generation Evaluation.Beverly Hills, CA: Sage.
19.
HancockL., Sanson-FisherR. W., RedmanS., BurtonR., BurtonL., ButlerJ., GirgisA., GibberdR., HensleyM., McClintockA., ReidA., SchofieldM., TripodiT., and WalshR. (1997) ‘Community Action for Health Promotion: A Review of Methods and Outcomes 1990–1995’, American Journal of Preventive Medicine13(4): 229–39.
20.
KellyK. J., and van VlaenderenH. (1996) ‘Dynamics of Participation in a Community Health Project’, Social Science & Medicine42(9): 1235–46.
21.
KnutillaM. (1998) ‘The State and Social Issues: Theoretical Considerations’, in AntonyW., and SamuelsonL. (eds) Power and Resistance: Critical Thinking About Canadian Social Issues, pp. 9–28. Halifax, NS: Fernwood Publishing.
22.
KowalskyL. O., VerhoefM. J., ThurstonW. E., and RutherfordG. E. (1996) ‘Guidelines for Entry into an Aboriginal Community’, The Canadian Journal of Native Studies16(2): 267–82.
23.
LedwithM. (1997). Participating in Transformation: Towards a Working Model of Community Empowerment.Birmingham: Venture Press.
24.
LichtermanP. (1998) ‘What do Movements Mean? The Value of Participant Observation’, Qualitative Sociology21(4): 401–18.
25.
LoveA. (1991). Internal Evaluation: Building Organizations from Within.London: Sage.
26.
McQueenD. V. (2001) ‘Strengthening the Evidence Base for Health Promotion’, Health Promotion International16(3): 261–8.
27.
MillsC. W. (1959). The Sociological Imagination.New York: Oxford University Press.
28.
MohrL. B. (1995). Impact Analysis for Program Evaluation, 2nd edn. Thousand Oaks, CA: Sage.
29.
O'NeillM. (1998) ‘Appropriate Methodological Attitudes for Conducting Health Promotion Research: A Perspective’, in ThurstonW. E., SieppertJ. D., and WeibeV. J. (eds) Doing Health Promotion Research: The Science of Action, pp. 15–27. Calgary, AB: Health Promotion Research Group.
30.
PattonM. Q. (1997). Utilization Focused Evaluation: The New Century Text.Beverly Hills, CA: Sage.
31.
PerkinsD. D. (1995) ‘Speaking Truth to Power: Empowerment Ideology as Social Intervention and Policy’, American Journal of Community Psychology23(5): 765–94.
32.
PollettaF. (1998) ‘Contending Stories: Narrative in Social Movements’, Qualitative Sociology21(4): 419–46.
33.
PotvinL. (1996) ‘Methodological Challenges in Evaluation of Dissemination Programs’, Canadian Journal of Public Health87(2): S79–S83.
34.
PotvinL., HaddadS., and FrohlichK. (2001) ‘Beyond Process and Outcome Evaluation: A Comprehensive Approach for Evaluating Health Promotion Programmes’, in RootmanI., GoodstadtM., HyndmanB., McQueenD. V., PotvinL., SpringettJ., and ZiglioE. (eds) Evaluation in Health Promotion: Principles and Perspectives, Regional Publication, European Series, No. 92. Copenhagen: World Health Organization.
35.
RamaliuA., and ThurstonW. E. (forthcoming) ‘Evaluability Assessment of a Survivors of Torture Program: Lessons Learned’, Canadian Journal of Program Evaluation.
36.
RazackS. H. (1998). Looking White People in the Eye: Gender, Race and Culture in Courtrooms and Classrooms.Toronto, ON: University of Toronto Press.
37.
RistockJ. L., and PennellJ. (1996). Community Research as Empowerment: Feminist Links, Postmodern Interruptions.Toronto, ON: Oxford University Press.
38.
RootmanI., GoodstadtM., PotvinL., and SpringettJ. (2001) ‘A Framework for Health Promotion Evaluation’, in RootmanI., GoodstadtM., HyndmanB., McQueenD. V., PotvinL., SpringettJ., ZiglioE. (eds) Evaluation in Health Promotion: Principles and Perspectives, Regional Publication, European Series, No. 92, pp. 45–62. Copenhagen: World Health Organization.
39.
RossiP. H., and FreemanH. E. (1989). Evaluation: A Systematic Approach.Newbury Park, CA: Sage.
40.
RutmanL., ed. (1977). Evaluation Research Methods: A Basic Guide.Beverly Hills, CA: Sage.
41.
ScottC. M., ThurstonW. E., and CrowB. A. (2002) ‘Development of Healthy Public Policy: Feminist Analysis of Conflict, Collaboration and Social Change’, Health Care for Women International23(6): 530–9.
42.
TaylorV. (1998) ‘Feminist Methodology in Social Movements Research’, Qualitative Sociology21(4): 357–79.
43.
ThoenigJ. C. (2000) ‘Evaluation as Usable Knowledge for Public Management Reforms’, Evaluation6(2): 217–29.
44.
ThurstonW. E., CrowB. A., and ScottC. M. (1998). The Role of Women's Organizations in Health Policy Development, Implementation and Dissemination.Ottawa, ON: Health Canada.
45.
ThurstonW. E., VollmanA. R., BurgessM. M (2003) ‘Ethical Review of Health Promotion Program Evaluation Proposals’, Health Promotion Practice4(1): 45–50.
46.
van der EykenW., GouldenD., and CrossleyM. (1995) ‘Evaluating Educational Reform in a Small State: A Case Study of Belize, Central America’, Evaluation1(1): 33–44.
47.
VanderPlaatM. (1995) ‘Beyond Technique: Issues in Evaluating for Empowerment’, Evaluation1(1): 81–96.
48.
WallersteinN. (1993) ‘Empowerment and Health: The Theory and Practice of Community Change’, Community Development Journal28(3): 218–27.
49.
WhaitesA. (1996) ‘Let's Get Civil Society Straight: NGOs and Political Theory’, Development in Practice6(3): 240–4.
50.
World Health Organization (1986). Ottawa Charter for Health Promotion.Geneva: World Health Organization.
51.
World Health Organization Working Group on Health Promotion Evaluation (1998). Health Promotion Evaluation: Recommendations to Policymakers.Geneva: World Health Organization.
