This article discusses the design of a comprehensive evaluation of a community development programme for young people 'at-risk' of self-harming behaviour. It outlines considerations in the design of the evaluation and focuses on the complexities and difficulties associated with the evaluation of a community development programme. The challenge was to fulfil the needs of the funding body for a broad, outcome-focused evaluation while remaining close enough to the programme to accurately represent its activities and potential effects at a community level. Specifically, the strengths and limitations of a mixed-method evaluation plan are discussed with recommendations for future evaluation practice.
Abatena, H. (1997) 'The Significance of Planned Community Participation in Problem Solving and Developing a Viable Community Capability', Journal of Community Practice4(2): 13-34.
2.
Bogenschneider, K. (1996) An Ecological Risk/Protective Theory for Building Prevention Programmes, Policies, and Community Capacity to Support Youth', Family Relations45: 127-138.
3.
Butterfoss, F. D. , R. M. Goodman and A. Wandersman (1993) 'Community Coalitions for Prevention and Health Promotion', Health Education Research8: 315-330.
4.
Chavis, D. M. and G. M. H. Pretty (1999) 'Sense of Community: Advances in Measurement and Application', Journal of Community Psychology27 (6): 635-642.
5.
Checkoway, B. (1998) 'Involving Young People in Neighbourhood Development', Children and Youth Services Review20(9-10): 765-795.
6.
Chelimsky, E. (1997) 'The Coming Transformations in Evaluation', in E. Chelimsky and W. R. Shadish (eds) Evaluation for the 21st Century: A Handbook. Thousand Oaks, CA: Sage.
7.
Chen, H. (1997) 'Applying Mixed Methods Under the Framework of Theory-Driven Evaluations', in J. C. Greene and V. J. Caracelli (eds) Advances in Mixed-Method Evaluation: The Challenges and Benefits of Integrating Diverse Paradigms, No. 74 in the series 'New Directions for Evaluation', a publication of the American Evaluation Association. San Francisco, CA: Jossey-Bass.
8.
Cook, T. D. (1997) 'Lessons Learned in Evaluation Over the Past 25 Years', in E. Chelimsky and W. R. Shadish (eds) Evaluation for the 21st Century: A Handbook. Thousand Oaks, CA: Sage.
9.
Datta, L. (1997) 'A Pragmatic Basis For Mixed-Method Designs', in J. C. Greene and V. J. Caracelli (eds) Advances in Mixed-Method Evaluation: The Challenges and Benefits of Integrating Diverse Paradigms, No. 74 in the series 'New Directions for Evaluation', a publication of the American Evaluation Association. San Francisco, CA: Jossey-Bass.
10.
Dixon, J. and C. Sindall (1994) 'Applying Logics of Change to the Evaluation of Community Development in Health Promotion', Health Promotion International9(4): 297-309.
11.
Duignan, P. and S. Casswell (1989) 'Evaluating Community Development Programmes for Health Promotion: Problems Illustrated by a New Zealand Example', Community Health Studies13 (1): 74-81.
12.
Fawcett, S. B. , R. K. Lewis, A. Paine Andrews, V. T. Francisco, k. P. Richter, E. L. Williams and B. Copple (1997) 'Evaluating Community Coalitions for Prevention of Substance Abuse: The Case of Project Freedom', Health Education and Behaviour24(6): 812-828.
13.
Fetterman, D. M. (1996) 'Empowerment Evaluation: An Introduction to Theory and Practice', in D. M. Fetterman, S. J. Kaftarian and A. Wandersman (eds) Empowerment Evaluation: Knowledge and Tools for Self-Assessment and Accountability. Thousand Oaks, CA: Sage.
14.
Francisco, V. T. , A. L. Paine and S. B. Fawcett (1993) 'A Methodology for Monitoring and Evaluating Community Health Coalitions', Health Education Research8(3): 403-416.
15.
Goodman, R. M. , M. A. Speers, K. McLeroy, S. Fawcett, M. Kegler, E. Parker, S. Rathgeb Smith, T. D. Sterling and N. Wallerstein (1998) 'Identifying and Defining the Dimensions of Community Capacity to Provide a Basis for Measurement', Health Education and Behaviour25 (3): 258-278.
16.
Greene, J. C. and V. J. Caracelli (1997) 'Defining and Describing the Paradigm Issue in Mixed-Method Evaluation', in J. C. Greene and V. J. Caracelli (eds) Advances in Mixed-Method Evaluation.: The Challenges and Benefits of Integrating Diverse Paradigms, No. 74 in the series 'New Directions for Evaluation', a publication of the American Evaluation Association. San Francisco, CA: Jossey-Bass.
17.
Gruenewald, P. J. (1997) 'Analysis Approaches to Community Evaluation', Evaluation Review21(2): 209-230.
18.
Harrison, J. , J. Moller and S. Bordeaux (1997) 'Youth Suicide and Self-Injury, Australia', Australian Injury Prevention Bulletin, National Injury Surveillance Unit15 (March): 1-8.
19.
Hawe, P. , D. Degeling and J. Hall (1990) Evaluating Health Promotion. A Health Worker's Guide. Sydney: Maclennan and Petty.
20.
Israel, B. A. , A. J. Schulz, E. A. Parker and A. B. Becker (1998) 'Review of Community-Based Research: Assessing Partnership Approaches to Improve Public Health', Annual Review of Public Health19: 173-202.
21.
Kelly, J. G. (1990) 'Changing Contexts and the Field of Community Psychology', American Journal of Community Psychology18(6): 769-793.
22.
McLaughlin, M. J. , P. E. Leone, S. Meisel and K. Henderson (1997) 'Strengthen School and Community Capacity', Journal of Emotional and Behavioral Disorders5(1): 15-23.
23.
Mason, G. (1990) Youth Suicide in Australia: Prevention Strategies. Canberra: Department of Employment, Education and Training (Youth Bureau).
24.
Moscicki, E. K. (1995) 'Epidemiology of Suicidal Behaviour', Suicide and Life-Threatening Behaviour25(1): 22-35.
25.
Mrazek, P.J. and R. J. Haggerty (1994) Reducing the Risks for Mental Disorders: Frontiers for Preventive Intervention Research. Washington, DC: National Academy Press.
26.
Nee, D. and M. I. Mojica (1999) 'Ethical Challenges in Evaluation with Communities: A Manager's Perspective', in J. L. Fitzpatrick and M. Morris (eds) Current and Emerging Ethical Challenges in Evaluation, No. 82 in the series 'New Directions for Evaluation', a publication of the American Evaluation Association. San Francisco, CA: Jossey-Bass.
27.
Paine-Andrews, A. , K. J. Harris, S. B. Fawcett, K. P. Richter, R. K. Lewis, V. T. Francisco, J. Johnston and S. Coen (1997) 'Evaluating a Statewide Partnership for Reducing Risks for Chronic Diseases', Journal of Community Health22(5): 343-359.
28.
Patton, G. C. , R. Harris, J. B. Carlin, M. E. Hibbert, C. Coffey, M. Schwartz and G. Bowes (1997) 'Adolescent Suicidal Behaviours: A Population-Based Study of Risk', Psychological Medicine27: 715-724.
29.
Patton, M. Q. (1990) Qualitative Evaluation and Research Methods. Thousand Oaks, CA: Sage.
30.
Penuel, W. R. and T. Freeman (1997) 'Participatory Action Research in Youth Programming: A Theory in Use', Child and Youth Care Forum26(3): 175-185.
31.
Poole, D. L. (1997) 'Building Community Capacity to Promote Social and Public Health: Challenges for Universities', Health and Social Work22 (3): 163-170.
32.
Rains, J. W. and D. W. Ray (1995) 'Participatory Action Research for Community Health Promotion', Public Health Nursing12(4): 256-261.
33.
Riggin, L. J. C. (1997) 'Advances in Mixed-Method Evaluation: A Synthesis and Comment', in J. C. Greene and V. J. Caracelli (eds) Advances in Mixed-Method Evaluation: The Challenges and Benefits of Integrating Diverse Paradigms, No. 74 in the series 'New Directions for Evaluation', a publication of the American Evaluation Association. San Francisco, CA: Jossey-Bass.
34.
Sanders, J. R. (1997) 'Cluster Evaluation', in E. Chelimsky and W. R. Shadish (eds) Evaluation for the 21st Century: A Handbook. Thousand Oaks, CA: Sage.
35.
Schaffer, D. , V. Vieland, A. Garland, M. Rojas, M. Underwood and C. Busner (1990) 'Adolescent Suicide Attempters: Response to Suicide-Prevention Programmes', Journal of the American Medical Association264(24): 3151-3155.
36.
Scriven, M. (1997) 'Truth and Objectivity in Evaluation', in E. Chelimsky and W. R. Shadish (eds) Evaluation for the 21st Century: A Handbook. Thousand Oaks, CA: Sage.
37.
Shufflebeam, D. L. (1994) 'Empowerment Evaluation, Objectivist Evaluation, and Evaluation Standards: Where the Future of Evaluation Should Not Go and Where it Needs to Go', Evaluation Practice15(3): 321-338.
38.
Silverman, M. M. and R. W. Maris (1995) 'Epidemiology and Risk Factors: 1. The Prevention of Suicidal Behaviors: An Overview', Suicide and Life Threatening Behaviour25(1): 10-21.
39.
Stevenson, J. F. , R. E. Mitchell and P. Florin (1996) 'Evaluation and Self-Direction in Community Prevention Coalitions', in D. M. Fetterman, S. J. Kaftarian, and A. Wandersman (eds) Empowerment Evaluation.' Knowledge and Tools for Self-Assessment and Accountability. Thousand Oaks, CA: Sage.
40.
Vincent, M. L. , A. F. Clearie and M. D. Schluchter (1987) 'Reducing Adolescent Pregnancy Through School and Community-Based Education', Journal of the American Medical Association257: 3382-3386.
41.
Wholey, J. S. , H. Hatry and K. Newcomer (1994) Handbook of Practical Evaluation. Thousand Oaks, CA: Sage.
