There are relatively few published accounts of the effectiveness of outdoor therapeutic programs. Most outdoor programs report favourable outcomes, yet few undertake a methodologically sound program evaluation. Application of a more rigorous evaluation method could improve the contribution that many programs could make to the evidence base regarding the effects and outcomes of outdoor programs. In recognition of this, we propose a practical and rigorous evaluation method that has been successfully trialled in Australia. The model was founded on four key principles: measurement of relevant concepts; from a range of informants; at meaningful time points; and with rigorous data collection procedures. The model proposed is suitable for diverse programs and utilises a form of individual goal attainment scaling in a mixed method design, with strategies for maximising data available from small samples. For program organisers who are not well versed in issues of evaluation design, this model, and the example described, will assist in developing and conducting an evaluation. More broadly, this article aims to inform future outcome evaluations of specialist programs.
Get full access to this article
View all access options for this article.
References
1.
AgateS.T., & CoveyC.D.2007, ‘Family camps: an overview of benefits and issues of camps and programs for families’, Child and Adolescent Psychiatric Clinics of North America, vol. 16, no. 4, pp. 921–937.
2.
BermanD.S., & Davis-BermanJ.2000, Therapeutic uses of outdoor education, ERIC Digest, ERIC Document Reproduction Service No. ED448011, ERIC Clearinghouse on Rural Education and Small Schools, Charleston, West Virginia, viewed 27 January 2012, <http://www.ericdigests.org/2001-3/outdoor.htm>.
3.
BushK., KivlahanD.R., McDonellM.B., FihnS.D., & BradleyK.A.1998, The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking, Ambulatory Care Quality Improvement Project (ACQUIP), Alcohol Use Disorders Identification Test, Archives Internal Medicine, vol. 158, no. 16, pp. 1789–1795.
4.
CasonD., & GillisH.1994, ‘A meta-analysis of outdoor adventure programming with adolescents’, Journal of Experiential Education, vol. 17, no. 1, pp. 40–47.
5.
CrispS.1997, International models of best practice in wilderness and adventure therapy: implications for Australia, 1996 Churchill Fellowship Report, Australian Winston Churchill Memorial Trust, Braddon, ACT.
6.
CrispS.2004, ‘Envisioning the birth of a profession: a blueprint of evidence based, ethical, best practice’, in BandoroffS, & NewesS (eds), Coming of age: the evolving field of adventure therapy, Association for Experiential Education, Boulder, Colorado.
Davis-BermanJ.L., & BermanD.1994a, Wilderness therapy: foundations, theory and research, Kendall/Hunt, Dubuque, Iowa.
9.
Davis-BermanJ.L., & BermanD.1994b, ‘Wilderness therapy: two-year follow-up for the wilderness therapy program’, Journal of Experiential Education, vol. 17, no. 1, pp. 48–50.
10.
Davis-BermanJ., BermanD., & CaponeL.1994, ‘Therapeutic wilderness programs: a national survey’, Journal of Experiential Education, vol. 17, no. 2, pp. 49–52.
11.
FrieseG., HendeeJ.C., & KinzigerM.1998, ‘The wilderness experience program industry in the United States: characteristics and dynamics’, Journal of Experiential Education, vol. 21, no. 1, pp. 40–45.
12.
GillisH.L., & SpeelmanE.2008, ‘Are challenge (ropes) courses an effective tool? A meta-analysis’, Journal of Experiential Education, vol. 31, no. 2, pp. 111–135.
13.
GillisH.L., & ThomsenD.1996, ‘A research update (1992-1995) of adventure therapy: challenge activities and ropes courses, wilderness expeditions, and residential camping programs’, Coalition for Education in the Outdoors Symposium Proceedings, Bradford Woods, Indiana University, Martinsville, Illinois, viewed 3 March 2012, <http://leegillis.com/AT/PDF/Gillis_Thomsen_CEO_96.pdf>.
14.
HansT.A.2000, ‘A meta-analysis of the effects of adventure programming on locus of control’, Journal of Contemporary Psychotherapy, vol. 30, no. 1, pp. 33–60.
15.
HattieJ., MarshH., NeillJ., & RichardsG.1997, ‘Adventure education and outward bound: out-of-class experiences that make a lasting difference’, Review of Educational Research, vol. 67, no. 1, pp. 43–87.
16.
HyerL., BoydS., SchurfieldR., SmithD., & BurkeJ.1996, ‘Outward bound as an adjunct to in-patient PTSD treatment of war veterans’, Journal of Clinical Psychology, vol. 53, no. 3, pp. 263–278.
17.
KiresukT.J., & ShermanR.E.1968, ‘Goal attainment scaling: a general method for evaluating comprehensive community mental health programs’, Community Mental Health Journal, vol. 4, no. 6, pp. 443–453.
18.
LambieI.H., SeymourL., SimmondsF., RobsonM., & HoulahanC.2000, ‘Using wilderness therapy in treating adolescent sexual offenders’, Journal of Sexual Aggression, vol. 5, no. 2, pp. 99–117.
19.
LovibondS.H., & LovibondP.F.1995, Manual for the depression anxiety stress scales, 2nd edn, Psychology Foundation, Sydney.
20.
McClungS.B.1984, ‘A rock-climbing program as therapy for the chronically mentally ill’, Educat. D. dissertation, Dissertations and Theses: Full Text (Publication No. AAT 8416170), Northern Arizona University, Arizona.
21.
NewesS.L.2001, ‘Future directions in adventure-based therapy research: methodological considerations and design suggestions’, Journal of Experiential Education, vol. 24, no. 2, pp. 92–99.
22.
PawlowskiM.H., GwiliH., & JulianR.1993, ‘Wilderness therapy for psychiatric disorder’, Mental Health in Australia, vol. 5, no. 1, pp. 8–14.
23.
PropstD.B., & KoeslerR.A.1998, ‘Bandura goes outdoors: role of self-efficacy in the outdoor leadership development process’, Leisure Sciences, vol. 20, pp. 319–344.
24.
RussellK.C., & FarnumJ.2004, ‘A concurrent model of the wilderness therapy process’, Journal of Adventure Education and Outdoor Learning, vol. 4, no. 1, pp. 39–55.
25.
RussellK.C., & HendeeJ.C.2000, Outdoor behavioral healthcare: definitions, common practice, expected outcomes and a nationwide survey of programs, Technical Report No. 26, Idaho Forest, Wildlife and Range Experiment Station, Moscow, Idaho.
26.
SchusterT.L., KesslerR.C., & AseltineR.H.Jr1990, ‘Supportive interactions, negative interactions, and depressed mood’, American Journal of Community Psychology, vol. 18, no. 3, pp. 423–438.
27.
SchwarzerR., & JerusalemM.1995, ‘Generalized self-efficacy scale’, in WeinmanJ, WrightS, & JohnstonM (eds), Measures in health psychology: A user's portfolio—causal and control beliefs, NFER-Nelson, Windsor, UK.
WilsonS.J., & LipseyM.W.2000, ‘Wilderness challenge programs for delinquent youth: a meta analysis of outcome evaluations’, Evaluation and Program Planning, vol. 23, no. 1, pp. 1–12.
