There are few high-quality studies using randomized controlled trials (RCTs) in the adventure and wilderness therapy literature. Thus, a unison call is heard for more such studies to be carried out. This article presents a Norwegian wilderness therapy research project that planned to incorporate this “gold standard” that is regarded as the most scientific and rigorous approach available. We did not succeed. Mounting challenges led us to discard the RCT altogether and select other methodologies. Here, we account for the ethical, health outcome, practical, and empirical obstacles that we encountered when attempting to randomize at-risk adolescents into experiment and control groups. Our conclusion is that although RCTs may be superior in some aspects, they hold the potential to become bad science when the interventions are as complex and multi-faceted as adventure and wilderness therapy programs.
BeckerS. P. (2010). Wilderness therapy: Ethical considerations for mental health professionals. Child & Youth Care Forum, 39, 47-61.
2.
BermanD.Davis-BermanJ. (2013). The role of therapeutic adventure in meeting the mental health needs of children and adolescents: Finding a niche in the health care systems of the United States and the United Kingdom. Journal of Experiential Education, 36, 51-64.
3.
BowenD. J.NeillJ. T. (2013). A meta-analysis of adventure therapy outcomes and moderators. The Open Psychology Journal, 6, 28-53.
4.
ClarkJ. P.MarmolL. M.CooleyR.GathercoalK. (2004). The effects of wilderness therapy on the clinical concerns (on Axes I, II, and IV) of troubled adolescents. Journal of Experiential Education, 27, 213-232.
5.
FerneeC. R.GabrielsenL. E.AndersenA. J. W.MeselT. (2015). Therapy in the open air. Introducing wilderness therapy to the adolescent mental health services in Scandinavia, 2, e14.
6.
GassM. A.GillisH. L.RussellK. C. (2012). Adventure therapy: Theory, research, and practice. New York, NY: Routledge.
7.
GelmanA. (2006). Multilevel (hierarchical) modeling: What it can and cannot do. Technometrics, 48, 432-435.
8.
GrossmanJ.MackenzieF. K. (2005). The randomized controlled trial: Gold standard or merely standard?Perspectives in Biology and Medicine, 48, 516-534.
9.
HackingI. (2000). The social construction of what?Cambridge, MA: Harvard University Press.
10.
HarperN. J. (2010). Future paradigm or false idol: A cautionary tale of evidence-based practice for adventure education and therapy. Journal of Experiential Education, 33, 38-55.
11.
HendersonB.VikanderN. (2007). Nature first: Outdoor life the friluftsliv way. Toronto, Ontario, Canada: Natural Heritage Books.
NortonC. L.TuckerA.RussellK. C.BettmannJ. E.GassM. A.GillisH. L.BehrensE. (2014). Adventure therapy with youth. Journal of Experiential Education, 37, 46-59.
14.
PalinkasL. A. (2014). Qualitative and mixed methods in mental health services and implementation research. Journal of Clinical Child & Adolescent Psychology, 43, 851-861.
15.
RidgeN. W.WarrenJ. S.BurlingameG. M.WellsM. G.TumblinK. M. (2009). Reliability and validity of the Youth Outcome Questionnaire Self-Report. Journal of Clinical Psychology, 65, 1115-1126.
16.
ShadishW. R.CookT. D.CampbellD. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
17.
SpielbergerC. D.GorsuchR. L.LusheneR.VaggP. R.JacobsG. A. (1983). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press.
18.
SpiritoA.StantonC.DonaldsonD.BoergersJ. (2002). Treatment-as-usual for adolescent suicide attempters: Implications for the choice of comparison groups in psychotherapy research. Journal of Clinical Child & Adolescent Psychology, 31, 41-47.
19.
ThistlethwaiteD. L.CampbellD. T. (1960). Regression-discontinuity analysis: An alternative to the ex post facto experiment. The Journal of Educational Psychology, 51, 309-317.
20.
WaddellC.GodderisR. (2005). Rethinking evidence-based practice for children’s mental health. Evidence-Based Mental Health, 8, 60-62.
21.
WilsonS. J.LipseyM. W. (2000). Wilderness challenge programs for delinquent youth: A meta-analysis of outcome evaluations. Evaluation and Program Planning, 23, 1-12.
22.
WolffN. (2000). Using randomized controlled trials to evaluate socially complex services: Problems, challenges and recommendations. The Journal of Mental Health Policy and Economics, 3, 97-109.
