Problematic Phrases in the Conclusions of Published Outcome Studies

Abstract

Objective: This study examined the extent to which conclusions of published outcome studies contain phrases that could be misconstrued as implying more empirical support than is warranted. Methods: All articles (N = 138) reporting outcome studies from 2000 to 2005 in two social work research journals and two topical database searches were assessed regarding research design, findings, and wording of conclusions. Substantial interrater agreement was indicated by kappa values of .95 for research design, 1.00 for nature of findings, and .70 for wording of conclusions. Results: Of the articles, 70% used designs that do not warrant making conclusive causal inferences, and 60% of articles with those designs contained phrases that could be misconstrued or exploited as implying an inflated evidence-based status. Conclusion: To prevent evidence-based practice from becoming a meaningless shibboleth, authors, reviewers, and editors should become vigilant in avoiding wording that could be misconstrued as implying more empirical support than is warranted.

Keywords

evidence-based practice research practice implementation

Get full access to this article

View all access options for this article.

References

American Psychological Association. (2006). PsycINFO coverage list. Retrieved April 23, 2006, from http://www.apa.org/psycinfo/about/covlist.pdf

Austin, D.M. (1999). A report on progress in the development of research resources in social work. Research on Social Work Practice , 9, 673-707.

Casselman, B. (1972). On the practitioner's orientation toward research . Smith College Studies in Social Work, 42, 211-233.

Chwalisz, K. (2003). Evidence-based practice: A framework for twenty-first-century scientific-practitioner training. The Counseling Psychologist , 31, 497-528.

Gibbs, L. , & Gambrill, E. (2002). Evidence-based practice: Counter-arguments to objections. Research on Social Work Practice, 12, 452-476.

Glisson, C. (1995). The state of art of social work research: Implications for mental health. Research on Social Work Practice, 5, 205-222.

Gordon-Garofalo, V.L. , & Rubin, A. (2004). Evaluation of a psychoeducational group for seronegative partners and spouses of persons with HIV/AIDS. Research on Social Work Practice, 14, 14-26.

Jenson, J.M. (2005). Connecting science to intervention: Advances, challenges, and the promise of evidence-based practice. Social Work Research, 29, 131-135.

Kirk, S.A. , & Fischer, J. (1976). Do social workers understand research? Journal of Education for Social Work, 12, 63-67.

10.

Kirk, S.A. , & Reid, W.J. (2002). Science and social work practice. New York: Columbia University Press.

11.

Messer, S.B. (2006). What qualifies as evidence in effective practice? Patient values and preferences. In J. C. Norcross , L. E. Beutler , & R. F. Levant (Eds.), Evidence-based practices in mental health: Debate and dialogue on the fundamental questions (pp. 31-40). Washington, DC: American Psychological Association .

12.

Mullen, E.J. , & Streiner, D.L. (2004). The evidence for and against evidence-based practice. Brief Treatment and Crisis Intervention , 4, 111-121.

13.

Norcross, J.C. , Beutler, L.E. , & Levant, R.F. (2005). Evidence-based practices in mental health. Washington, DC: American Psychological Association .

14.

Reed, G.M. (2006). What qualifies as evidence of effective practice? Clinical expertise. In J. C. Norcross , L. E. Beutler , & R. F. Levant (Eds.), Evidence-based practices in mental health: Debate and dialogue on the fundamental questions (pp. 13-23). Washington, DC: American Psychological Association.

15.

Rosen, A. (2003). Evidence-based social work practice: Challenges and promise. Social Work Research, 27, 197-208.

16.

Rosen, A. , Proctor, E.K. , Marrow-Howell, N. , & Staudt, M. (1995). Rationales for practice decisions: Variations in knowledge use by decision task and social work service. Research on Social Work Practice, 5, 501-523.

17.

Rosenblatt, A. (1968). The practitioner's use and evaluation of research . Social Work, 13, 53-59.

18.

Rubin, A. , & Parrish, D. (2007). Views of evidence-based practice among faculty in MSW programs: A national survey. Research on Social Work Practice, 17, 110-122.

19.

Sackett, D.L. , Straus, S.E. , Richardson, W.S. , Rosenberg, W. , & Haynes, R.B. (2000). Evidence-based medicine: How to practice and teach EBP (2nd ed.). New York: Churchill-Livingstone.

20.

Shlonsky, A. , & Gibbs, L. (2004). Will the real evidence-based practice please stand up? Teaching the process of evidence-based practice to the helping professions . Brief Treatment and Crisis Intervention, 4(2), 137-153.

21.

Task Force on Social Work Research. (1991). Building social work knowledge for effective services and policies: A plan for research development. Washington, DC: Institute for the Advancement of Social Work Research.

22.

Thyer, B. (2004). What is evidence-based practice? Brief Treatment and Crisis Intervention, 4, 167-176.

23.

Westen, D.I. (2006). Patients and treatments in clinical trials are not adequately representative of clinical practice. In J. C. Norcross , L. E. Beutler , & R. F. Levant (Eds.), Evidence-based practices in mental health: Debate and dialogue on the fundamental questions (pp. 161-171). Washington, DC: American Psychological Association .

24.

Zlotnik, J.L. , & Galambos, C. (2004). Evidence-based practices in health care: Social work possibilities. Health and Social Work, 29, 259-261.