Objectives: This study investigated treatment fidelity in social work research. Method: The authors systematically reviewed all articles published in five prominent social work journals over a 5- year period. Sixty-three outcome studies were identified and reviewed for how well treatment fidelity was monitored using eight review criteria. Results: Seventy-one percent of reviewed studies defined each independent variable but more than two thirds lacked information on control measures for the interventions. Only two studies addressed all eight of the fidelity criteria, while five articles provided sufficient information on seven of the criteria. Nearly half (49%) were identified as primarily effectiveness studies. Slightly fewer (43%) were identified as efficacy studies. Conclusions: Greater attention needs to be paid to fidelity in social work intervention research.
Alkema, G.E. ( 2007). Translating research into practice: A community-based medication management intervention. ProQuest Dissertations & Theses. (UMI No. 3261791).
2.
Bellg, A.J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D.S., Ory, M., et al. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH behavior change consortium. Health Psychology, 23, 443-451.
3.
Bond, G.R., Evans, L., Salyers, M.P., Williams, J., & Kim, H. ( 2000). Measurement of fidelity in psychiatric rehabilitation . Mental Health Services Research, 2, 75-87.
4.
Calsyn, R.J. ( 2000). A checklist for critiquing treatment fidelity studies . Mental Health Services Research, 2, 107-112.
5.
Castro, F.G., Barrera, M.B., & Martinez, C.R. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5, 41-45.
6.
Chambless, D.L., & Hollon, S. ( 1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.
7.
Clarke, G.N. ( 1995). Improving the transition from basic efficacy research to effectiveness studies: Methodological issues and procedures. Journal of Consulting and Clinical Psychology, 63, 718-725.
8.
Collins, C., Harshbarger, C., Sawyer, R., & Hamdallah, M. ( 2006). The Diffusion of Effective Behavioral Interventions project: Development, implementation, and lessons learned. AIDS Education and Prevention, 18(Suppl. A), 5-20.
9.
Crits-Christoph, P., & Mintz, J. ( 1991). Implications of therapist effects for the design and analysis of comparative studies of psychotherapy. Journal of Consulting and Clinical Psychology, 59, 20-26.
10.
Drozd, J.F., & Goldfried, M.R. (1996). A critical evaluation of the state-of-the-art in psychotherapy outcome research. Psychotherapy , 33, 171-180.
11.
Farrington, D.P. ( 2003). Methodological quality standards for evaluation research . Annals of the American Academy of Political and Social Science , 587, 49-68.
12.
Fraser, M.W. ( 2004). Intervention research in social work: Recent advances and continuing challenges. Research on Social Work Practice , 14, 210-222.
13.
Fraser, M., Taylor, M., Jackson, R., & O’Jack, J. (1991). Social work and science: Many ways of knowing. Social Work Research and Abstracts, 27, 5-15.
14.
Glasgow, R.E., Lichtenstein, E., & Marcus, A.C. ( 2003). Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition . American Journal of Public Health, 93, 1261-1267.
15.
Green, L.W., & Glasgow, R.E. ( 2006). Evaluating the relevance, generalization, and applicability of research: Issues in external validation and translation methodology. Evaluation and the Health Professions, 29, 126-153.
16.
Hartman, A. ( 1990). Many ways of knowing [Editorial], Social Work, 35, 3-4.
17.
Hohmann, A.A., & Shear, M.K. ( 2002). Community-based intervention research: Coping with the ‘‘noise’’ of real life in study design. American Journal of Psychiatry, 159, 201-207.
18.
Howard, M.O., McMillen, C.J., & Pollio, D.E. ( 2003). Teaching evidence-based practice: Toward a new paradigm for social work education. Research on Social Work Practice , 13, 234-259.
19.
Hogue, A., Liddle, H.A., & Rowe, C. ( 1996). Treatment adherence process research in family therapy: A rationale and some practical guidelines. Psychotherapy: Theory, Research, Practice, & Training, 33, 332-345.
20.
Institute for Scientific Information (1997 ). Journal citation reports. Philadelphia : Author.
21.
Kazdin, A.E. ( 1986). Comparative outcome studies of psychotherapy: Methodological issues and strategies. Journal of Consulting and Clinical Psychology, 54, 95-105.
22.
McGrew, J.H., Bond, G.R., Dietzen, L.L., & Salyers, M.P. ( 1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology , 62, 670-678.
23.
Mowbray, C.T., Holter, M.C., Teague, G.B., & Bybee, D. ( 2003). Fidelity criteria: Development, measurement, and validation . American Journal of Evaluation, 24, 315-340.
24.
Moncher, F., & Prinz, R. ( 1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247-266.
25.
Mullen, E.J., Bledsoe, S.E., & Bellamy, J.L. ( 2007). Implementing evidence-based social work practice. Research on Social Work Practice, 18, 325-338.
26.
National Association of Social Workers (1999 ). Code of Ethics of the National Association of Social Workers . Washington, DC: NASW Press.
27.
Netting, F.E., & O’Connor, M.K. (2005). Teaching organization practice: A multi-paradigmatic approach source. Administration in Social Work, 29, 25-43.
28.
Ory, M.G., Evashwick, C., Glasgow, R.E., & Sharkey, J. ( 2005). Pushing the boundaries of evidence-based research: Enhancing the application and sustainability of health promotion programs in diverse populations. Enhancing the application and sustainability of health promotion programs. Edinburgh, UK: Elsevier .
29.
Persons, J.B. ( 1991). Psychotherapy outcome studies do not accurately represent current models of psychotherapy: A proposed remedy. American Psychologist, 46, 99-106.
30.
Persons, J.B. ( 2005). Empiricism, mechanism, and the practice of cognitive-behavior therapy. Behavior Therapy, 36, 107-118.
31.
Proctor, E.K. ( 2007). Implementing evidence-based practice in social work education: Principles, strategies, and partnerships. Research on Social Work Practice, 17, 583-593.
32.
Reid, W.J., & Fortune, A.E. ( 2003). Empirical foundations for practice guidelines in current social work knowledge. In A. Rosen & E. K. Proctor (Eds.), Developing practice guidelines for social work interventions: Issues, methods, and research agenda (pp. 59-79). New York: Columbia University Press.
33.
Rosen, A., Proctor, E., & Staudt, M. ( 1999). Social work research and the quest for effective practice . Social Work Research, 23, 4-14.
34.
Rothman, J., & Thomas, E. ( 1994). Intervention research: Design and development for the human services. Binghamton, NY: Hayworth.
35.
Startup, M.J., & Shapiro, D.A. ( 1993). Therapist treatment fidelity in prescriptive vs. exploratory psychotherapy. British Journal of Clinical Psychology, 32, 443-456.
36.
Teague, G.B., Bond, G.R., & Drake, R.E. ( 1998). Program fidelity in assertive community treatment: Development and use of a measure. American Journal of Orthopsychiatry , 68, 216-232.
37.
Thyer, B.A. ( 2008). The quest for evidence-based practice?: We are all positivists! . Research on Social Work Practice, 18, 339-345.
38.
Thyer, B.A. ( 2001). What is the role of theory in research on social work practice? Journal of Social Work Education, 37, 9-25.
39.
Waltz, J., Addis, M., Koerner, K., & Jacobson, N.S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620-630.
40.
Wilson, G.T. ( 1996). Manual-based treatments: The clinical application of research findings. Behavior Research and Therapy, 34, 295-315.
