BACKGROUND: Fidelity assessment is important for implementation of evidence-based practices (EBPs), including assertive community treatment (ACT). OBJECTIVES: The TMACT, an enhanced fidelity tool, was developed and pilot-tested to better assess critical ACT structures and processes. DESIGN: Ten ACT teams were administered the TMACT and the long-standing ACT fidelity measure, the Dartmouth Assertive Community Treatment Scale (DACTS), at baseline, 6, 12, and 18 months. RESULTS: Overall, fidelity scores for all 10 teams were relatively high. Six teams showed improvement, concluding with high TMACT scores at 18 months. Four teams with significantly lower total scores had experienced turnover and organizational barriers. TMACT ratings were higher in core ACT practices than in recovery practices and EBPs. TMACT scores rose steadily but were significantly lower than DACTS scores, which remained unchanged. CONCLUSIONS: The TMACT sets higher performance standards through enhanced assessment of recovery-orientation, EBPs, and teamwork and is more sensitive to change than the DACTS.
Allness, D.J. ( 2003). National program standards for ACT teams [Online guidelines] . Retrieved from http://www.nami.org/Template.cfm?Section=ACT-TA_Center
2.
Allness, D.J., & Knoedler, W.H. (1998). The PACT model of community-based treatment for persons with severe and persistent mental illnesses: A manual for PACT start-up. Arlington, VA: National Alliance for the Mentally Ill.
3.
Becker, D.R., Smith, J., Tanzman, B., Drake, R.E., & Tremblay, T. ( 2001). Fidelity of supported employment programs and employment outcomes. Psychiatric Services, 52, 834-836.
4.
Bjorklund, R., Monroe-DeVita, M., Reed, D., Toulon, A., & Morse, G. ( 2009). Washington State’s initiative to disseminate and implement high-fidelity ACT teams. Psychiatric Services , 60, 24-27.
5.
Bond, G.R., Drake, R.E., Mueser, K.T., & Latimer, E. ( 2001). Assertive community treatment for people with severe mental illness. Disease Management & Health Outcomes , 9, 141-159.
6.
Bond, G.R., Evans, L., Salyers, M.P., Williams, J., & Kim, H.-W. (2000). Measurement of fidelity in psychiatric rehabilitation research. Mental Health Services Research, 2, 75-87.
7.
Bond, G.R., Salyers, M.P., Rollins, A.L., Rapp, C.A., & Zipple, A.M. ( 2004). How evidence-based practices contribute to community integration. Community Mental Health Journal, 40, 569-588.
8.
Brekke, J.S. ( 1988). What do we really know about community support programs? Strategies for better monitoring. Hospital & Community Psychiatry, 39, 946-952.
9.
Brekke, J.S., & Test, M.A. ( 1992). A model for measuring the implementation of community support programs: Results from three sites. Community Mental Health Journal, 28, 227-247.
10.
Dixon, L.B., Dickerson, F., Bellack, A.S., Bennett, M., Dickinson, D., Goldberg, R.W., . . . Kreyenbuhl, J. (2010). The 2009 schizophrenia PORT psychosocial treatment recommendations and summary statements. Schizophrenia Bulletin, 36, 48-70.
11.
Donabedian A.1988. The quality of care. How can it be assessed?Journal of the American Medical Association260(12):1743-1748.
12.
Dixon, L., Haas, G.L., Weiden, P., Sweeney, J.K., & Frances, A.J. ( 1991). Drug abuse in schizophrenic patients: Clinical correlates and reasons for use. American Journal of Psychiatry , 148, 224-230.
13.
Drake, R.E., McHugo, G.J., Clark, R.E., Teague, G.B., Xie, H., Miles, K., . . . Ackerson, M.S.W. (1998). Assertive community treatment for patients with co-occurring severe mental illness and substance use disorder: A clinical trial. American Journal of Orthopsychiatry, 68, 201-215.
14.
Drake, R.E., & Wallach, M.A. ( 1989). Substance abuse among the chronic mentally ill . Hospital & Community Psychiatry, 40, 1041-1046.
15.
Latimer, E. ( 1999). Economic impacts of assertive community treatment: A review of the literature. Canadian Journal of Psychiatry , 44, 443-454.
16.
Mancini, A.D., Moser, L.L., Whitley, R., McHugo, G.J., Bond, G.R., Finnerty, M.T., & Burns, B.J. ( 2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60, 189-195.
17.
McGrew, J.H., Bond, G.R., Dietzen, L., & Salyers, M. ( 1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology , 62, 670-678.
18.
McHugo, G.J., Drake, R.E., Teague, G.B., & Xie, H. ( 1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire Dual Disorders Study. Psychiatric Services, 50, 818-824.
19.
McHugo, G.J., Hargreaves, W., Drake, R.E., Clark, R.E., Xie, H., Bond, G.R., & Burns, B.J. ( 1998). Methodological issues in assertive community treatment studies. American Journal of Orthopsychiatry, 68, 246-260.
20.
McQuilken, M., Zahniser, J.H., Novak, J., Starks, R.D., Olmos, A., & Bond, G.R. ( 2003). The work project survey: Consumer perspectives on work . Journal of Vocational Rehabilitation, 18, 59-68.
Mowbray, C.T., Holder, M., Teague, G.B., & Bybee, D. ( 2003). Fidelity criteria: Development, measurement, and validation . American Journal of Evaluation, 24, 315-340.
23.
Mueser, K.T., Salyers, M.P., & Mueser, P.R. ( 2001). A prospective analysis of work in schizophrenia . Schizophrenia Bulletin, 27, 281-296.
24.
New Freedom Commission on Mental Health. ( 2003, July 22). Achieving the promise: Transforming mental health care in America. Final reportDHHS Publ. ( No. SMA-03-3832). Rockville, MD: Author.
25.
Phillips, S.D., Burns, B.J., Edgar, E.R., Mueser, K.T., Linkins, K.W., Rosenheck, R.A., . . . McDonel Herr, E.C. (2001). Moving assertive community treatment into standard practice. Psychiatric Services, 52, 771-779.
26.
Regier, D.A., Farmer, M.E., Rae, D.S., Locke, B.Z., Keith, S.J., Judd, L.L., & Goodwin, F.K. ( 1990). Comorbidity of mental disorders with alcohol and other drug abuse. Results from the Epidemiologic Catchment Area (ECA) Study . Journal of the American Medical Association, 264, 2511-2518.
27.
Rogers, E.S., Walsh, D., Masotta, L., Danley, K., & Smith, K. ( 1991). Massachusetts survey of client preferences for community support services: Final report (Submitted to the Department of Mental Health) . Boston, MA: Boston University , Center for Psychiatric Rehabilitation.
28.
Salyers, M.P., Bond, G.R., Teague, G.B., Cox, J.F., Smith, M.E., Hicks, M.L., . . . Koop, J. ( 2003). Is it ACT yet? Real-world examples of evaluating the degree of implementation for assertive community treatment. Journal of Behavioral Health Services & Research, 30, 304-320.
29.
Salyers, M.P., McKasson, M., Bond, G.R., & McGrew, J.H. (2007). The role of technical assistance centers in implementing evidence-based practices: Lessons learned . American Journal of Psychiatric Rehabilitation, 10, 85-101.
30.
Salyers, M.P., &Tsemberis, S.J. (2007). ACT and recovery: Integrating evidence-based practice and recovery orientation on assertive community treatment teams. Community Mental Health Journal, 43, 619-641.
31.
Stein, L.I., & Test, M.A. ( 1980). Alternative to mental hospital treatment: I. Conceptual model, treatment program, and clinical evaluation. Archives of General Psychiatry, 37, 392-397.
32.
Substance Abuse and Mental Health Services Administration. ( 2010). Publications ordering: Evidence-based practices . retrieved September 15, 2010, from http://store.samhsa.gov/facet/Professional-Research-Topics/term/Evidence-Based-Practices
33.
Teague, G.B., Bond, G.R., & Drake, R.E. ( 1998). Program fidelity in assertive community treatment: Development and use of a measure. American Journal of Orthopsychiatry , 68, 216-232.
34.
Teague, G.B., Drake, R.E., & Ackerson, T. ( 1995). Evaluating use of continuous treatment teams for persons with mental illness and substance abuse. Psychiatric Services , 46, 689-695.
35.
Teague, G.B., & Monroe-DeVita, M. (in press). Not by outcomes alone: Using peer evaluation to ensure fidelity to evidence-based assertive community treatment (ACT) practice. In J. L. Magnabosco & R. W. Manderscheid (Eds.), Outcomes measurement in the human services: Crosscutting issues and methods (2nd ed.). Washington, DC: National Association of Social Workers Press.
36.
Waltz, J., Addis, M.E., Koerner, K., & Jacobson, N.S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620-630.
