Statewide evaluations of mental health services are colossal undertakings, reports of which are few in the published literature. Social workers are often called on to conduct program evaluations of both small-and large-scale mental health systems. A statewide evaluation system was implemented in the state of Georgia in 1999 to measure the impact of services on mental health, mental retardation, and substance abuse programs. This report delineates the evaluation of substance abuse services for the state of Georgia using the Addiction Severity Index. System-wide outcomes were assessed across 13 mental health regions, and 19 substance abuse programs participated. Consumers admitted to American Society of Addiction Medicine level II services were assessed at intake and 60 days posttreatment. Difficulties with the implementation of the statewide evaluation system, such as attrition, are identified and discussed. Recommendations for improving the evaluation system are also discussed.
Alterman, A. I., Brown, L. S., Zaballero, A., & McKay, J. R. (1994). Interviewer severity ratings and composite scores of the ASI: A further look. Drug and Alcohol Dependence, 34, 201-209.
2.
Alterman, A. I., Mulvaney, F. D., Cacciola, J. S., Cnaan, A., McDermott, P. A., & Brown, L. S., Jr. (2001). The validity of the interviewer severity ratings in groups of ASI interviewers with varying training. Addiction, 96, 1297-1305.
3.
Burlingame, G. M., Lambert, M. J., Reisinger, C. W., Neff, W. M., & Mosier, J. (1995). Pragmatics of tracking mental health outcomes in a managed care setting. Journal of Mental Health Administration, 22, 226-236.
Center for Substance Abuse Prevention. (2002). Science-based prevention programs and principles 2002: Effective substance abuse and mental health programs for every community (BKD479). Rockville, MD: Department of Health and Human Services Center for Substance Abuse Prevention.
6.
Chassin, M. R. (1997). Assessing strategies for quality improvement. Health Affairs, 16, 151-161.
7.
Commons, M., McGuire, T. G., & Riordan, M. H. (1997). Performance contracting for substance abuse treatment. Journal of Behavioral Health Service Research, 32, 631-650.
8.
Edwards, A. G., & Rollnick, S. (1997). Outcome studies of brief alcohol intervention in general practice: The problem of lost subjects. Addiction, 92, 1699-1704.
9.
Hodgins, D. C., & el-Guebaly, N. (1992). More data on the Addiction Severity Index. Reliability and validity with the mentally ill substance abuser. Journal of Nervous Mental Disease, 180, 197-201.
10.
Hoffmann, N.G., Halikas, J.A., Mee-Lee, D., & Weedman, R.D. (1991). ASAM patient placement critieria for the treatment of psychoactive substance use disorders. Washington, DC: ASAM.
11.
Hudson, W. W., Thyer, B. A., & Stocks, J. T. (1985). Assessing the importance of experimental outcomes. Journal of Social Service Research, 8, 87-98.
12.
Humphreys, K., & Hamilton, E. G. (1997). Policy relevant program evaluation in a national substance abuse treatment system. Journal of Mental Health Administration, 24, 373-386.
13.
King, M., & Bordnick, P. S. (2002). Alcohol use disorders: A social worker’s guide to clinical assessment. Journal of Social Work Practice in the Addiction, 2, 3-31.
14.
Marsh, A., & Jansen, M. (1996). Evaluation in the substance abuse and mental health services administration. Evaluation and the Health Professions, 19, 363-377.
15.
McKenzie, M., Tulsky, J. P., Long, H. L., Chesney, M., & Moss, A. (1999). Tracking and follow-up of marginalized populations: A review. Journal of Health Care for the Poor and Underserved, 10, 409-429.
16.
McLellan, A. T., Kushner, H., Metzger, D., Peters, R., Smith, I., Grissom, G., et al. (1992). The fifth edition of the Addiction Severity Index. Journal of Substance Abuse Treatment, 9, 199-213.
17.
McLellan, A. T., Luborsky, L., Cacciola, J., Griffith, J., Evans, F., Barr, H. L., et al. (1985). New data from the Addiction Severity Index. Reliability and validity in three centers. Journal of Nervous and Mental Disease, 173, 412-423.
18.
McLellan, A. T., Luborsky, L., Woody, G. E., & O’Brien, C. P. (1980). An improved diagnostic evaluation instrument for substance abuse patients. The Addiction Severity Index. Journal of Nervous and Mental Disease, 168, 26-33.
19.
McLellan, A. T., Parikh, G., Bragg, A., Cacciola, J., Fureman, B., & Incmikoski, R. (1990). Addiction Severity Index administration manual (5th ed.). University Park, Pennsylvania: Pennsylvania State University, Veterans Affairs Center for Studies of Addiction.
20.
McPheeters, H. L. (1984). Statewide mental health outcome evaluation: A perspective of two southern states. Community Mental Health Journal, 20, 44-55.
21.
Mechanic, D., Schlesinger, M., & McAlpine, D. (1995). Management of mental health and substance abuse services: State of the art and early results. Milbank Quarterly, 73, 19-55.
22.
National Institute on Drug Abuse (1995), Broadening the role of NIDA’s neuroscience research. Director’s Column by Dr. Alan Leshner, 10(6). Retrieved October 12, 2001 from http://www.drugabuse.gov/NIDA_Notes/NNVol10N6/Dirrep.html
23.
Nelson, D. C., Hartman, E., Ojemann, P. G., & Wilcox, M. (1995). Outcomes measurement and management with a large Medicaid population: A public/private collaboration. Behavioral Healthcare Tomorrow, 4, 31-37.
24.
Nirenberg, T. D., Sobell, L. C., & Sobell, M. B. (1980). Effective and inexpensive procedures for decreasing client attrition in an out-patient alcohol treatment program. The American Journal of Drug and Alcohol Abuse, 7, 73-82.
25.
Official Code of Georgia (1998). Volume 28: Title 37 Mental Health. Charlottesville, Virginia: Butterworth.
26.
Pritham, C. H. (1996). Quality improvement process/outcomes research. Journal of Rehabilitation Research and Development, 33, vii-viii.
27.
Reilly, J. (1997). Tackling the complexities of outcome evaluations in New York. Alcoholism and Drug Abuse Weekly, 37, 5-5.
28.
Rouse, L. W., Toprac, M. G., & MacCabe, N. A. (1998). The development of a statewide continuous evaluation system for the Texas Children’s Mental Health Plan: A total quality management approach. Journal of Behavioral Health Service Research, 25, 194-207.
29.
Royse, D., Thyer, B. A., Padgett, D. K., & Logan, T. K. (2001). Program Evaluation: An introduction (3rd ed.). Belmont, CA: Brooks/Cole.
30.
Statistical Package or the Social Science. (2001). SPSS (Version 10.0) [Computer Software]. Chicago: Author.
31.
Stoffelmayr, B. E., Mavis, B. E., & Kasim, R. M. (1994). The longitudinal stability of the Addiction Severity Index. Journal of Substance Abuse Treat, 11, 373-378.
32.
Substance Abuse and Mental Health Services Administration. (1995). Evaluation Policy. Rockville, MD: Author.
