Measurement of clinically significant change is critical for rehabilitation research because it can enhance the credibility of rehabilitation efforts and guide evidence-based practices. The practical appeal of clinically significant change is that it can bridge research and clinical practice by focusing on individual rather than group differences. In response to current challenges in rehabilitation outcome measurement, the authors describe methods and strategies for the analysis of clinically significant change. The complementary approaches of reliable change index scores as proposed by Jacobson and Truax (1991) and regression-based z scores as proposed by McSweeney, Naugle, Chelune, and Luders (1993) are highlighted. The article concludes with a case example and discussion of implications for future directions in rehabilitation research.
Get full access to this article
View all access options for this article.
References
1.
Ankuta, G.Y., & Abeles, N. (1993). Client satisfaction, clinical significance, and meaningful change in psychotherapy. Professional Psychology, Research and Practice, 24, 70—74.
2.
Arokiasamy, C.V. (1993). A theory for rehabilitation. RehabilitationEducation, 7, 77—98.
Chelune, G.J., Naugle, R.I., Luders, H., Sedlak, J., & Awad, I.A. (1993). Individual change after epilepsy surgery: Practice effects and base rate information. Neuropsychology, 7, 41—52.
7.
Derogatis, L. (1983). SCL-90-R administration and scoring procedures manual—II. Towson, MD: Clinical Psychometric Research.
8.
Hageman, W.J., & Arrindell, W.A. (1999). Establishing clinically significant change: Increment of precision and the distinction between individual and group level of analysis. Behaviour Research and Therapy , 37, 1169—1193.
9.
Hansen, N.B., & Lambert, M.J. (1996). Clinical significance: An overview of methods . Journal of Mental Health, 5, 17—24.
10.
Hermann, B.P., Seidenberg, M., Bell, B., Rutecki, P., Sheth, R., Wendt, G., et al. (2003). Extratemporal quantitative MR volumetrics and neuropsychological status in temporal lobe epilepsy. Journal of the International Neuropsychological Society, 9, 353—362.
11.
Hermann, B.P., Seidenberg, M., Schoenfeld, J., Peterson, J., Leveroni, C., & Wyler, A.R. (1996). Empirical techniques for determining the reliability, magnitude, and pattern of neuropsychological change following epilepsy surgery . Epilepsia, 37, 942—950.
12.
Hermann, B.P., Wyler, A.R., VanderZwagg, R., & LeBailly, R.K. (1991). Predictors of neuropsychological change following anterior temporal lobectomy: Role of regression toward the mean. Journal of Epilepsy, 4, 139—148.
13.
Hsu, L.M. (1989). Reliable changes in psychotherapy: Taking into account regression toward the mean. Behavioral Assessment , 11, 459—467.
14.
Jacobson, N.S., Follette, W.C., & Revenstorf, D. (1984). Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15, 336—352.
15.
Jacobson, N.S., & Revenstorf, D. (1988). Statistics for assessing the clinical significance of psychotherapy techniques: Issues, problems, and new developments. Behavioral Assessment, 10, 133—145.
16.
Jacobson, N.S., Roberts, L.J., Berns, S.B., & McGlinchey, J.B. (1999). Methods for defining and determining the clinical significance of treatment effects: Description, application, and alternatives. Journal of Consulting and Clinical Psychology , 67, 300—307.
17.
Jacobson, N.S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12—19.
18.
Jette, A.M., & Jette, D.U. (1997). Assessing health status outcomes in rehabilitation . In M. J. Fuhrer (Ed.), Assessing medical rehabilitation practices: The promise of outcomes research (pp. 181—207). Baltimore: Brookes .
19.
Johnson, E.K., Jones, J.E., Seidenberg, M., & Hermann, B.P. (2004). The relative impact of anxiety, depression and clinical seizure variables on health-related quality of life in epilepsy. Epilepsia, 45, 544— 550.
20.
Kadera, S.W., Lambert, M.J., & Andrews, A.A. (1996). How much therapy is really enough? A session-by-session analysis of the psychotherapy dose-effect relationship. TheJournal of Psychotherapy Practice and Research, 5, 132—151.
21.
Kazdin, A.E. (1999). The meanings and measurement of clinical significance . Journal of Consulting and Clinical Psychology, 67, 332—339.
Koch, L.C., & Rumrill, P.D. (1997). Rehabilitation counseling outside the state agency: Setting, roles, and functions for the new millennium. Journal of Applied Rehabilitation Counseling, 28, 9—14.
24.
Lambert, M.J., Burlingame, G.M., Umphress, V., Hansen, N.B., Vermeersch, D.A., Clouse, G.C., et al. (1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology & Psychotherapy, 3, 249—258.
25.
Lambert, M.J., Hansen, N.B., Umphress, V., Lunner, K., Okiishi, J., Burlingame, G., et al. (1996). Administration and scoring manual for the Outcome Questionnaire (OQ-45.2). Wilmington, DE: American Professional Credentialing Services.
26.
Leahy, M.J., Chan, F., & Saunders, J.L. (2003). Job functions and knowledge requirements of certified rehabilitation counselors in the 21st century. Rehabilitation Counseling Bulletin, 46, 66—81.
27.
Leahy, M.J., & Szymanski, E.M. (1995). Rehabilitation counseling: Evolution and current status. Journal of Counseling and Development , 74, 163—166.
28.
Lunnen, K.M., & Ogles, B.M. (1998). A multiperspective, multivariable evaluation of reliable change. Journal of Consulting and Clinical Psychology , 66, 400—410.
29.
Lynch, R.T., & Degeneffe, C. (1998). Program evaluation and assessment of outcomes in rehabilitation settings. Directions in Rehabilitation Counseling , 9(8), 93—101.
30.
Maassen, G.H. (2004). The standard error in the Jacobson and Truax reliable change index: The classic approach to the assessment of reliable change. Journal of the International Neuropsychological Society, 10(6), 888—893.
31.
Maki, D.R., & Riggar, T.F. (2004). Concepts and paradigms. In D. R. Maki & T. F. Riggar (Eds.), Handbook of rehabilitation counseling (pp. 1—24). New York: Springer.
32.
McAweeney, M., & Crewe, N. (2000). Evaluating outcomes research: Statistical concerns and clinical relevance. In R. G. Frank & T. R. Elliott (Eds.), Handbook of rehabilitation psychology (pp. 311—326). Washington, DC: American Psychological Association.
33.
McGlinchey, J.B., Atkins, D.C., & Jacobson, N.S. (2002). Clinical significance methods: Which one to use and how useful are they?Behavior Therapy , 33, 529—550.
34.
McSweeney, A.J., Naugle, R.I., Chelune, G.J., & Luders, H. (1993). “T Scores for Change”: An illustration of a regression approach to depicting change in clinical neuropsychology. The Clinical Neuro-psychologist, 7, 300—312.
35.
Nosek, M.A. (1987). Outcome analysis in independent living. In M. J. Fuhrer (Ed.), Rehabilitation outcomes: Analysis and measurement (pp. 71—83). Baltimore : Brookes.
36.
Nunnally, J.C., & Kotsch, W.E. (1983). Studies of individual subjects: Logic and methods of analysis. The British Journal of Clinical Psychology, 22, 83—93.
37.
Ogles, B.M., Lambert, M.J., & Fields, S.A. (2002). Essentials of outcome assessment. New York: Wiley.
38.
Parker, R.M., & Bolton, B. (2005). Research in rehabilitation counseling. In R. M. Parker, E. M. Szymanski, & J. B. Patterson (Eds.), Rehabilitation counseling: Basics and beyond (4th ed., pp. 335—362). Austin, TX: PRO-ED.
Rogers, E.S., & Palmer-Erbs, V. (1994). Participatory action research: Implications for research and evaluation in psychiatric rehabilitation. Psychosocial Rehabilitation Journal, 18, 3—12.
41.
Rosenthal, R., & Rosnow, R.L. (1991). Essentials of behavioral research: Methods and data analysis. (2nd ed.). Boston : McGraw-Hill.
42.
Sawrie, S.M., Chelune, G.J., Naugle, R.I., & Luders, H.O. (1996). Empirical methods for assessing meaningful neuropsychological change following epilepsy surgery. Journal of the International Neuropsychological Society, 2, 556—564.
Smith, M.L., Glass, G.V., & Miller, T.I. (1980). The benefits of psychotherapy. Baltimore: Johns Hopkins University Press.
45.
Speer, D.C. (1992). Clinically significant change: Jacobson and Truax (1991) revisited. Journal of Consulting and Clinical Psychology , 60, 402—408.
46.
Speer, D.C. (1999). What is the role of two-wave designs in clinical research? Comment on Hageman and Arrindell. Behaviour Research and Therapy, 37, 1203—1210.
47.
Speer, D.C., & Greenbaum, P.E. (1995). Five methods for computing significant individual client change and improvement rates: Support for an individual growth curve approach. Journal of Consulting and Clinical Psychology, 63, 1044—1048.
Walls, R.T. (2001). Measurement of client outcomes in rehabilitation . In B. F. Bolton (Ed.), Handbook of measurement and evaluation in rehabilitation (3rd ed., pp. 311—337). Gaithersberg, MD: Aspen.
