A study explored various graphic characteristics associated with the visual analysis of single-subject data. A sample of 20 rehabilitation therapists used visual analysis to rate 24 graphs of data sets using a traditional baseline/treatment (AB) format. Using the intraclass correlation approach, the authors assessed the interrater reliability and found that it ranged from .52 to .66 for each graph. Data analysis revealed that the graphic characteristics of level and mean shift were associated with consistent judgments across the raters, and that changes in slope across the two phases of a graph were associated with substantial rater disagreement. The authors discuss the implications of using visual and statistical procedures to analyze single-subject data, and argue that quantitative adjuncts to visual analysis may facilitate the reliable interpretation of graphed data for a single subject.
Get full access to this article
View all access options for this article.
References
1.
Baer, D. M.
(1977). Perhaps it would be better not to know everything. Journal of Applied Behavior Analysis, 10, 167-172.
2.
Barlow, D. H.
, & Herson, M. (1984). Single case experimental designs: Strategies for studying behavior change (2nd ed.). New York: Pergamon Press.
3.
Bartko, J. J.
(1976). On various intraclass correlation reliability coefficients. Psychological Bulletin, 83, 762-765.
4.
Berk, R. A.
(1979). Generalizability of behavioral observations: A clarification of interobserver agreement and interobserver reliability. American Journal of Mental Deficiency, 83, 460-472.
5.
Bloom, M.
, & Fischer, J. (1982). Evaluating practice: Guidelines for the accountable professional. Englewood Cliffs, NJ: Prentice-Hall.
6.
DeProspero, A.
, & Cohen, S. (1979). Inconsistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis, 12, 573-579.
7.
DiNitto, D.
(1983). Time-series analysis: An application to social welfare policy. Journal of Applied Behavioral Science, 19, 507-518.
8.
Elashoff, J. D.
, & Thoresen, C. E. (1978). Choosing a statistical method for analysis of an intensive experiment. In T. R. Kratochwill (Ed.), Single-subject research: Strategies for evaluating change (pp. 287-311). New York: Academic Press.
9.
Fuqua, R. W.
, & Bachman, J. (1986). Some factors limiting the applicability of applied behavioral research: Descriptive information in JABA articles. In A. Poling & R. W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances (pp. 85-98). New York: Plenum Press.
10.
Furlong, M. J.
, & Wampold, B. E. (1981). Visual analysis of single subject studies by school psychologists. Psychology in the Schools, 18, 80-86.
11.
Hartmann, D. P.
, Gottman, J. M., Jones, R. R., Gardner, W., Kazdin, A. E., & Vaught, R. S. (1980). Interrupted time-series analysis and its application to behavioral data. Journal of Applied Behavior Analysis, 13, 543-559.
12.
Hersen, M.
, & Barlow, D. (1976). Single-case experimental designs: Strategies for studying behavior change. New York: Pergamon Press.
13.
Jones, R. R.
, Vaught, R. S., & Weinrott, M. (1977). Time-series analysis in operant research. Journal of Applied Behavior Analysis, 10, 151-166.
14.
Jones, R. R.
, Weinrott, M. R., & Vaught, R. S. (1978). Effects of serial dependency on the agreement between visual and statistical inference. Journal of Applied Behavior Analysis, 11, 277-283.
15.
Kazdin, A. E.
(1982). Single-case research designs: Methods for clinical and applied settings. New York: Oxford University Press.
16.
Knapp, T. J.
(1983). Behavior analysts' visual appraisal of behavior change in graphic display. Behavioral Assessment, 5, 155-164.
17.
Kratochwill, T. R.
, & Brody, G. H. (1978). Single-subject designs: A perspective on the controversy over employing statistical inference and implications for research and training in behavior modification. Behavior Modification, 2, 291-307.
18.
Michael, J.
(1974). Statistical inference for individual organism research: Mixed blessing or curse?Journal of Applied Behavior Analysis, 7, 647-653.
19.
Nurius, P. S.
(1983). Use of time-series analysis in the evaluation of change due to intervention. Journal of Applied Behavioral Science, 19, 215-228.
20.
Ottenbacher, K. J.
(1986). Reliability and accuracy of visually analyzing graphed data from single-subject designs. American Journal of Occupational Therapy, 40, 464-469.
21.
Parsonson, B. S.
, & Baer, D. M. (1978). The analysis and presentation of graphic data. In T. R. Kratochwill (Ed.), Single-subject research: Strategies for evaluating change (pp. 101-165). New York: Academic Press.
22.
Parsonson, B. S.
, & Baer, D. M. (1986). The graphic analysis of data. In A. Poling & R. W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances (pp. 157-186). New York: Plenum Press.
23.
Rojahn, J.
, & Schulze, H. H. (1985). The linear regression line as a judgmental aid in visual analysis of serially dependent A-B time series data. Journal of Psychopathology and Behavioral Assessment, 7, 191-206.
24.
Shrout, P. E.
, & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
25.
Tawney, J. W.
, & Gast, D. L. (1984). Single-subject research in special education. Columbus, OH: Charles E. Merrill.
26.
Tinsley, H. E.
, & Weiss, D. (1975). Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358-376.
