Issues surrounding the application of inferential statistical tests to behavior modification research was presented. Four major behavior modification journals were surveyed from their inception through 1974 for their use of inferential statistical tests in empirical research studies. Results indicated that Behaviour Research and Therapy and Behavior Therapy contained the highest percentage of articles using inferential statistical procedures. Over all journals, nearly all studies employing group designs used inferential statistical tests. Parametric analysis-of-variance and various nonparametric tests were generally the most commonly employed statistics within the journals sampled. Implications of the review suggest that the methodological base of behavior modification research is becoming more diverse as reflected in increased use of group designs where inferential tests are commonly employed. While all journals contained some N=1 experiments which relied on some form of inferential statistics, both valid and invalid applications are noted. Issues surrounding the use of statistics are documented. Implications for research and training are discussed.
Get full access to this article
View all access options for this article.
References
1.
Agras, W. S.Toward the certification of behavior therapists?Journal ofApplied Behavior Analysis, 1973, 6, 167-173.
2.
Baer, D. M.Perhaps it would be better not to know everything . Journal of Applied Behavior Analysis, 1977, 10, 167-172.
3.
Baer, D. M. , Wolf, M. M., & Risley, T. R.Some current dimension of applied behavior analysis. Journal of Applied Behavior Analysis, 1968, 1, 91-97.
4.
Bandura, A.Principles of behavior modification. New York: Holt, Rinehart, & Winston, 1969.
Benjamin, L. S.A special Latin square for the use of each subject "as his own control."Psychometrika, 1965, 30, 499-513.
7.
Bijou, S. W. , Peterson, R. F., & Ault, M. H.A method to integrate descriptive and experimental field studies at the level of data and empirical concepts. Journal of Applied Behavior Analysis, 1968, 1, 175-191.
8.
Brady, J.Behavior therapy: Fad or psychotherapy of the future. In R. Rubin, J. Brady, & J. Henderson (Eds.), Advances in behavior therapy. New York: Academic Press, 1973.
9.
Browning, R. M.A same-subject design for simultaneous comparison of three reinforced contingencies . Behavior Therapy, 1967, 5, 237-243.
10.
Browning, R. M. & Stover, D. O.Behavior modification in child treatment: An experimental and clinical approach. Chicago: Aldine-Atherton, 1971.
11.
Campbell, D. T. & Stanley, J. C.Experimental and quasi-experimental design for research. Chicago: Rand McNally, 1963.
12.
Chassan, J. B.Research designs in clinical psychology and psychiatry. New York: Appleton-Century-Crofts, 1967.
13.
Davidson, W. E. , & Seidman, E.Studies of behavior modification and juvenile delinquency: A review, methodological critique and social perspective. Psychological Bulletin, 1974, 81, 998-1011.
14.
DeProspero, A. J. , Cohen, S. H., Kennen, R. D., & Edelstein, B. M.Objective approach to visual inspection of intrasubject replication data. Paper presented at the 83rd Annual Convention of the American Psychological Association, Chicago, August 30, 1975.
15.
Edgar, E. , & Billingsley, F.Believability when N= 1. Psychological Record, 1974, 24, 147-160.
16.
Edgington, E. S.Statistical inference from N=1 experiments . Journal of Psychology, 1967, 65, 195-199.
17.
Edgington, E. S.N=I experiments: Hypothesis testing . The Canadian Psychologist, 1972, 2, 121-134. (a)
18.
Edgington, E. S.The design of one-subject experiments for testing hypotheses . The Western Psychologist, 1972, 3. (b)
19.
Edgington, E. S.A new tabulation of statistical procedures used in APA journals . American Psychologist, 1974, 29, 25-26.
20.
Edgington, E. S.Randomization tests for one-subject operant experiments . The Journal of Psychology, 1975, 90, 57-68. (a)
21.
Edgington, E. S.Randomization tests for one-subject experiments . In A. E. Kazdin, Use of Statistics in N=1 Research. Symposium presented at the 83rd Annual Convention of the American Psychological Association, Chicago, September, 1975. (b)
22.
Gentile, R. J. , Roden, A. H., & Klein, R. D.An analysis-of-variance model for the intrasubject replication design. Journal of Applied Behavior Analysis, 1972, 5, 193-198.
23.
Glass, G. V. , Peckham, P. D., & Sanders, J. R.Consequences of failure to meet assumptions underlying the fixed effects analysis of variance and covariance. Review of Educational Research, 1972, 42, 237-288.
24.
Glass, G. V. , Willson, J., & Gottman, J. M.Design and analysis of time-series experiments. Boulder: University of Colorado Press, 1975.
25.
Gottman, J. M. , & Glass, G. V.Analysis of interrupted time-series experiments. In T. R. Kratochwill (Ed.), Single-subject research: Strategies for evaluating change. New York: Academic Press, 1978.
26.
Gottman, J. M. , & Notarius, C.Sequential analysis of observational data using Markov chains. In T. R. Kratochwill (Ed.), Single-subject research: Strategies for evaluating change. New York: Academic Press, 1978.
27.
Hartmann, D. P.Forcing square pegs into round holes: Some comments on an analysis-of-variance model for the intrasubject replication design . Journal of Applied Behavior Analysis, 1974, 7, 635-638.
28.
Hersen, J. , & Barlow, D. H.Single-case experimental designs: Strategies for studying behavior change. New York: Pergamon Press, 1976.
29.
Jones, R. R. , Vaught, R. S., & Reid, J. B.Time-series analysis as a substitute for single subject analysis of variance designs. In G. R. Patterson, I. M. Marks, J. D. Matarazzo, R. A. Meyers, G. E. Schwartz, & H. H. Stupp, Behavior Change 1974. Chicago: Aldine, 1975.
30.
Jones, R. R. , Vaught, R. S., & Weinrott, M.Time-series analysis in operant research. Journal of Applied Behavior Analysis, 1977, 10, 151-166.
31.
Kazdin, A. E.Methodological and assessment considerations in evaluating reinforcement programs in applied settings . Journal of Applied Behavior Analysis, 1973, 6, 517-531.
32.
Kazdin, A. E.Characteristics and trends in applied behavior analysis . Journal of Applied Behavior Analysis, 1975, 8, 332.
33.
Kazdin, A. E.Statistical analysis for single-case experimental designs. In M. Hersen & D. H. Barlow, Single-case experimental designs: Strategies for studying behavior change. New York: Pergamon Press, 1976.
34.
Kazdin, A. E.Methodology of applied behavior analysis. In T. A. Brigham & A. C. Catania (Eds.), Social and instructional processes: Foundations and applications of a behavior analysis. New York: Irvington-Naiburg-Wiley & Sons, 1977. (a)
35.
Kazdin, A. E.Assessing the clinical or applied importance of behavior through social validation . Behavior Modification, 1977, 1, 427-452. (b)
36.
Kelly, F. J. , McNeil, K., & Newman, I.Suggested inferential statistical models for research in behavior modification. Journal of Experimental Education, 1973, 41, 54-63.
37.
Keselman, H. J. , & Leventhal, LConcerning the statistical procedures enumerated by Gentile et al.: Another perspective. Journal of Applied Behavior Analysis, 1974, 7, 643-645.
38.
Knapczyk, D. R. , & Livingston, G.Self-recording and student teacher supervision: Variables within a token economy structure. Journal of Applied Behavior Analysis, 1973, 6, 481-486.
39.
Kratochwill, T. R. (Ed.) Single-subject research: Strategies for evaluating change. New York: Academic Press, 1978.
40.
Kratochwill, T. R. , Levin, J. R., & Benjamin, L. J.On the applicability of the Benjamin Special Latin Square design to single subject research. Paper presented at the Annual Meeting of the American Educational Research Association, New York, New York, April, 1977.
41.
Kratochwill, T. R. , Alden, K., Demuth, D., Dawson, D., Panicucci, D., Arntson, R., McMurray, N., Hempstead, J., & Levin, J. R.A further consideration in the application of an analysis-of-variance model for the intrasubject replication design. Journal of Applied Behavior Analysis, 1974, 7, 629-633.
42.
Leitenberg, H.The use of single-case methodology in psychotherapy research . Journal of Abnormal Psychology, 1973, 82, 87-101.
43.
Levin, J. R. , Marascuilo, L. A., & Hubert, L.J.N=Nonparametric randomization tests. In T. R. Kratochwill (Ed.) Single-subject research: Strategies for evaluating change. New York: Academic Press, 1978.
44.
McCullough, J. P. , Cornell, J. E., McDaniel, M. H., & Mueller, R. K.Utilization of the simultaneous treatment design to improve student behavior in a first-grade classroom. Journal of Consulting and Clinical Psychology, 1974, 42, 288-292.
45.
Michael, J.Statistical inference for individual organism research: Some reactions to a suggestion of Gentile, Roden, and Klein . Journal of Applied Behavior Analysis, 1974, 7, 627-628. (a)
46.
Michael, J.Statistical inference for individual organism research: Mixed blessing or curse?Journal of Applied Behavior Analysis, 1974, 7, 647-653. (b)
47.
Mahoney, M. J.Cognition and behavior modification. Cambridge, MA: Ballinger, 1974.
48.
Myers, D. V.Extinction, DRO, and response-cost procedures for eliminating self-injurious behavior: A case study . Behaviour Research and Therapy, 1975, 13, 189-191.
49.
O'Leary, K. D. & Kent, R.Behavior modification for social action: Research tactics and problems. In L. A. Hamerlynck, L. C. Handy, & E. J. Mash (Eds.), Behavior Change: Methodology concepts and practice. Champaign, IL: Research Press, 1973.
50.
Parsonson, B. S. & Baer, D. M.The analysis and presentation of graphic data. In T. R. Kratochwill (Ed.), Single-subject research: Strategies for evaluating change. New York: Academic Press, 1978.
51.
Revusky, S. H.Some statistical treatments compatible with individual organism methodology . Journal of the Experimental Analysis of Behavior, 1967, 10, 319-330.
52.
Risley, T. R.Behavior modification: An experimental-therapeutic endeavor. In L. G. Hamerlynck, P. O. Davidson, & L. E. Acker (Eds.), Behavior modification and ideal mental health services. Calgary, Alberta, Canada: University of Calgary Press, 1970.
53.
Rodewald, H. K.All-or-none acquisition in matching-to-sample and a test of two models . Journal of the Experimental Analysis of Behavior, 1974, 22, 53-60.
54.
Scheffe', H.The analysis of variance. New York: John Wiley, 1959.
55.
Schnelle, J. F. , & Lee, J. C.A quasi-experimental retrospective evaluation of a prison policy change. Journal of Applied Behavior Analysis, 1974, 7, 483-496.
56.
Schnelle, J. F. , Kirchner, R. E., McNees, M. P., & Lawler, J. M.Social evaluation research: The evaluation of two police patrolling strategies. Journal of Applied Behavior Analysis, 1975, 8, 353-365.
57.
Schwarzmueller, G. B. , Neil, J. H., & Deitz, S. M.Nonparametric statistics for behavior modification data. Paper presented at the 83rd Annual Meeting of the American Psychological Association, Chicago, August, 1975.
58.
Shine, L. C., II , & Bower, S. M.A one-way analysis of variance for single-subject designs. Educational and Psychological Measurement, 1971, 31, 105-113.
59.
Sidman, M.Tactics of scientific research. New York: Basic Books, 1960.
60.
Stuart, R. B.Behavioral contracting within the families of delinquents . Journal of Behavior Therapy and Experimental Psychology, 1971, 2, 1-11.
61.
Thoresen, C. E.Let's get intensive: Single case research. Englewood Cliffs, NJ: Prentice-Hall, in press.
62.
Thoresen, C. E. , & Elashoff, J. D."Analysis-of-variance model for intra subject replication design": Some additional comments. Journal of Applied Behavior Analysis, 1974, 7, 639-641.
63.
Weiss, B. , Laties, V. G., Siegel, L., & Goldstein, D.A computer analysis of serial interactions in spaced responding. Journal of Experimental Analysis of Behavior, 1966, 9, 619-626.
