True experimental designs (Designs 4, 5, and 6 of Campbell & Stanley, 1963) are thought to provide internally valid results. This paper describes five studies involving the evaluation of various treat ment interventions and identifies a source of inter nal invalidity when self-report measures are used in a Pretest-Posttest manner. An alternative approach (Retrospective Pretest-Posttest design) to measuring change is suggested, and data comparing its ac curacy with the traditional Pretest-Posttest design in measuring treatment effects is presented. Finally, the implications of these findings for evaluation re search using self-report instruments and the strengths and limitations of retrospective measures are discussed.
Get full access to this article
View all access options for this article.
References
1.
Bem, S.L.The measurement of psychological androgyny. Journal of Consulting and Clinical Psychology, 1974, 42, 155-162.
2.
Bergin, A.E.The evaluation of therapeutic outcomes. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change . New York: John Wiley & Sons, 1971.
3.
Campbell, D.T., & Stanley, J.C.Experimental and quasi-experimental designs for research on teaching In N. L. Gage (Ed.), Handbook of research on teaching . Chicago: Rand McNally, 1963.
4.
Carkhuff, R.R.Helping and human relations: A primer for lay and professional helpers (Vols. 1&2). New York: Holt, Rinehart, & Winston, 1969.
5.
Caporaso, J.A.Quasi-experimental approaches to social science: Perspective and problems . In J. A. Caporaso & L. L. Roos, Jr. (Eds.), Quasi-experimental approaches: Testing theory and evaluating policy. Evanston, IL: Northwestern University Press, 1973.
6.
Cronbach, L.J., & Furby, L.How we should measure "change"—or. should we?Psychological Bulletin, 1970, 74, 68-80.
7.
Deutch, M., & Collins, M.E.Interracial housing: A psychological evaluation of a social experiment . Minneapolis: University of Minnesota Press, 1951.
8.
Eisler, R.M., Miller, P.M., & Hersen, M.Components of assertive behavior. Journal of Clinical Psychology. 1973, 29, 295-299.
9.
Galassi, J., Delo, J., Galassi, M., & Bastein, S.The college self expression scale: A measure of assertiveness, Behavior Therapy, 1974, 5, 165-171.
10.
Galassi, J., Hollandsworth, J., Radecki, J.C., Gay, M., Howe, M.R., & Evans, C.Behavioral performance in the validation of an assertiveness scale, Behavior Therapy, 1976, 7, 447-452.
11.
Gaudreau, P.Bem sex-role inventory validation study. Paper presented at the American Psychological Association Convention, Chicago, 1975
12.
Gay, M.L., Hollandsworth, J.G., & Galassi, J.P.An assertiveness inventory for adults. Journal of Counseling Psychology, 1975, 22, 340-344.
13.
Gulanick, N.A.A group program for highly feminine women aimed at increasing androgyny, Unpublished doctoral dissertation. Southern Illinois University , 1976.
14.
Hill, C.A.process approach for establishing counseling goals and outcomes, Personnel and Guidance Journal, 1975, 53, 571-576.
15.
Howard, G.S., & Tinsley, H.E.A.Use of a retrospective pretest to accomodate the effects of response-shift bias with self-report measures. University of Houston, in preparation.
16.
Huck, S., & McLean, R.Using a repeated measure ANOVA to analyze the data from a pretest-posttest design: A potentially confusing task. Psychological Bulletin , 1975, 82, 511-518.
17.
Information and Education Division, U. S. War Department. Negro infantry platoons in white companies of seven divisions . In T. M. Newcomb & E. L. Hartley (Eds.), Readings in social psychology. New York: Holt, 1947.
18.
Linn, R.L., & Slinde, J.A.The determination of the significance of change between pre- and posttesting periods. Review of Educational Research , 1977, 47, 121-150.
19.
McGuigan, F.J.The G-statistic: An index of amount learned. National Society for Programmed Instruction Journal, 1967 , 6, 14-16.
20.
Neale, J.M., & Liebert, R.M.Science and behavior: An introduction to methods of research. Englewood Cliffs, NJ: Prentice-Hall , 1973.
21.
Ralph, K.M.The self-report response-shift theory of now/then self-report procedure. Unpublished doctoral dissertationSouthern Illinois University , 1975.
22.
Rathus, S.Instigation of assertive behavior through videotape-mediated assertive models and directed practice. Behavior Research and Therapy , 1973, 11, 57-65.
23.
Rokeach, M.The open and closed mind. New York, 1960.
24.
Spence, J.T., Helmreich, R., & Stapp, J.The personal attributes questionnaire: A measure of sex-role stereotypes and masculinity-femininity, JSAS Catalogue of Selected Documents in Psychology, 1974, 4, 43.
