The paper reviews many objections to meta-analysis, both in principle, and in particular, as practiced by its originators. Particular attention is given to the most widely cited application of meta-analysis: to the facts of psychotherapy. It is suggested that the claims to inclusiveness and objectivity, made for these analyses, are not supported by the evidence, and that the conclusions drawn from the evidence surveyed are incompatible with the results of the analysis on which they are supposed to be based. It is further suggested that no pseudo-objective computerized technique can substitute for the scientific insight and theoretical acumen of the investigator. Indeed, for most purposes the simplistic scoring systems of meta-analysis are not only useless, but may be counterproductive. It is precisely in those areas where there is most disagreement that these methods are least applicable.
Get full access to this article
View all access options for this article.
References
1.
Barendregt, J.T.A psychological investigation of the effect of group psychotherapy in patients with bronchial asthma. Journal of Psychosomatic Research, 1957, 2, 115-119.
2.
Bartley, S.H.Principles of perception. New York: Harper, 1958.
3.
Beckstrand, P.E.TA as a means of teaching writing in high school. Transactional Analysis Journal, 1973, 3, 161-163.
4.
Ciminero, A. R.,Calhoun, K. S., & Adams, H. E. (Eds.) Handbook of behavioural assessment. New York : Wiley, 1977.
5.
Cooper, H.M.Statistically combining independent studies: A meta-analysis of sex differences in conformity research. Journal of Personality and Social Psychology, 1979, 37, 131-146.
6.
Cooper, J.E.A study of behaviour therapy in 30 psychiatric patients. Lancet, 1963, 1, 411-415.
7.
Cooper, J.E., Gelder, M.G., & Marks, I.M.Results of behaviour therapy in 77 psychiatric patients. British Medical Journal, 1965, 1, 1222.
8.
Eysenck, H.J.The effects of psychotherapy : An evaluation. Journal of Consulting Psychology, 1952, 16, 319-324.
Eysenck, H. J. (Ed.). The measurement of personality . Lancaster, England: Medical and Technical Publishers, 1976.
11.
Eysenck, H.J.An exercise in mega-silliness. American Psychologist , 1978, 33, 517.
12.
Eysenck, H.J.The conditioning model of neurosis. The Behavioural and Brain Sciences, 1979, 2, 155-199.
13.
Eysenck, H. J. (Ed.). A model for personality . New York: Springer, 1981.
14.
Eysenck, H.J.Neo-behavioristic (S-R) theory. In G. T. Wilson & C. M. Frank (Eds.), Contemporary behavior therapy. New York : Guilford Press, 1982.
15.
Eysenck, H.J.Special review: The benefits of psychotherapy. Behaviour Research & Therapy, in press.
16.
Eysenck, H.J., & Frith, C.Reminiscence, motivation and personality. New York : Plenum, 1977.
17.
Gelder, M.G., Bancroft, J.H.J., Gath, D., Johnston, D.W., Mathews, A.M., & Shaw, P.M.Specific and non-specific factors in behaviour therapy. British Journal of Psychiatry, 1973, 123, 445-462.
18.
Gilbert, G.M.Intersensory facilitation and inhibition. Journal of General Psychology, 1941, 24, 381-407.
19.
Glass, G.V.Primary, secondary, and meta-analysis of research. Educational Research, 1976, 5, 3-8.
20.
Glass, G.V.Integrating findings: The meta-analysis of research. In L. Shulman (Ed.), Review of Research in Education , 5, 59-78. Itasca, III.: Peacock, 1977.
21.
Glass, G.V., & Smith, M.L.Meta-analysis of research on the relationship of class-size and achievement . Educational Evaluation and Policy Analysis, 1979, 1, 2-16.
22.
Harris, J.D.Some relations between vision and audition. Springfield, Ill.: Thomas, 1950.
23.
Hartman, G.W.Gestalt psychology. New York: Ronald Press, 1935.
24.
Kazdin, A.E., & Wilson, G.T.Evaluation of behaviour therapy: Issues, evidence and research strategies . Cambridge, Mass.: Ballinger, 1978.
25.
Kiesler, D.J.Some myths of psychotherapy research and the search for a paradigm . Psychological Bulletin, 1966, 65, 110-136.
26.
Kravkov, S.V.Interaction of the sense organs. In A. Leontyev et al. (Eds.), Psychological research in the USSR, I. Moscow: Progress Publications, 1966.
27.
London, I.D.Research on sensory interaction in the Soviet Union. Psychological Bulletin, 1954, 51, 531-568.
28.
Loveless, N.E., Brebner, J., & Hamilton, P Bisensory presentation of information . Psychological Bulletin, 1970, 73, 161-199.
29.
Luborsky, L., Singer, B., & Luborsky, L.Comparative studies of psychotherapies: Is it true that everyone has won and all must have prizes? Archives of General Psychiatry , 1975, 32, 995-1008.
30.
Maruyama, K.Intersensory effects in vision and audition. Japanese Journal of Psychology, 1964, 35, 204-216. (In Japanese)
31.
Meltzoff, J., & Kornreich, M.Research in psychotherapy. New York: Atherton, 1970.
32.
Mischel, W.Personality and assessment. New York: Wiley, 1968.
33.
Mischel, W.On the future of personality measurement. American Psychologist , 1977, 32, 246-254.
Rachman, S., & Hodgson, R.J.Synchrony and disynchrony in fear and avoidance. Behaviour Research and Therapy, 1974, 12, 311-318.
36.
Rachman, S.J., & Wilson, G.T.The effects of psychological therapy. Oxford & New York: Pergamon, 1980.
37.
Ryan, T.A.Intercorrelation of the sensory systems in perception. Psychological Bulletin, 1940, 37, 659-698.
38.
Sheldon, A.An evaluation of psychiatric aftercare. British Journal of Psychiatry, 1964, 110, 662-667.
39.
Shigehisa, T.An investigation of intersensory effects. Unpublished doctoral dissertation, University of Aberdeen, 1972.
40.
Shigehisa, T., & Symons, J.R.Effect of intensity of visual stimulation on auditory sensitivity in relation to personality. British Journal of Psychology , 1973, 64, 205-213. (a)
41.
Shigehisa, T., & Symons, J.R.Reliability of auditory responses under increasing intensity of visual stimulation in relation to personality. British Journal of Psychology , 1973, 64, 375-381. (b)
42.
Shigehisa, T., & Symons, J.R.Effect of intensity of visual stimulation on auditory sensitivity in relation to personality. In H. J. Eysenck (Ed.), The measurement of personality. London: MTP Press, 1976.
43.
Smith, M.L., & Glass, G.V.Meta-analysis of psychotherapy outcome studies. American Psychologist , 1977, 32, 752-760.
44.
Smith, M.L., Glass, G.V., & Miller, T.I.The benefits of psychotherapy. Baltimore & London: The Johns Hopkins University. Press, 1980.
45.
Stern, W AllgemeinePsychologie auf personalistischen Grundlage. The Hague : Nijhoft, 1935.
46.
Strupp, H.H., & Hadley, S.W Specific vs. nonspecific factors in psychotherapy. Archives of General Psychiatry, 1979, 36, 1125-1136.
47.
Symons, J.R.An investigation of intersensory relationships. Unpublished doctoral dissertation, University of Reading, 1954.
48.
Torii, N.Sensory interaction between vision and audition. Bulletin of the Japanese Research Centre, 1962, 1, 26-37. (In Japanese)
49.
Wincze, J.P., Hoon, E.F., & Hoon, P.W.Multiple measure analysis of women experiencing low sexual arousal . Behaviour Research & Therapy, 1978, 16, 43-50.
