The old controversy regarding the Rorschach Inkblot Test has recently revived. The present article suggests that the debate will be most productive if careful attention is paid to methodological issues. Three recent examples illustrate how incorrect conclusions regarding Rorschach validity may occur if methodological issues are not evaluated carefully. The present article examines (a) Burns and Viglione's (1996) conclusion that the Rorschach Human Experience Variable (HEV) is a predictor of interpersonal relatedness among adults; (b) Weiner's (1996) conclusion that the D score and Morbid Responses (MOR) are valid measures of "experienced distress" in Posttraumatic Stress Disorder (PTSD); and (c) Ganellen's (1996a, 1996b) conclusion that the Rorschach Depression Index (DEPI) and the Minnesota Multiphasic Personality Inventory (MMPI) are comparable in their power to identify diagnoses of depression.
Abrahams, N. M.
, & Alf, E. F. (1978). Relative costs and statistical power in the extreme groups approach. Psychometrika, 43, 11-17.
2.
Aiken, L. S.
, & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
3.
Alf, E. F.
, & Abrahams, N. M. (1975). The use of extreme groups in assessing relationships. Psychometrika, 40, 563-572.
4.
Archer, R. P.
, & Gordon, R. A. (1988). MMPI and Rorschach indices of schizophrenic and depressive diagnoses among adolescent inpatients. Journal of Personality Assessment, 52, 276-287.
5.
Archer, R. P.
, & Krishnamurthy, R. (1993a). Combining the Rorschach and the MMPI in the assessment of adolescents.Journal of Personality Assessment, 60, 132-140.
6.
Archer, R. P.
, & Krishnamurthy, R. (1993b). A review of MMPI and Rorschach interrelationships in adult samples. Journal of Personality Assessment, 61, 277-293.
7.
Archer, R. P.
, & Krishnamurthy, R. (1997). MMPI-A and Rorschach indices related to depression and conduct disorder: An evaluation of the incremental validity hypothesis. Journal of Personality Assessment, 69, 517-533.
8.
Atkinson, L.
(1986). The comparative validities of the Rorschach and the MMPI: A meta-analysis. Canadian Psychology, 27, 238-247.
9.
Ball, J. D.
, Archer, R. P., Gordon, R. A., & French, J. (1991). Rorschach depression indices with children and adolescents: Concurrent validity findings. Journal of Personality Assessment, 57, 465-476.
10.
Bell, M. D.
, Billington, R., & Becker, B. (1986). A scale for the assessment of object relationships: Reliability, validity, and factorial invariance. Journal of Clinical Psychology, 42, 733-741.
11.
Bessell, H.
(1984). The love test. New York: William Morrow.
12.
Burns, B.
(1994). An object relations study: Relationship between the Rorschach Human Experience Variable and interpersonal relatedness among nonpatients (Doctoral dissertation, California School of Professional Psychology, San Diego, 1993). Dissertation Abstracts, 54, 3847B-3847B.
13.
Burns, B.
, & Viglione, D. J. (1996). The Rorschach Human Experience variable, interpersonal relatedness, and object representation in nonpatients. Psychological Assessment, 8, 92-99.
14.
Burns, B.
, & Viglione, D. J. (1997). Correction to Burns and Viglione (1996). Psychological Assessment, 9, 82-82.
15.
Butcher, J. N.
, Dahlstrom, W. G., Graham, J. R., Tellegen, A., & Kaemmer, B. (1989). Minnesota Multiphasic Personality Inventory-2 (MMPI-2): Manual for administration and scoring. Minneapolis: University of Minnesota Press.
16.
Carlson, C. F.
, Kula, M. L., & St. Laurent, C. M. (1997). Rorschach revised DEPI and CDI with inpatient major depressives and borderline personality disorder with major depression: Validity issues. Journal of Clinical Psychology, 53, 51-58.
17.
Carter, C. L.
, & Dacey, C. M. (1996). Validity of the Beck Depression Inventory, MMPI, and Rorschach in assessing adolescent depression. Journal of Adolescence, 19, 223-231.
18.
Cohen, J.
, & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed). Hillsdale, NJ: Erlbaum.
19.
Darlington, R. B.
(1990). Regression and linear models. New York: McGraw-Hill.
20.
Dawes, R. M.
(1994). House of cards: Psychology and psychotherapy built on myth. New York: Free Press.
21.
Exner, J. E.
(1974). The Rorschach: A Comprehensive System. Volume 1. New York: Wiley.
22.
Exner, J. E.
(1978). The Rorschach: A Comprehensive System. Volume 2: Current research and advanced interpretation. New York: Wiley.
23.
Exner, J. E.
(1986). The Rorschach: A Comprehensive System. Volume 1: Basic foundations (2nd ed.). New York: Wiley.
24.
Exner, J. E.
(1991). The Rorschach: A Comprehensive System. Volume 2: Interpretation (2nd ed.). New York: Wiley.
25.
Exner, J. E.
(1993). The Rorschach: A Comprehensive System. Volume 1: Basic foundations (3rd ed.). New York: Wiley.
26.
Exner, J. E.
(1996). A comment on "The Comprehensive System for the Rorschach: A critical examination."Psychological Science, 7, 11-13.
27.
Exner, J. E.
, Kinder, B. N., & Curtiss, G. (1995). Reviewing basic design features. In J. E. Exner (Ed.), Issues and methods in Rorschach research (pp. 145-158). Mahwah, NJ: Erlbaum.
28.
Exner, J. E.
, & Weiner, I. B. (1982). The Rorschach: A Comprehensive System. Volume 3: Assessment of Children and Adolescents. New York: Wiley.
29.
Exner, J. E.
, & Weiner, I. B. (1995). The Rorschach: A Comprehensive System. Volume 3: Assessment of children and adolescents (2nd ed.). New York: Wiley.
30.
Eysenck, H. J.
(1959). The Rorschach Inkblot Test. In O. K. Buros (Ed.), The fifth mental measurements yearbook (pp. 276-278). Highland Park, NJ: Gryphon Press.
31.
Feldt, L. S.
(1961). The use of extreme groups to test for the presence of a relationship. Psychometrika, 26, 307-316.
32.
Ganellen, R. J.
(1996a). Comparing the diagnostic efficiency of the MMPI, MCMI-II, and Rorschach: A review. Journal of Personality Assessment, 67, 219-243.
33.
Ganellen, R. J.
(1996b). Integrating the Rorschach and the MMPI-2 in personality assessment. Mahwah, NJ: Erlbaum.
34.
Gann, M. K.
(1995). The Rorschach and other projective methods. In J. Ziskin (Ed.), Coping with psychiatric and psychological testimony. Vol. II: Special topics (5th ed.; pp. 823-884). Los Angeles: Law and Psychology Press.
35.
Garb, H. N.
, Florio, C. M., & Grove, W. M. (1998). The validity of the Rorschach and the Minnesota Multiphasic Personality Inventory: Results from meta-analyses. Psychological Science, 9, 402-404.
36.
Garb, H. N.
, Florio, C. M., & Grove, W. M. (in press). The Rorschach controversy: Reply to Parker, Hunsley, and Hanson. Psychological Science.
37.
Garg, R.
(1983). An empirical comparison of three strategies used in extreme group designs. Educational and Psychological Measurement, 43, 359-371.
38.
Hartman, W. L.
, Clark, M. E., Morgan, M. K., Dunn, V. K., Fine, A. D., Perry, G. G., & Winsch, D. L. (1990). Rorschach structure of a hospitalized sample of Vietnam veterans with PTSD. Journal of Personality Assessment, 54, 149-159.
39.
Hathaway, S. R.
, & McKinley, J. C. (1943). Manual for the Minnesota Multiphasic Personality Inventory. New York: The Psychological Corporation.
40.
Haynes, S. N.
(1978). Principles of behavioral assessment. New York: Gardner Press.
41.
Hosmer, D. W.
, & Lemeshow, S. (1989). Applied logistic regression. New York: John Wiley & Sons.
42.
Hunsley, J.
, & Bailey, J. M. (in press). The clinical utility of the Rorschach: Unfulfilled promises and an uncertain future. Psychological Assessment.
43.
Jansak, D. M.
(1997). The Rorschach Comprehensive System Depression Index, depression heterogeneity, and the role of self-schema (Doctoral dissertation, California School of Professional Psychology, San Diego, 1996). Dissertation Abstracts International, 57, 6576B-6576B.
44.
Jensen, A. R.
(1965). The Rorschach Inkblot Test. In O. K. Buros (Ed.), The sixth mental measurements yearbook (pp. 501-509). Highland Park, NJ: Gryphon Press.
45.
Krishnamurthy, R.
, Archer, R. P., & House, J. J. (1996). The MMPI-A and Rorschach: A failure to establish convergent validity. Assessment, 3, 179-191.
46.
McCann, J. T.
(1998). Defending the Rorschach in court. An analysis of admissibility using legal and professional standards. Journal of Personality Assessment, 70, 125-144.
47.
McClelland, G. H.
, &Judd, C. M. (1993). Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin, 114, 376-390.
48.
McDowell, C. J.
, & Acklin, M. W. (1996). Standardizing procedures for calculating Rorschach interobserver reliability: Conceptual and empirical foundations. Journal of Personality Assessment, 66, 308-320.
49.
McNemar, Q.
(1960). At random: Sense and nonsense. American Psychologist, 15, 295-300.
50.
Meyer, G. J.
(1993). The impact of response frequency on the Rorschach constellation indices and on their validity with diagnostic and MMPI-2 criteria. Journal of Personality Assessment, 60, 153-180.
51.
Meyer, G. J.
(1997a). Assessing reliability: Critical corrections for a critical examination of the Rorschach Comprehensive System. Psychological Assessment, 9, 480-489.
52.
Meyer, G. J.
(1997b). On the integration of personality assessment methods: The Rorschach and MMPI. Journal of Personality Assessment, 68, 297-330.
53.
Meyer, G. J.
(1997c). Thinking clearly about reliability: More critical corrections regarding the Rorschach Comprehensive System. Psychological Assessment, 9, 495-498.
54.
Meyer, G. J.
, & Handler, L. (1997). The ability of the Rorschach to predict subsequent outcome: A meta-analysis of the Rorschach Prognostic Rating Scale. Journal of Personality Assessment, 69, 1-38.
55.
Meyer, G. J.
, Finn, S. E., Eyde, L. D., Kay, G. G., Kubiszyn, T. W., Moreland, K. L., Eisman, E. J., & Dies, R. R. (1998). Benefits and costs of psychological assessment in healthcare deliver: Report of the board of professional affairs psychological assessment work group, Part 1. Washington, DC: American Psychological Association.
56.
Nezworski, M. T.
, & Wood, J. M. (1995). Narcissism in the Comprehensive System for the Rorschach. Clinical Psychology: Science and Practice, 2, 179-199.
57.
Parker, K. C. H.
, Hanson, R. K., & Hunsley, J. (1988). MMPI, Rorschach, and WAIS: A meta-analytic comparison of reliability, stability, and validity. Psychological Bulletin, 103, 367-373.
58.
Parker, K. H. C.
, Hunsley, J., & Hanson, R. K. (in press). Old wine from old skins sometimes tastes like vinegar: A response to Garb, Florio, and Grove. Psychological Science.
59.
Pedhazur, E. J.
(1982). Multiple regression in behavioral research (2nd ed.). New York: Holt, Rinehart & Winston.
60.
Perry, W.
, & Viglione, D. J. (1991). The Ego Impairment Index as a predictor of outcome in melancholic depressed patients treated with tricyclic antidepressants. Journal of Personality Assessment, 56, 487-501.
61.
Pitts, S. C., & West, S. G. (1998). Alternative sampling designs to detect interactions in multiple regression. Unpublished manuscript, Arizona State University.
62.
Ritzler, B. A.
, & Exner, J. E. (1995). Special issues in subject selection and design. In J. E. Exner (Ed.), Issues and methods in Rorschach research (pp. 123-143). Mahwah, NJ: Erlbaum.
63.
Rorschach, H.
(1921). Psychodiagnostic. Bern, Switzerland: Bircher (Transl. Han Huber Verlag, 1942).
64.
Sechrest, L.
, Stickle, T. R., & Stewart, M. (1998). The role of assessment in clinical psychology. In A. Bellack, M. Hersen, (Series Eds.) & C. R. Reynolds, (Vol. Ed.), Comprehensive clinical psychology. Vol. 4: Assessment, (pp. 1-32).
65.
Sells, J. E.
(1991). A validity study of the DEPI index: The Rorschach Comprehensive System (Doctoral dissertation, University of Utah, 1990). Dissertation Abstracts International, 51, 5590B-5590B.
66.
Singer, H. K.
, & Brabender, V. (1993). The use of the Rorschach to differentiate unipolar and bipolar disorders. Journal of Personality Assessment, 60, 333-345.
67.
Sloan, P.
, Arsenault, L., Hilsenroth, M., Harvill, L., & Handler, L. (1995). Rorschach measures of posttraumatic stress in Persian Gulf War veterans. Journal of Personality Assessment, 64, 397-414.
68.
Swanson, G. S.
, Blount, J., & Bruno, R. (1990). Comprehensive System Rorschach data on Vietnam combat veterans.Journal of Personality Assessment, 54, 160-169.
69.
Tilden, R. S. (1989). Predicting marital adjustment with level of object relations, romantic love, and emotional maturity. Unpublished doctoral dissertation, United States International University, San Diego, CA.
70.
Viglione, D. J.
(1997). Problems in Rorschach research and what to do about them. Journal of Personality Assessment, 68, 590-599.
71.
Viglione, D. J.
, Brager, R. C., & Haller, N. (1988). Usefulness of structural Rorschach data in identifying inpatients with depressive symptoms: A preliminary study. Journal of Personality Assessment, 52, 524-529.
72.
Viglione, D. J.
, & Exner, J. E. (1995). Formulating issues in Rorschach research. In J. E. Exner (Ed.), Issues and methods in Rorschach research (pp. 53-71). Mahwah, NJ: Erlbaum.
73.
Weiner, I. B.
(1995). Methodological considerations in Rorschach research. Psychological Assessment, 7, 330-337.
74.
Weiner, I. B.
(1996). Some observations on the validity of the Rorschach Inkblot Method. Psychological Assessment, 8, 206-213.
75.
Weiner, I. B.
(1997). Current status of the Rorschach Inkblot Method.Journal of Personality Assessment, 68, 5-19.
76.
Wood, J. M.
, Nezworski, M. T., & Stejskal, W. J. (1996a). The Comprehensive System for the Rorschach: A critical examination. Psychological Science, 7, 3-10.
77.
Wood, J. M.
, Nezworski, M. T., & Stejskal, W. J. (1996b). Thinking critically about the Comprehensive System for the Rorschach. A reply to Exner. Psychological Science, 7, 14-17.
78.
Wood, J. M.
, Nezworski, M. T., & Stejskal, W. J. (1997). The reliability of the Comprehensive System for the Rorschach: A Comment on Meyer (1997). Psychological Assessment, 9, 490-494.
79.
Zubin, J.
, Eron, L. D., & Schumer, F. (1965). An experimental approach to projective techniques. New York: Wiley.
