Never without its critics, the Rorschach Test continues to be widely used in clinical settings. The test continues to be criticized vigorously. Rorschach critics appear to fall into two broad groups: those leveling valid methodological concerns about the test's behavioral science foundations and "method critics" who appear to deny the validity of the test on strictly a priori or theoretical considerations. Many critics do not appear to be acquainted with the extensive Rorschach research literature. The current paper provides an overview of several domains of applied and laboratory Rorschach behavioral science, including statistical power analysis, interobserver agreement and interrater reliability, Rorschach assessment of thought disorder, and emerging research linking Rorschach variables with diagnostic criteria from the DSM-JiV, as a means of educating both adherents and detractors alike concerning the test's scientific track record and applicability to clinical assessment.
Acklin, M. W.
, McDowell, C. M., & Orndoff, S. (1992). Statistical power and the Rorschach: 1975-199 1. Journal of Personality Assessment, 59, 366-379.
2.
Acklin, M. W.
, McDowell, C. M., & Verschell, M. S. (in press). Interobserver agreement, intraobserver reliability, and the Rorschach Comprehensive System. Journal of Personality Assessment.
3.
American Psychiatric Association
. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
4.
Arboleda, C.
, & Holzman, P. S. (1985). Thought disorder in children at risk for psychosis. Archives of General Psychiatry, 42, 1004-1013.
5.
Archer, R. P.
, Maruish, M., Imhof, E., & Piotrowski, C. (1991). Psychological test usage with adolescent clients: 1991 survey findings. Professional Psychology: Research & Practice, 22, 247-252.
6.
Baity, M. R.
, & Hilsenroth, M. J. (1999). Rorschach aggression variables: A study of reliability and validity. Journal of Personality Assessment, 72, 93-110.
7.
Berk, R. A.
(1979). Generalizability of behavioral observations: A clarification of interobserver agreement and interobserver reliability. American Journal of Mental Disability, 83(5), 460-472.
8.
Blais, M.
, Hilsenroth, M., Castlebury, F., Fowler, J., & Baity, M. (in press). Predicting DSM-IV Cluster B personality disorder criteria from MMPI-2 and Rorschach data: A test of incremental validity. Journal of Personality Assessment.
9.
Blais, M. A.
, Hilsenroth, M. J., & Fowler, C. (1998). Rorschach correlates of the DSM-IV histrionic personality disorder.Journal of Personality Assessment, 70(2), 355-364.
10.
Blais, M.
, Hilsenroth, M., Fowler, C., & Conboy, C. (1999). A Rorschach exploration of the DSM-IV borderline personality disorder.Journal of Clinical Psychology, 55, 1-10.
11.
Chapman, L.
, Chapman, J., & Raulin, M. (1978). Bodyimage aberration in schizophrenia. Journal of Abnormal Psychology, 87, 399-407.
12.
Cohen, J.
(1962). The statistical power of abnormal-social psychological research. Journal of Abnormal and Social Psychology, 65, 49-55.
13.
Cohen, J.
(1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
14.
Coleman, M. J.
, Carpenter, J., Waternaux, C., Levy, D., Shenton, M., Perry, J., Medoff, D., Wong, H., Monoach, D., Meyer, P., O'Brian, C., Valention, C., Robinson, D., Smith, M., Makowski, D., & Holzman, P. (1993). The Thought Disorder Index: A reliability study. Psychological Assessment, 5(3), 336-342.
15.
Coleman, M.
, Levy, D., Lenzenweger, M., & Holzman, P. (1996). Thought disorder, perceptual aberrations, and schizotypy.Journal of Abnormal Psychology, 105(3), 469-473.
16.
Daniels, E. K.
, Shenton, M., Holzman, P., Benowitz, L., Coleman, M., Levin, S., & Levine, D. (1988). Patterns of thought disorder associated with right cortical damage, schizophrenia, and mania. American Journal of Psychiatry, 145(8), 944-949.
17.
Edell, W. S.
(1987). Role of structure in disordered thinking in borderline and schizophrenic disorders.Journal of Personality Assessment, 51(1), 23-41.
18.
Exner, J. E.
(1991). The Rorschach: A Comprehensive System. Vol. 2: Interpretation (2nd ed.). New York: John Wiley & Sons.
19.
Exner, J. E.
(1993). The Rorschach: A Comprehensive System. Vol. 1: Basic foundations (3rd ed.). New York: Wiley & Sons.
20.
Exner, J. E.
, & Weiner, I. B. (1994). The Rorschach: A Comprehensive System. Vol. 3: Assessment of children and adolescents. New York: John Wiley & Sons.
21.
Garb, H.
, Florio, C., & Grove, W. (1998). The validity of the Rorschach and Minnesota Multiphasic Personality Inventory: Result from meta-analyses. Psychological Science, 9(5), 402-404.
22.
Gold, J. M.
, & Hurt, S. (1990). The effects of haloperidol on thought disorder and IQ in schizophrenia. Journal of Personality Assessment, 54(1&2), 390-400.
23.
Haimo, S.
, & Holzman, P. S. (1979). Thought disorder in schizophrenics and normal controls: Social class and race differences. Journal of Consulting and Clinical Psychology, 47(5), 963-967.
24.
Hain, C.
, Maier, W., Hoechst-Janneck, S., & Franke, P. (1995). Subclinical thought disorder in first degree relatives of schizophrenic patients. Acta Psychiatrica Scandinavica, 92, 305-309.
25.
Harris, D.
(1993). The prevalence of thought disorder in personality-disordered outpatients. Journal of Personality Assessment, 61(1), 112-120.
26.
Hathaway, S. R.
, & McKinley, J. C. (1943). Manual for the Minnesota Multiphasic Personality Inventory. New York: The Psychological Corporation.
27.
Hiller, J. B.
, Rosenthal, R., Bornstein, R. F., Berry, D., & Brunell-Neulieb, S. (in press). Rorschach and MMPI validity. Psychological Assessment.
28.
Hilsenroth, M. J.
, Fowler, C., & Padawer, J. (1998). The Rorschach Schizophrenia Index (SCZI): An examination of reliability, validity, and diagnostic efficiency. Journal of Personality Assessment, 70, 514-534.
29.
Hilsenroth, M. J.
, Fowler, J. C., Padawer, J. R., & Handler, L. (1997). Narcissism in the Rorschach revisited: Some reflections on empirical data. Psychological Assessment, 9(2), 113-121.
30.
Holzman, P. S.
(1986). Thought disorder in schizophrenia: Editor's introduction. Schizophrenia Bulletin, 12, 342-347.
31.
Holzman, P. S.
(1995). Thought disorders and the fundamental disturbance in schizophrenia. Schizophrenia, 38, 409-417.
32.
Holzman, P. S.
, Coleman, M., Lezenweger, M., Levy, D., Matthysee, S., O'Driscoll, G., & Park, S. (1995). Working memory deficits, antisaccades, and thought disorder in relation to perceptual aberration. In A. Raine (Ed.), Schizotypal personality. New York: Cambridge University Press.
33.
Holzman, P. S.
, Shenton., M., & Solovay, M. (1986). Quality of thought disorder in differential diagnosis. Schizophrenia Bulletin, 12(3), 360-372.
34.
Holzman, P. S.
, Solovay, M., & Shenton, M. (1985). Thought disorder specificity in functional psychoses. In M. Alpert (Ed.), Controversies in schizophrenia (pp. 228-245). New York: Guilford Press.
35.
Hurt, S.
, Holzman, P., & Davis, J. (1983). Thought disorder: The measurement of its changes. Archives of General Psychiatry, 40, 1281-1285.
36.
Johnston, M. H.
, & Holzman, P. S. (1979). Assessing schizophrenic thinking. San Francisco: Jossey Bass.
37.
Khadivi, A.
, Wetzler, S., & Wilson, A. (1997). Manic indices on the Rorschach. Journal of Personality Assessment, 69(2), 365-375.
38.
Kinney, D. K.
, Holzman, P., Jacobsen, B., Jansson, L., Faber, B., Hildebrand, W., Kasell, E., & Zimbalist, M. (1997). Thought disorder in schizophrenic and control adoptees and their relatives. Archives of General Psychiatry, 54, 475-479.
39.
Kleiger, J. H.
(1999). Disordered thinking and the Rorschach: Theory, research, and differential diagnosis. Mahwah, NJ: Analytic Press.
40.
Koistinen, P.
(1995). Thought disorder and the Rorschach. Oulu, Finland: Oulun Yliopistd.
41.
Lees-Haley, P.
(1992). Psychodiagnostic test usage by forensic psychologists. American Journal of Forensic Psychology, 10, 25-30.
42.
Levy, D. L.
, Smith, M., Robinson, D., Jody, D., Lerner, G., Alvir, J., Geisler, S., Szymanski, S., Gonzalez, A., Mayerhoff, D., Lieberman, J., & Mendell, N. (1993). Methylphenidate increases thought disorder in recent onset schizophrenics, but not in normal controls. Biological Psychiatry, 34, 507-514.
43.
Lubin, B.
, Larsen, R. M., & Matarazzo, J. (1984). Patterns of psychological test usage in the United States: 1935-1982. American Psychologist, 39, 451-454.
44.
Makowski, D.
, Waternaux, C., Lajonchere, C., Dicker, R., Smoke, N., Koplewicz, H., Min, D., Mendell, N., & Levy, D. (1997). Thought disorder in adolescent-onset schizophrenia. Schizophrenia Research, 23, 147-165.
45.
McDowell, C. M.
, & Acklin, M. W. (1996). Standardizing procedures for calculating Rorschach interrater reliability: Conceptual and empirical foundations. Journal of Personality Assessment, 66(2), 308-320.
46.
Meyer, G.
, Baxter, D., Exner, J., Fowler, C., Hilsenroth, M., & Piers, C. (1999). An examination of interrater reliability for scoring the Rorschach Comprehensive System in five data sets. Manuscript submitted for publication.
47.
Nestor, P.
, Shenton, M., Wible, C., Hokama, H., O'Donnell, B., Law, S., & McCarley, R. (1998). A neuropsychological analysis of schizophrenic thought disorder. Schizophrenia Research, 29, 217-225.
48.
O'Connell, M.
, Cooper, S., Perry, C., & Hoke, L. (1989). The relationship between thought disorder and psychotic symptoms in borderline personality disorder. The Journal of Nervous and Mental Disease, 177(5), 273-278.
49.
Parker, K.
(1983). A meta-analysis of the reliability and validity of the Rorschach. Journal of Personality Assessment, 47, 227-231.
50.
Parker, K.
, Hanson, R., & Hunsley, J. (1988). MMPI, Rorschach, and WAIS: A meta-analytic comparison of reliability, stability, and validity. Psychological Bulletin, 103, 367-373.
51.
Parker, K.
, Hunsley, J., & Hanson, R. (1999). Old wine from old skins sometimes tastes like vinegar: A response to Garb, Florio, and Grove. Psychological Science, 10(3), 291-292.
52.
Pinkerman, J.
, Haynes, J., & Keiser, T. (1993). Characteristics of psychological practice in juvenile courts. American Journal of Forensic Psychology, 11, 3-12.
53.
Rossi, J. S.
(1990). Statistical power of psychological research: What have we gained in 20 years?Journal of Consulting and Clinical Psychology, 58, 646-656.
54.
Sedlmeier, P.
, & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies?Psychological Bulletin, 105, 309-316.
55.
Shenton, M. E.
, Ballinger, R., Marcy, B., Faux, S., Cane, M., Lemay, M., Cassen, G., Coleman, M., Duffy, F., & McCarley, R. (1989). Two syndromes of schizophrenic psychopathology associated with left vs. right temporal deficits in P300 amplitude. The Journal of Nervous and Mental Disease, 177(4), 219-225.
56.
Shenton, M. E.
, Faux, S., McCarley, R., Ballinger, R., Coleman, M., & Duffy, F. (1989). Clinical correlations of auditory P200 topography and left-temporo-central deficits in schizophrenia: A preliminary study. Journal of Psychiatric Research, 23(1), 13-34.
57.
Shenton, M. E.
, Faux, S., McCarley, R., Ballinger, R., Coleman, M., Torello, M., & Duffy, F. (1989). Correlations between abnormal auditory P300 topography and positive symptoms in schizophrenia: A preliminary report. Biological Psychiatry, 25, 710-716.
58.
Shenton, M. E.
, Kikinis, R., Jolesz, F., Pollak, S., LeMay, M., Wible, C., Hokama, H., Martin, J., Metcalf, D., Coleman, M., & McCarley, R. (1992). Abnormalities of the left temporal lobe and thought disorder in schizophrenia: A quantitative magnetic resonance imaging study. The New EnglandJournal of Medicine, 327(9), 604-612.
59.
Shenton, M. E.
, Solovay, M., & Holzman, P. S. (1987). Comparative studies of thought disorder: II. Schizoaffective disorder. Archives of General Psychiatry, 44, 21-30.
60.
Shenton, M. E.
, Solovay, M., Holzman, P., Coleman, M., & Gale, H. (1989). Thought disorder in the relatives of psychotic patients. Archives of General Psychiatry, 46, 897-901.
61.
Skelton, M.
, Boik, R., & Madero, J. (1995). Thought disorder on the WAIS-R relative to the Rorschach: Assessing identity-disordered adolescents. Journal of Personality Assessment, 65(3), 533-549.
62.
Solomon, C. M.
, Holzman, P., Levin, S., & Gale, H. (1987). The association between eye-tracking dysfunctions and thought disorder in psychosis. Archives of General Psychiatry, 44, 31-35.
63.
Solovay, M.
, Shenton, M., Gasperetti, C., Coleman, M., Daniels, E., Carpenter, J., & Holzman, P. (1986). Scoring manual for the Thought Disorder Index. Schizophrenia Bulletin, 12(3), 483-496.
64.
Solovay, M.
, Shenton, M. E., & Holzman, P. S. (1987). Comparative studies of thought disorder. I. Mania and schizophrenia. Archives of General Psychiatry, 44, 13-20.
65.
Spitzer, R.
, Cohen, J., Fleiss, J., & Endicott, J. (1967). Quantification of agreement in psychiatric diagnosis: A new approach. Archives of General Psychiatry, 17, 83-87.
66.
Suen, H.
, & Ary, D. (1989). Analyzing quantitative behavioral observation data. Hillsdale, NJ: Erlbaum.
67.
Weiner, I. B.
(1995). Methodological considerations in Rorschach research. Psychological Assessment, 7(3), 330-337.
68.
Weiner, I.
(1996). Some observations on the validity of the Rorschach Inkblot Method. Psychological Assessment, 8(2), 206-213.
