Cloze Analysis in Schizophrenic Speech: Scoring Method and Raters' Education

Abstract

This report examines two methodologic concerns pertaining to use of the cloze procedure in studying the predictability of schizophrenic speech, scoring criteria and raters' education (at or below college level). We find that two strategies for scoring the predictions of raters, one requiring the exact word, the other permitting a reasonable synonym, do not appear to differ in distinguishing groups of patients. The accuracy of raters' guessing is, however, correlated with raters' education: the more educated the rater, the more accurate the guessing. Thought-disordered schizophrenic speech is significantly less predictable than that of nonthought-disordered schizophrenics and normal controls when scored by less educated raters. These differences diminish when more highly educated raters are used. We conclude that raters' education can influence the sensitivity of cloze analysis.

Get full access to this article

View all access options for this article.

References

American Psychiatric Association. (1980) Diagnostic and statistical manual of mental disorders. (3rd ed.) Washington, DC: American Psychiatric Press.

Cheek

Amarel

(1968) Studies in the sources of variation in cloze scores: II. The verbal passages. Journal of Abnormal Psychology, 73, 424–430.

Hart

D. S.

Payne

R. W.

(1973) Language structure and predictability in overinclusive patients. British Journal of Psychiatry, 123, 643–652.

Kraepelin

(1919) Dementia praecox and paraphrenia. ( Barclay

R. M.

, transl.) Huntington, NY: Krieger, 1971.

Manschreck

T. C.

Maher

B. A.

Rucklos

M. E.

White

M. T.

(1979) The predictability of thought disordered speech in schizophrenic patients. British Journal of Psychiatry, 134, 595–601.

Ragin

A. B.

Oltmanns

T. F.

(1983) Predictability as an index of impaired verbal communication in schizophrenic and affective disorders. British Journal of Psychiatry, 143, 578–583.

Roget's International Thesaurus. (1977) (4th ed., Rev.) New York: Cromwell.

Rutter

D. R.

Draffan

Davies

(1977) Thought disorder and the predictability of speech in schizophrenic speech. British Journal of Psychiatry, 131, 67–68

Rutter

D. R.

Wishner

Callaghan

B. A.

(1975) The prediction and predictability of speech in schizophrenic patients. British Journal of Psychiatry, 126, 571–576.

10.

Rutter

D. R.

Wishner

Koptynska

Button

(1978) The predictability of speech in schizophrenic patients. British Journal of Psychiatry, 132, 228–232.

11.

Salzinger

(1973) Schizophrenia: behavioral aspects. New York: Wiley.

12.

Salzinger

Portnoy

Feldman

R. S.

(1964) Verbal behavior of schizophrenic and normal subjects. Annals of the New York Academy of Sciences, 105, 845–860.

13.

Salzinger

Portnoy

Feldman

R. S.

(1966) Verbal behavior in schizophrenics and some comments toward a theory of schizophrenia. Proceedings of the American Psychopathological Association, 54, 98–128.

14.

Silverman

(1973) Redundancy, repetition and pausing in schizophrenic speech. British Journal of Psychiatry, 122, 407–413.

15.

Spitzer

Endicott

(1977) Schedule of affective disorders and schizophrenia (SADS). (2nd ed.) New York: Biometrics Research, New York State Psychiatric Institute.

16.

Taylor

(1953) Cloze procedure: a new tool for measuring readability. Journalism Quarterly, 30, 415–423.