This paper reviews recent progress in the assessment of the psychopathology of psychosis and focuses upon a number of persistent limitations. In particular the over-emphasis upon reliability at the expense of validity is highlighted and the relationship between reliability and validity is reconsidered. A number of strategies aimed at improving the validity of psychopathological measures are outlined. Proposals to deploy such variables differently in research strategies and analyses are endorsed.
References
1.
PfohlBAndreasenNC. Development of classifications systems in psychiatry. Comprehensive Psychiatry1978; 19: 197–207
2.
SkinnerHA. Toward the integration of classification theory and methods. Journal of Abnormal Psychology1981; 90: 68–87
3.
SchwartzMAWigginsOP. Logical empiricism and psychiatric classification. Comprehensive Psychiatry1986; 27: 101–114
4.
FaustDMinerRA. The empiricist and his new clothes: DSM III in perspective. American Journal of Psychiatry1986; 143: 962–967
5.
HavensL. Historical perspectives on diagnosis in psychiatry. Comprehensive Psychiatry1985; 26: 326–336
6.
KendellRE. The Role of Diagnosis in Psychiatry. London: Blackwell Scientific Publications, 1975
7.
RobinsLNHelzerJE. Diagnosis and clinical assessment: the current state of psychiatric diagnosis. Annual Review of Psychology1986; 37: 409–432
8.
MaltUF. Philosophy of science and DSM III. Acta Psychiatrica Scandinavica, Supplementum No. 328, 1986; 73: 10–18
9.
KreitmanN. The reliability of psychiatric diagnosis. Journal of Mental Science1961; 107: 878–886
10.
BeckAT. Reliability of psychiatric diagnosis: a critique of systematic studies. American Journal of Psychiatry1962; 119: 210–216
11.
CooperJEKendellREGurlandBJPsychiatric diagnosis in New York and London. Maudsley Monographs No. 20, 1972
12.
SpitzerRLFleissJL. A re-analysis of the reliability of psychiatric diagnosis. British Journal Psychiatry1974; 125: 341–347
13.
FeighnerJPRobinsEGuzeSBDiagnostic criteria for use in psychiatric research. Archives of General Psychiatry, 1972; 26: 57–63
14.
SpitzerRL. Endicott J, Robins E. Research diagnostic criteria: rationale and reliability. Archives of General Psychiatry1978; 35: 773–782
15.
American Psychiatric Association.Diagnostic and Statistical Manual of Mental Disorders. 3rd Edition (DSM-III). Washington D.C., 1980
16.
HedlundJLViewegBW. Structural psychiatric interviews: a comparative review. Journal of Operational Psychiatry1981; 12: 39–67
17.
HelzerJE. Standardized interviews in psychiatry. Psychiatric Developments1983; 2: 161–178
18.
BlashfieldRK. The Classification of Psychopathology: Neo-Kraepelinian and Quantitative Approaches. New York: Plenum Press, 1984
19.
NunallyJC. Psychometric Theory. New York: McGraw-Hill1967
20.
CronbachLJGleserGCNandaHRajaratnamN. The Dependability of Behavioural Measurements: Theory of Generalizability for and profiles. New York: Wiley, 1972
21.
ZubinJSteinhauerSRDayRSchizophrenia at the crossroads: a blueprint for the 80′s. Comprehensive Psychiatry1985; 26: 217–240
22.
CareyGottesman GII. Reliability and validity in binary ratings: areas of common misunderstanding in diagnosis and symptom ratings. Archives of General Psychiatry1978; 35: 1454–1459
23.
LoevingerJ. The attenuation paradox in test theory. Psychological Bulletin1954; 51: 493–504
24.
RobinsLNHelzerJECroughanJNational Institute of Mental Health Diagnostic Interview Schedule. Archives of General Psychiatry1981; 38: 381–389
25.
RegierDAMyersJKKramerMThe Epidemiologic Catchment Area program. Archives of General Psychiatry1984; 41: 934–941
26.
KlermanGL. The National Institute of Mental Health — Epidemiologic Catchment Area (NIMH-ECA) program. Social Psychiatry1986; 21: 159–166
27.
RobinsLN. Epidemiology: reflections on testing the validity of psychiatric interviews. Archives of General Psychiatry1985; 42: 918–924
28.
KendellREBrockingtonIFLeffJP. Prognostic implications of six alternative definitions of schizophrenia. Archives of General Psychiatry1979; 35: 25–31
29.
KetySS. The syndrome of schizophrenia: unresolved questions and opportunities for research. British Journal of Psychiatry1980; 136: 421–436
30.
McGuffinPFarmerACIITwin concordance for operationally defined schizophrenia: confirmation of familiality and heritability. Archives of General Psychiatry1984; 41: 541–545
31.
WingJK. Use and misuse of the PSE. British Journal of Psychiatry1983; 143: 111–117
32.
KlermanGLVaillantGESpitzerRLA debate on DSM-III. American Journal of Psychiatry1984; 141: 539–553
33.
GroveWMAndreasenNCMcDonald-ScottPReliability studies of psychiatric diagnosis: theory and practice. Archives of General Psychiatry1981; 38: 408–413
34.
SpitznagelELHelzerJE. A proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry1985; 42: 725–728
35.
ShroutPESpitzerRLFleissJL. Quantification of agreement in psychiatric diagnoses revisited. Archives of General Psychiatry1987; 22: 172–177
36.
KraemerHC. Letter: Charlie Brown and statistics: an exchange. Archives of General Psychiatry. 1987; 44: 192–193
37.
SpitznagelELHelzerJE. Letter: Charlie Brown and statistics: an exchange: in reply. Archives of General Psychiatry1987; 44: 194–195
38.
MoosRH. Psychosocial techniques in the assessment of adaptive behaviour. In Coping and Adaptation (eds. CoelhoG.V.HamburgD.A.AdamsJ.E.), pp. 334–399. New York: Basic Books Inc., 1974
39.
VaillantGEBondMVaillantCO. An empirically validated hierarchy of defense mechanisms. Archives of General Psychiatry1986; 43: 786–794
40.
BrockingtonIFKendellRELeffJP. Definitions of schizophrenia: concordance and prediction of outcome. Psychological Medicine1978; 8: 387–398
41.
BrockingtonIFLeffJP. Schizoaffective psychosis: definitions and incidence. Psychological Medicine1979; 9: 91–99
42.
BrockingtonIFHelzerJEHillierVFDefinitions of depression: concordance and prediction of outcome. American Journal of Psychiatry1982; 139: 1022–1027
43.
BrockingtonIFHillierVFFrancisAFDefinitions of mania: concordance and prediction of outcome. American Journal of Psychiatry1983; 140: 435–439
44.
EndicottJNeeJFleissJDiagnostic criteria for schizophrenia: reliabilities and agreement between systems. Archives of General Psychiatry1982; 39: 884–889
45.
KendellRE. The choice of diagnostic criteria for biological research. Archives of General Psychiatry1982; 39: 1334–1339
46.
FentonWSMosherLRMathewsSM. Diagnosis of schizophrenia: a critical review of current diagnostic systems. Schizophrenia Bulletin1981; 7: 452–476
47.
StraussJSGiftTE. Choosing an approach for diagnosing schizophrenia. Archives of General Psychiatry1977; 34: 1248–1253
48.
LandmarkJ. A manual for the assessment of schizophrenia. Acta Psychiatrica Scandinavica, Supplementum No. 298, 1982; 65: 1–88
49.
YoungMATannerMAMeltzerHY. Operational definitions of schizophrenia: what do they identify?Journal of Nervous and Mental Disease1982; 170: 443–447
50.
PichotP. The diagnosis and classification of mental disorders in French-speaking countries: background, current views and comparisons with other nomenclatures. Psychological Medicine1982; 12: 475–492
51.
BernerPGabrielEKatschnigHDiagnostic criteria for Schizophrenia and Affective Psychoses. Washington: World Psychiatric Association, 1983
52.
BoyerPPullCSDreyfusJFA computerised diagnostic system for comparing alternative classification schemes of depression. Journal of Affective Disorders1984; 7: 159–171
53.
LewineRBurbachDMeltzerHY. Effect of diagnostic criteria on the ratio of male to female schizophrenic patients. American Journal of Psychiatry1984; 141: 84–87
54.
MajM. Effectiveness of lithium prophylaxis in schizoaffective psychoses: application of a polydiagnostic approach. Acta Psychiatrica Scandinavica1984; 70: 228–234
55.
PhilippMMaierW. The polydiagnostic interview: a structured interview for the polydiagnostic classification of psychiatric patients. Psychopathology1986; 19: 175–185
56.
BrockingtonIF. The polydiagnostic approach. In Psychiatry: The State of the Art. Volume 1: Clinical Psychopathology Nomenclature and Classification. Editors PichotP.BernerP.WolfR.ThauK.. New York: Plenum Press1985
57.
JampalaVCSierlesFSTaylorMA. The use of DSM III in the United States: a case of not going by the book. Comprehensive Psychiatry1988; 29, 39–47
58.
WinokurGZimmermanMCadoretR. ‘Cause the bible tells me so‘. Archives of General Psychiatry1988; 45[,]683–684
59.
ZimmermanM. Why are we rushing to publish DSM-IV?Archives of General Psychiatry1988; 45[,]1135–1138
60.
WingJKCooperJESartoriusN. Measurement and Classification of Psychiatric Symptoms. Cambridge: Cambridge University Press, 1974
61.
LuriaREGuziecRJ. Comparative description of the SADS and PSE. Schizophrenia Bulletin1981; 7: 248–257
62.
McGuffinPKatzRAldrichJ. Past and Present State Examination: the assessment of “lifetime-ever” psychopathology. Psychological Medicine1986; 16: 461–465
63.
CarpenterWTSacksMHStraussJSEvaluating signs and symptoms: comparison of structured interview and clinical approaches. British Journal of Psychiatry1976; 128: 397–403
64.
StraussJSCarpenterWTNasrallahAT. How reliable is the psychiatric history?Comprehensive Psychiatry1978; 19: 213–219
65.
DowningARFrancisAFBrockingtonIF. A comparison of information sources in the study of psychotic illness. British Journal of Psychiatry1980; 137: 38–44
66.
BrockingtonIFMeltzerHY. Documenting an episode of psychiatric illness: need for multiple information sources, multiple raters, and narrative. Schizophrenia Bulletin1982; 8: 485–492
67.
AnthonyJCFolsteinMRomanoskiAJComparison of the lay DIS and a standardised psychiatric diagnosis, experience in eastern Baltimore. Archives General Psychiatry1985; 42: 667–675
68.
SpitzerRLWilliamsJBW. Structured clinical interview for DSM-III (SCID 5/1/84). New York: New York State Psychiatric Institute, 1984
69.
SimonREndicottJNeeJ. Intake diagnosis: how representative?Comprehensive Psychiatry, 1987; 28: 389–396
70.
SirisSGRifkinAReardonGTCourse-related depressive syndromes in schizophrenia. American Journal of Psychiatry1984; 141: 1254–1257
71.
StanglDPfohlBZimmermanMA structured interview for the DSM-III personality disorders. Archives of General Psychiatry1985; 42: 591–596
72.
ZimmermanMPfohlBStanglDAssessment of DSM-III personality disorders: the importance of interviewing an informant. Journal of Clinical Psychiatry1986; 43: 261–263
73.
GrahamPRutterM. The reliability and validity of the psychiatric assessment of the child: II interview with the parent. British Journal of Psychiatry1968; 114: 581–592
74.
BurvillPW. An appraisal of the NIMH Epidemiologic Catchment Area Program. Australian & New Zealand Journal of Psychiatry1987; 21: 175–184
75.
SpitzerRL. Psychiatric diagnosis: are clinicians still necessary?Comprehensive Psychiatry, 1983; 24: 399–411
76.
SchwartzMAWigginsOP. Typifications: the first step for clinical diagnosis in psychiatry. Journal of Nervous and Mental Disease1987; 175: 65–77
77.
WingJKHendersonASWinckleM. The rating of symptoms by a psychiatrist and a non-psychiatrist: a study of patients referred from general practice. Psychological Medicine1977; 7: 713–715
78.
CooperJECopelandJBrownGWFurther studies on interviewer training and inter-rater reliability of the Present State Examination. Psychological Medicine1977; 7: 517–523
79.
GiftTE. Changing diagnostic criteria. American Journal of Psychiatry. 1988; 145: 1414–1415
80.
FentonWSMcGlashanTHHeinssenRK. A comparison of DSM-III and DSM-III-R schizophrenia. American Journal of Psychiatry1988; 145: 1446–1449
81.
KuhnTS. The Essential Tension; Selected Studies in Scientific Tradition and Change. Chicago: University of Chicago Press, 1977
82.
EisenbergL. Disease and illness: distinctions between professional and popular ideas of sickness. Culture Medicine and Psychiatry1977; 1: 9–23
83.
BoydJHBurkeJDGruenbergEExclusion criteria of DSM-III: a study of co-occurrence of hierarchy-free syndromes. Archives General Psychiatry1984; 41: 983–989
84.
SturtE. Hierarchical patterns in the distribution of psychiatric symptoms. Psychological Medicine1981; 11: 783–794
85.
MoreyLC. A comparative validation of the Foulds and Bedford hierarchy of psychiatric symptomatology. British Journal of Psychiatry1985; 146: 424–428
86.
BarlowDHDinardoPAVermilyeaBBCo-morbidity and depression among the anxiety disorders: issues in diagnosis and classification. Journal of Nervous Mental Disease1986; 174: 63–72
87.
CrowTJ. The continuum of psychosis and its implications for the structure of the gene. British Journal of Psychiatry1986; 149: 419–429
88.
American Psychiatric Association.Diagnostic and Statistical Manual of Mental Disorders. 3rd Edition — Revised. (DSM-III-R) Washington D.C., 1987
89.
CooperJE. The Development of the Present State Examination (P.S.E.). In Psychiatry: The State of the Art Volume 1. Clinical Psychopathology Nomenclature and Classification. Editors. PichotP.BernerPWolfR.ThauK.. New York: Plenum Press, 1985
90.
PulverAECarpenterWT. Lifetime psychotic symptoms assessed with the D.I.S. Schizophrenia Bulletin1983; 9: 377–382
91.
ParkerG.Are the lifetime prevalence estimates in the ECA study accurate?Psychological Medicine1987; 17: 275–282
92.
AndreasonNCGroveWMShapiroRWReliability of lifetime diagnosis: a multicenter collaborative perspective. Archives General Psychiatry1981; 38: 400–405
93.
KellerMBLavoriPWMcDonald-ScottPReliability of lifetime diagnosis and symptoms in patients with a current psychiatric disorder. Journal of Psychiatric Research1981; 16: 229–240
94.
HelmesELandmarkJKazarianSS. Inter-rater reliability of twelve diagnostic systems of schizophrenia. Journal of Nervous and Mental Disease1983; 171: 307–311
95.
BrometEJDunnLOConnellMMLong-term reliability of diagnosing lifetime major depression in a community sample. Archives of General Psychiatry1986; 43: 435–440
96.
WestbrookMTVineyLL. Psychological reactions to the onset of chronic illness. Social Science and Medicine1982; 16: 899–905
World Health OrganisationInternational Classification of Impairments, Disabilities and Handicaps. Geneva: WHO Press, 1980
99.
McFarlaneAC. The international classification of impairments disabilities and handicaps: its usefulness in classifying and understanding biopsychosocial phenomena. Australian and New Zealand Journal of Psychiatry1988; 22: 31–42
100.
StraussJCarpenterWT. Schizophrenia. New York: Plenum Press, 1981
101.
HuberG. Das Konzept substratnaher Basissymptome und seine Bedeutung für Theorie und Therapie schizophrener Erkrankungen. Nervenarzt. 1983; 54: 23–32
102.
SpitzerRLSkodolAEWilliamsJBWSupervising intake diagnosis: a psychiatric “rashomon”. Archives of General Psychiatry1982; 39: 1299–1305
103.
ZimmermanMPfohlBCoryellWStanglDCorenthalC. Diagnosing personality disorder in depressed patients. Archives of General Psychiatry. 1988; 45: 733–737
104.
JaspersK. General Psychopathology. Manchester. Manchester University Press, 1963
105.
BuchsbaumMSHaierRJ. Biological homogeneity, symptom heterogeneity, and the diagnosis of schizophrenia. Schizophrenia Bulletin1978; 4: 473–475
106.
HaysP. The nosological status of schizophrenia. Lanceti:1984;1342–1345
107.
SieverLJLCourseyRD. Biological markers for schizophrenia and the biological high-risk approach. Journal of Nervous and Mental Disease1985; 173: 4–16
108.
HelmchenHGaebelW. Strategies of clinical research on neurobiological determinants of psychosis. Psychiatric Developments1987; 1: 51–62
109.
KendellRE. Reflections on psychiatric classification — for the architects of DCM-1V and ICD-10. Integrative Psychiatry1984; 2: 43–57
110.
MeltzerHY. What is schizophrenia?Schizophrenia Bulletin1982; 8: 433–434
111.
WikGWieselFAEnerothPDexamethasone Suppression Test in schizophrenic patients before and during neuroleptic treatment. Acta Psychiatrica Scandinavica1986; 74: 161–167
112.
CopolovDLRubinRTStuartGWSpecificity of the salivary Cortisol dexamethasone suppression test across psychiatric diagnoses. Biological Psychiatry1989 (in press)
113.
BuchsbaumMSde LisiLEHolcombHHAnteroposterior gradients in cerebral glucose use in schizophrenia and affective disorder. Archives of General Psychiatry1984; 41: 1159–1166
114.
RiederROMannLSWeinbergerDRComputed tomographic scans in patients with schizophrenia, schizoaffective and bipolar affective disorder. Archives of General Psychiatry1983; 40: 735–739
115.
OwensDGCJohnstoneECCrowTJLateral ventricular size in schizophrenia: relationship to the disease process and its clinical manifestations. Psychological Medicine1985; 15: 27–41
116.
MirskyAFDuncanCC. Etiology and expression of schizophrenia: neurobiological and psychosocial factors. Annual Review of Psychology1986; 37: 291–319
117.
KovelmanJAScheibelAB. Biological substrates of schizophrenia. Acta Neurologica Scandinavica1986; 73: 1–32
118.
ZubinJ. Commentary on “Reflections on psychiatric classification — for the architects of DSM-IV and ICD-10” by R.E. Kendell. Integrative Psychiatry1984; 2: 52–54
119.
HolzmanP. The fences of psychiatry. American Journal of Psychiatry1985; 142: 217–218
120.
BrownT. Holzman's Fences: Chauvinism or confusion?Archives of General Psychiatry1986; 43: 910–912
121.
BuchsbaumMS. Schizophrenia — a contemporary overview. Paper presented at the 12th Geigy Symposium “The Major Psychoses”. Melbourne: 1986
