A Comparison of Non-Adjusted and Bootstrapped Methods: Bootstrapped Diagnosis Might be Worth the Trouble

Abstract

This study compared the diagnostic accuracy of non-adjusted (Rorer, Hoffman, LaForge, and Hsieh, 1966) and bootstrapped (Rorer and Dawes, 1982) diagnosis using a sample of 1,455 psychiatric inpatients who had completed the Millon Clinical Multiaxial Inventory. The usefulness of bootstrapping depended on the criteria for accuracy. Bootstrapping showed no benefit with regard to overall accuracy. Sensitivity increased for five scales upon bootstrapping, although specificity decreased on two scales. The strongest support for bootstrapped diagnosis was in terms of positive and negative predictive power. Positive predictive power increased for 10 scales upon bootstrapping, with no loss in negative predictive power. The discussion examines the conditions under which bootstrapping might increase diagnostic accuracy.

Get full access to this article

View all access options for this article.

References

Dawes, R. M. (1962). A note on base rates and psychometric efficiency. Journal of Consulting Psychology, 26, 422-424.

Finn, S. E. (1982). Base rates, utilities, and DSM-III: Shortcomings of fixed-rule systems of psychodiagnosis. Journal of Abnormal Psychology, 91, 294-302.

Finn, S. E. (1983). Utility-balanced and utility-imbalanced rules: Reply to Widiger. Journal ofAbnonnal Psychology, 92, 499-501.

Gibertini, M. , Brandenburg, N. A. , and Retzlaff, P. D. (1986). The operating characteristics of the Millon Clinical Multiaxial Inventory. Journal of Personality Assessment, 50, 554-567.

Grove, W. M. (1985). Bootstrapping diagnoses using Baye's Theorem: It's not worth the trouble. Journal of Consulting and Clinical Psychology, 53, 261-263.

Meehl, P. E. (1986). Diagnostic taxa as open concepts: Metatheo-retical and statistical questions about reliability and construct validity. In T. Millon and G. L. Klerman (Eds.), Contemporary Directions in Psychopathology: Toward the DSM-IV. New York: Guilford.

Meehl, P. E. and Rosen, A. (1955). Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychological Bulletin, 52, 194-216.

Millon, T. (1983). Millon Clinical Multiaxial Inventory Manual, Third Edition. Minneapolis: Interpretive Scoring Systems.

Paulson, M. and Lin, T. (1970). Predicting WAIS-IQ from Shipley-Hartford scores. Journal of Clinical Psychology, 26, 453-461.

10.

Rorer, L. G. and Dawes, R. M. (1982). A base-rate bootstrap. Journal of Consulting and Clinical Psychology, 50, 419-425.

11.

Rorer, L. G. , Hoffman, P. J. , LaForge, G. E. , and Hsieh, K. C. (1966). Optimum cutting scores to discriminate groups of un-equal size and variance. Journal of Applied Psychology, 50, 153-164.

12.

Rorer, L. G. , Hoffman, P. J. , and Hsieh, K. (1966). Utilities as base-rate multipliers in the determination of optimum cutting scores for the discrimination of groups of unequal size and variance. Journal of Applied Psychology, 50, 364-368.

13.

Widiger, T. A. (1983). Utilities and fixed rules: Comments on Finn. Journal of Abnormal Psychology, 92, 495-498.