Scotched on the ROCs

Abstract

In the last four years an active debate has been conducted in this journal about single-parameter ROC curves and methods for correcting curves that have been subjected to verification bias. The major discussants in this debate have produced these three commentaries on a study recently published in MDM. As a researcher I conclude that Diamond's single-parameter ROC, while conceptually attractive and easy to use, is not free from the verification bias that can be found in many diagnostic assessment studies. As Editor I judge that enough space has been devoted to this problem for the time being. Let the scientific community sort through the material already presented on this topic. May it lead to clinical studies wherein single- parameter ROCs can be profitably applied.—JRB

Get full access to this article

View all access options for this article.

References

Diamond GA ROC steady: a receiver operating characteristic curve that is invariant relative to selection bias. Med Decis Making. 1987;7:238-43.

Begg CB , Greenes RA Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics. 1983;39:207-16.

Fryback DG Ideas at issue. Med Decis Making. 1987;7:238.

Hanley JA , Begg CB Response to ROC steady. Med Decis Making. 1987;7:244-6.

Diamond GA ROCky III. Med Decis Making. 1987;7:247-9.

Tosteson Ana , Begg CB A general regression methodology for ROC curve estimation. Med Decis Making. 1988;8:204-15.

Hunink Mgm , Richardson DK , Doubilet PM , Begg CB Testing for fetal pulmonary maturity: ROC analysis involving covariates, verification bias, and combination testing. Med Decis Making. 1990;10:201-11.

Diamond GA Reverend Bayes' silent majority. An alternative factor affecting sensitivity and specificity of exercise electrocardiography. Am J Cardiol. 1986;57:1175-80.

Diamond GA The origin of specious. Am J Cardiol. 1988 ;62: 175-7.

10.

Gray R. , Begg CB , Greenes RA Construction of receiver operating characteristic curves when disease verification is subject to selection bias. Med Decis Making. 1984;4:151-64.

11.

Diamond GA Limited assurances. Am J Cardiol. 1989;63:99-100.

12.

Hanley JA The robustness of the "binormal" assumptions used in fitting ROC curves. Med Decis Making. 1988;8:197-203.

13.

Diamond GA Afirmative actions: can the discriminant accuracy of a test be determined in the face of selection bias? Med Decis Making. 1991;11:48-56.

14.

Shakespeare W. Macbeth. Act III, Scene II.