Sage Journals: Discover world-class research

Abstract

The receiver-operating characteristic surface is frequently used for presenting the accuracy of a diagnostic test for three-category classification problems. One common problem that can complicate the estimation of the volume under receiver-operating characteristic surface is that not all subjects receive the verification of the true disease status. Estimation based only on data from subjects with verified disease status may be biased, which is referred to as verification bias. In this article, we propose new verification bias correction methods to estimate the volume under receiver-operating characteristic surface for a continuous diagnostic test. We assume the verification process is missing not at random, which means the missingness might be related to unobserved clinical characteristics. Three classes of estimators are proposed, namely, inverse probability weighted, imputation-based, and doubly robust estimators. A jackknife estimator of variance is derived for all the proposed volume under receiver-operating characteristic surface estimators. The finite sample properties of the new estimators are examined via simulation studies. We illustrate our methods with data collected from Alzheimer’s disease research.

Keywords

Diagnostic test doubly robust missing not at random verification bias volume under receiver-operating characteristic surface

Get full access to this article

View all access options for this article.

References

Schneider

Arvarnitakis

Bang

et al.

Mixed brain pathologies account for most dementia cases in community-dwelling older persons. Neurol 2007; 69: 2197–2204.

White

Small

Petrovitch

et al.

Recent clinical-pathologic research on the causes of dementia in late life: update from the Honolulu-Asia Aging Study. J Geriatr Psychiatr Neurol 2005; 18: 224–227.

Misra

Fan

Davatzikos

. Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of short-term conversion to AD: results from ADNI. NeuroImage 2009; 44: 1415–1422.

Begg

Greenes

. Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics 1983; 39: 207–215.

Ransohoff

Feinstein

. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. New Engl J Med 1978; 299: 926–930.

Scurfield

. Multiple-event forced-choice tasks in the theory of signal detectability. J Math Psychol 1978; 40: 253–269.

Chi

Zhou

. Receiver operating characteristic surfaces in the presence of verification bias. J Roy Stat Soc C Appl Stat 2008; 57: 1–23.

Duc

Chiogna

Adimari

. Bias-corrected methods for estimating the receiver operating characteristic surface of continuous diagnostic tests. Electron J Stat 2016; 10(2): 3063–3113.

Zhang

Alonzo

. Inverse probability weighting estimation of the volume under the ROC surface in the presence of verification bias. Biometrical J 2016; 58: 1338–1356.

10.

Little

Rubin

. Statistical analysis with missing data, New York: Wiley, 1987.

11.

Baker . Evaluating multiple diagnostic tests with partial verification. Biometrics 1995; 51: 330–337.

12.

Kosinski

Barnhart

. Accounting for nonignorable verification bias in assessment of diagnostic tests. Biometrics 2003; 59: 163–171.

13.

Zhou

. Maximum likelihood estimators of sensitivity and specificity corrected for verification bias. Comm Stat Theor Meth 1993; 22: 3177–3198.

14.

Zhou

. Effect of verification bias on positive and negative predictive values. Stat Med 1994; 13: 1737–1745.

15.

Zhou

Rodenberg

. Estimating an roc curve in the presence of non-ignorable verification bias. Comm Stat Theor Meth 1998; 27: 635–657.

16.

Zhou

Castelluccio

. Nonparametric analysis for the ROC areas of two diagnostic tests in the presence of nonignorable verification bias. J Stat Plann Infer 2003; 115: 193–213.

17.

Rotnitzky

Faraggi

Schisterman

. Doubly robust estimation of the area under the receiver-operating characteristic curve in the presence of verification bias. J Am Stat Assoc 2006; 101: 1276–1288.

18.

Fluss

Reiser

Faraggi

et al.

Estimation of the ROC curve under verification bias. Biometrical J 2009; 51: 475–490.

19.

Fluss

Reiser

Faraggi

. Adjusting ROC curves for covariates in the presence of verification bias. J Stat Plann Infer 2012; 142: 1–11.

20.

Liu

Zhou

. A model for adjusting for nonignorable verification bias in estimation of ROC curve and its area with likelihood-based approach. Biometrics 2010; 66: 1119–1128.

21.

Mossman

. Three-way ROCs. Med Decis Making 1999; 19(1): 78–89.

22.

Nakas

Yiannoutsos

. Ordered multiple-class ROC analysis with continuous measurements. Stat Med 2004; 23: 3437–3449.

23.

Alonzo

Pepe

Lumley

. Estimating disease prevalence in two-phase studies. Biostatistics 2003; 4: 313–326.

24.

Alonzo

Pepe

. Assessing accuracy of a continuous screening test in the presence of verification bias. J Roy Stat Soc C Appl Stat 2005; 54: 173–190.

25.

Rotnitzky

Robins

. Analysis of semi-parametric regression models with non-ignorable non-response. Stat Med 1997; 16: 81–102.

26.

Quenouille

. Notes on bias in estimation. Biometrika 1956; 43: 353–360.

27.

Tukey

. Bias and confidence in not-quite large samples. Ann Math Stat 1958; 29: 614–614.

28.

Frank

Galasko

Hampel

et al.

Biological markers for therapeutic trials in Alzheimer’s disease: proceedings of the biological markers working group; NIA initiative on neuroimaging in Alzheimer’s disease. Neurobiol Aging 2003; 24: 521–536.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.02 MB

0.06 MB

0.03 MB

Estimation of the volume under the receiver-operating characteristic surface adjusting for non-ignorable verification bias

Abstract

Keywords

Get full access to this article

References

Supplementary Material