Assessing Physicians Estimates of the Probability of Coronary Artery Disease

Abstract

The authors assessed physicians' probability estimates of coronary artery disease (CAD) in 250 patients undergoing a screening exercise stress test. True likelihood of disease (prev alence) was derived from the literature. Discrimination and calibration were assessed by comparing physicians' probability estimates and prevalence using pairwise comparisons, rank correlation, and linear regression. There were differences in the discriminative abilities of the physicians based on patient characteristics For example, the physicians had better discriminative ability for patients with typical cardiac chest pain compared with atypical chest pain. The physicians were able to predict the prevalences of CAD in broad groups of patients. However, they overestimated probabilities for patients with low prevalence of disease and underestimated probabilities for patients with high prevalence of disease The authors con clude that physicians make consistent errors in the use of probability estimates The quality of these estimates depends on patient characteristics such as type of chest pain and true likelihood of disease. Key words: calibration; decision making, probabilistic judgments; heart disease; exercise stress test; women; linear regression; medical judgments; discrimination; models (Med Decis Making 1992; 12:109-114)