Accuracy of Prediction Models in the Context of Disease Management

Abstract

There has been a significantly increased interest in the adoption of prediction modeling by many disease and case management programs to risk stratify members in order to optimize the utilization of available clinical resources. Before adopting any prediction model, it is critical to understand how to evaluate the model's accuracy. This paper explains the basic concepts of prediction accuracy, the relevant parameters, their drawbacks, and their interpretations. It also introduces a new accuracy parameter termed "cost concentration," which indicates the model accuracy more explicitly in the context of disease management. (Disease Management 2005;8:42–47)