A primary question that must be resolved in the development of tasks to assess the quality of physicians’ clinical judgment is, “What is the outcome variable?” One natural choice would seem to be the correctness of the clinical decision. In this article, we use data on the diagnosis of urinary tract infections among young girls to illustrate why, in many clinical situations, this is not a useful variable. We propose instead a judgment weighted by the relative costs of an error. This variable has the disadvantage of requiring expert judgment for scoring, but the advantage of measuring the construct of interest.
American Academy of Pediatrics. (1999, April). The diagnosis, treatment and evaluation of the initial urinary tract infection in febrile infants and young children. Pediatrics, 103(4, Pt. 1), 843-852.
2.
Barza, M., & Pauker, S. G. (1980). The decision to biopsy, treat, or wait in suspected herpes encephalitis. Annals of Internal Medicine, 92(5), 641-649.
3.
Elstein, A., Shulman, L., Sprafka, S., Allal, L., Gordon, M., Jason, H., et al. (1978). Medical problem solving: An analysis of clinical reasoning. Cambridge, MA: Harvard University Press.
4.
Feinstein, A. (1967). Clinical judgment. Baltimore: Waverly.
5.
Gorelick, M. H., & Shaw, K. N. (2000). Clinical decision rule to identify febrile young girls at risk for urinary tract infection. Archives of Pediatrics & Adolescent Medicine, 154, 386-390.
6.
Gorry, G. A., Kassirer, J. P., Fineberg, H. V., Pauker, S. G., Elstein, A. S., & Peirce, J. C. (1979). Symposium: The role of decision analysis in medical education and practice. Annual Conference on Research in Medical Education, 18, 427-437.
7.
Janis, I. L. (1972). Victims of groupthink. Boston: Houghton Mifflin.
8.
Nkanginieme, K. E. O. (1997). Clinical diagnosis as a dynamic cognitive process: Application of Bloom’s taxonomy for educational objectives in the cognitive domain. Retrieved December 2, 2003, from http://www.med-ed-online.org/f0000007.htm
9.
Papa, F. (2001, August). Exemplar versus abstraction theories of medical differential diagnosis. Paper presented at the annual meeting of the American Psychological Association, San Francisco, CA.
10.
Pauker, S. G. (1976). Coronary artery surgery: The use of decision analysis. Annals of Internal Medicine, 85(1), 8-18.
11.
Pauker, S. G., & Kassirer, J. P. (1975). Therapeutic decision making: A cost-benefit analysis. New England Journal of Medicine, 293(5), 229-234.
12.
Pauker, S. G., & Kassirer, J. P. (1980). The threshold approach to clinical decision making. New England Journal of Medicine, 302(20), 1109-1117.
13.
Poses, R. M., Cebul, R. D., Wigton, R. S., Centor, R. M., Collins, M.,& Fleischli, G. (1992). Controlled trial using computerized feedback to improve physicians’diagnostic judgments. Academic Medicine, 67(5), 345-347.
14.
Raiffa, H. (1968). Decision analysis. Reading, MA: Addison-Wesley.
15.
Ramsay, J. O. (1973). The effect of number of categories in rating scales on precision of estimation of scale values. Psychometrika, 28, 513-532.
16.
Tape, T. G., Kripal, J., & Wigton, R. S. (1992). Comparing methods of learning clinical prediction from case simulations. Medical Decision Making, 12(3), 213-221.
17.
Thissen, D., & Wainer, H. (Eds.). (2001). Test scoring. Hillsdale, NJ: Lawrence Erlbaum.
18.
Von Neumann, J.,& Morgenstern, O. (1974). Theory of games and economic behavior(2nd ed.). Princeton, NJ: Princeton University Press.
