Diagnostic Judgment as a Function of the Preprocessing of Evidence

Abstract

An experiment was conducted to determine how the quality of a human judgment (in this case, military threat diagnosis) is affected by various levels of preprocessing applied to the raw predictive events when such processing is carried out by the human and by a machine aid. Subjects were required to estimate the threat of attack on the friendly position (criterion) based on observed activity levels (cues) and designated threat potential weights of various enemy positions. Overall threat judgments were made under conditions in which a prior overt estimate of position activity levels was or was not required. Machine-aiding conditions were as follows: (1) no aiding, where subjects simply observed raw events in real time, (2) automatic tabulation of events, and (3) automatic computation of events. Finally, the rate of event occurrences was manipulated. When subjects made overall criterion judgments (threat evaluation) intuitively on the basis of events observed in real time, their performance improved markedly by interposing cue estimation, even if cue estimation was fairly inaccurate. If events were computed automatically, permitting a more analytic threat judgment, performance improved and the redundant estimation step was not helpful. If events were merely tabulated, estimation was helpful, but to an extent midway between the raw-observation and automatic computation conditions.

Get full access to this article

View all access options for this article.

References

Cohen, L. J. (1979). On the psychology of prediction: Whose is the fallacy? Cognition, 7, 385–407.

Dawes, R. M. , and Corrigan, B. (1974). Linear models in decision making. Psychological Bulletin, 81, 95–106.

Einhorn, H. J. , and Hogarth, R. M. (1981). Behavioral decision theory: Processes of judgment and choice. Annual Review of Psychology, 32, 53–88.

Erlick, D. E. (1964). Absolute judgments of discrete quantities randomly distributed over time. Journal of Experimental Psychology, 67, 475–482.

Goldberg, L. R. (1970). Man vs. model of man: A rationale, plus some evidence, for a method of improving on clinical inference, Psychological Bulletin, 73, 422–432.

Hammond, K. R. (1980, July). The integration of research in judgment and decision theory (Report No. 226). Boulder, CO: University of Colorado, Center for Research on Judgment and Policy.

Hammond, K. R. (1981, February). Principles of organization in intuitive and analytical cognitions (Report No. Boulder, CO: University of Colorado, Center for Research on Judgment and Policy.

Hammond, K. R. , McClelland, G. H. , and Mumpower, J. (1980). Human judgment and decision making: Theories, methods, and procedures. New York: Praeger.

Hogarth, R. M. (1980). Beyond static biases: Functional and dysfunctional aspects of judgmental heuristics. Psychological Bulletin, 90, 197–217.

10.

Howell, W. C. , and Burnett, S. A. (1978). Uncertainty measurements: A cognitive taxonomy. Organizational Behavior and Human Performance, 22, 45–68.

11.

Howell, W. C. , and Kerkar, S. P. (1982). A test of task influences in uncertainty measurement. Organizational Behavior and Human Performance, 30, 365–390.

12.

Kahneman, D. , Slovic, P. , and Tverskv, A. (Eds.). (1982). Judgment under uncertainty: Heuristics and biases. New York: Cambridge.

13.

Kahneman, D. , and Tversky, A. (1979), On the interpretation of intuitive probability: A reply to Jonathan Cohen. Cognition, 7, 409–411.

14.

Kerkar, S. P. (1983, July). A critical analysis of the uses of multiple regression in the study of human judgment (Report No. ONR-83–2). Houston, TX: Rice University.

15.

Nisbett, R. , and Ross, L. (1980). Human inference: Strategies and shortcomings of social judgment. Englewood Cliffs, NJ: Prentice-Hall.

16.

Sage, A. P. (1981). Behavioral and organizational considerations in the design of information systems and processes for planning and decision support. IEEE Transactions, SMC-11, 640–678.

17.

Schrenk, L. P. (1969). Aiding the decision maker--A decision process model. IEEE Transactions on Man-Machine Systems, MMS-10, 204–218.

18.

Slovic, P. (1982). Toward understanding and improving decisions. In W. C. Howell and E. A. Fleischman (Eds.), Human performance and productivity. Vol. 2. Human information processing and decision making (pp. 157–183). Hillsdale, NJ: Erlbaum.

19.

Slovic, P. , Fischoff, B. , and Lichtenstein, S. (1977). Behavioral decision theory. Annual Review of Psychology, 28, 1–39.

20.

Tversky, A. , and Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1135.

21.

Wohl, J. G. (1981). Force management decision requirements for air force tactical command and control. IEEE Transactions, SMC-11, 618–639.