Research with Patriot Air Defense Officers: Examining Information Order Effects

Abstract

In an experiment using the Patriot air defense training simulator, we found that the order in which the same information was presented to experienced Patriot officers significantly affected their probability estimates, identification judgments, and engagement decisions. In all cases the results represented a primacy effect, contradicting the recency effect predictions of the Hogarth and Einhorn (1992) model. In the present study we found that early in an aircraft's track history, the order effect is caused by the overweighting of prior information; later in the history, the late order effect is caused by participants reinterpreting the meaning of information based on what preceded it. These findings help to explain the differential effectiveness of a proposed display and the importance of naturalistic research for testing the generality of models of decision making.

Get full access to this article

View all access options for this article.

References

Adelman

Bresnick

T. A.

(1992). Examining the effect of information sequence on expert judgment: An experiment with Patriot air defense officers using the Patriot air defense simulator. Organizational Behavior and Human Decision Processes, 53, 204–228

Adelman

Bresnick

T. A.

Black

P. K.

Marvin

F. F.

Sak

S. G.

(1995). Information order effects on expert judgment. In Andriole

S. J.

Adelman

(Eds.), Cognitive systems engineering: Interface design, prototyping, and evaluation (pp. 171–193). Hillsdale, NJ: Erlbaum

Adelman

Cohen

M. S.

Bresnick

T. A.

Chinnis

J. O.

Jr. Laskey

K. B.

(1993). Real-time expert system interfaces, cognitive processes, and task performance: An empirical assessment. Human Factors, 35, 243–261

Adelman

Tolcott

M. A.

Bresnick

T. A.

(1993). Examining the effect of information order on expert judgment. Organizational Behavior and Human Decision Processes, 56, 348–369

Ashton

R. H.

Ashton

A. H.

(1990). Evidence responsiveness in professional judgment: Effects of positive versus negative evidence and presentation mode. Organizational Behavior and Human Decision Processes, 46, 1–19

Bishop

Y. M. M.

Fienberg

S. E.

Holland

P. W.

(1975). Discrete multivariate analysis: Theory and practice. Cambridge: MIT Press

Einhorn

H. J.

Hogarth

R. M.

(1987). Adaptation and inertia in belief updating: The contrast-inertia model. Unpublished manuscript. University of Chicago, Center for Decision Research, Chicago

Hammond

K. R.

(1988). Judgment and decision making in dynamic tasks. Information and Decision Technologies, 14, 3–14

Hammond

K. R.

Hamm

R. M.

Grassia

Pearson

(1987). Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment. IEEE Transactions on Systems, Man and Cybernetics, SMC-17, 753–770

10.

Hogarth

R. M.

Einhom

H. J.

(1992). Order effects in belief updating: The belief-adjustment model. Cognitive Psychology, 24, 1–55

11.

Johnson

E. J.

Payne

J. W.

Bettman

J. R.

(1988). Information displays and preference reversals. Organizational Behavior and Human Decision Processes, 42, 1–21

12.

Klein

G. A.

Orasanu

Calderwood

Zsambok

C. E.

(Eds.). (1993). Preface. In Decision making in action: Models and methods (pp. vii–x). Norwood, NJ: Ablex

13.

Orasanu

Salas

(1993). Team decision making in complex environments. In Klein

G. A.

Orasanu

Calderwood

Zsambok

C. E.

(Eds.), Decision making in action: Models and methods (pp. 327–345). Norwood, NJ: Ablex

14.

Payne

J. W.

Bettman

J. R.

Johnson

E. J.

(1992). Behavioral decision research: A constructive processing perspective. Annual Review of Psychology, 43, 87–131

15.

Pennington

Hastie

(1993). A theory of explanation-based decision making. In Klein

G. A.

Orasanu

Calderwood

Zsambok

C. E.

(Eds.), Decision making in action: Models and methods (pp. 188–20I). Norwood, NJ: Ablex

16.

Serfaty

Entin

Tenney

(1989). Planning with uncertain and conflicting information. In Johnson

S. E.

Levis

A. H.

(Eds.), Science of command and control. Part 2: Coping with complexity (pp. 91–100). Fairfax, VA: AFCEA International

17.

Shanteau

(1992). Competence in experts: The role of task characteristics. Organizational Behavior and Human Decision Processes, 53, 252–266