Real-Time Expert System Interfaces,Cognitive Processes,and Task Performance: An Empirical Assessment

Abstract

In this experiment we investigated the effect of different real-time expert system interfaces on operators' cognitive processes and performance. The results supported the principle that a real-time expert system's interface should focus operators' attention on where it is required most. However, following this principle resulted in unanticipated consequences. In particular, it led to inferior performance for less critical, yet important cases requiring operators' attention. For such cases operators performed better with an interface that let them select where they wanted to focus their attention. Having a rule generation capability improved performance with all interfaces but did so less than hypothesized. In all cases performance with different interfaces and a rule generation capability was explained by the effect of the interfaces on cognitive process measures.

Get full access to this article

View all access options for this article.

References

Adelman, L. (1992). Evaluating decision support and expert systems. New York: Wiley.

Andriole, S. J. (1989). Handbook for the design, development, evaluation, and application of interactive decision support systems. Princeton, NJ: Petrocelli.

Chinnis, J. O., Jr. , Cohen, M. S. , and Bresnick, T. A. (1985). Human and computer task allocation in air defense systems (Tech. Report 691). Alexandria, VA: Army Research Institute.

Cohen, M. S. , Adelman, L. , Bresnick, T. A. , Chinnis, J. O., Jr. , and Laskey, K. B. (1988). Human and computer task allocation in air defense systems: Final report (Tech. Report 87-16). Reston, VA: Decision Science Consortium, Inc.

Gould, J. D. , and Lewis, C. (1985). Designing for usability: Key principles and what designers think. Communications of the ACM, 28, 300–311.

Hoadley, E. D. (1990). Investigating the effects of color. Communications of the ACM, 33, 120–125.

Jarvenpaa, S. L. (1989). The effect of task demands and graphical format on information-processing strategies. Management Science, 35, 285–303.

Johnson, E. J. , Payne, J. W. , and Bettman, J. R. (1988). Information displays and preference reversals. Organizational Behavior and Human Decision Processes, 42, 1–21.

Klein, G. A. (1989). Recognition primed decision. In W. B. Rouse (Ed.), Advances in man-machine systems research, 5 (pp. 47–92). Greenwich, CT: JAI Press.

10.

Sage, A. P. (1991). Decision support systems engineering. New York: Wiley.

11.

Shafer, G. , and Pearl, J. (Eds.). (1990). Readings in uncertain reasoning. Palo Alto, CA: Morgan Kaufman.