Measuring Driver Adaptation to In-Vehicle Information Systems: Disassociation of Subjective and Objective Situation Awareness Measures

Abstract

This study examined a range of design parameters for an in-vehicle signing and warning system, using a low-fidelity driving simulator and a variety of driver performance measures. A series of probe questions provided an objective measure of situation awareness, and drivers' confidence ratings in these answers provided a subjective measure of situation awareness. The correspondence between the accuracy of the answers to the probe questions and subjective confidence in the answers to the probe questions provides a measure of meta-situation awareness. Meta-situation awareness is a necessary condition for the validity of any subjective measure of situation awareness. Analysis of subjective and objective measures of situation awareness showed that they were both sensitive to design parameters, but that they responded in different ways. In addition, they were poorly calibrated and were only slightly correlated. This indicates a poor level of meta-situation awareness. Poor meta-situation awareness argues for great caution in using subjective measures of situation awareness. The results also suggest that meta-situation awareness may be a useful concept in explaining human performance.

Get full access to this article

View all access options for this article.

References

Billings

C. E.

(1995). Situation awareness measurement and analysis: A commentary. Paper presented at the Proceedings of an international conference on experimental analysis and measurement of situation awareness., Daytona Beach, FL.

Brehmer

(1990). Towards a taxonomy of microworlds. In Rasmussen

Brehmer

Montmollin

M. d.

Leplat

, Taxonomy for analysis of work domains. Proceedings of the first Mohawc workshop. Roskilde, Denmark: Risö National Laboratory.

Dingus

T. A.

Antin

J. F.

Hulse

M. C.

Wierwille

W. W.

(1989). Attention demand requirements of an automobile moving-map navigation system. Transportation Research, 23A(4), 301–315.

Endsley

M. R.

(1995). Towards a theory of situation awareness in dynamic systems. Human Factors, 37(1), 32–64.

Endsley

M. R.

Kiris

E. O.

(1995). The out-of-the-loop performance problem and level of control in automation. Human Factors, 37(2), 381–394.

Flach

J. M.

(1995). Situation awareness: Proceed with caution. Human Factors, 27(1), 149–157.

Garland

D. J.

Endsley

M. R.

. (1995). Proceedings of an international conference on experimental analysis and measurement of situation awareness. Daytona Beach, FL: Embry-Riddle Aeronautical University Press.

Harwood

K.B. Barnett

Wickens

(1988). Situational awareness: A conceptual and methodological framework. In McIntire

F. E.

, Proceedings of the 11th Symposium of Psychology in the Department of Defense. (pp. 316–320). Colorado Springs), CO US Air Force Academy.

Lee

J. D.

Gore

B. F.

Campbell

J. L.

(In press). Display alternatives for in-vehicle warning and sign information: Message style, location, and modality. Transportation Human Factors.

10.

Mollenhauer

M. A.

Hulse

M. C.

Dingus

T. A.

Jahns

S. K.

Carney

(1997). Design decision aids and human factors guidelines for ATIS displays. In Noy

Y. I.

, Ergonomics and Safety of Intelligent Driver Interfaces (pp. 23–61). Mahwah, NJ: Lawrence Erlbaum Associates.

11.

Moray

(1981). The role of attention in the detection of errors and the diagnosis of errors in man-machine systems. In Rasmussen

Rouse

W. B.

, Human detection and diagnosis of system failures. New York: Plenum Press.

12.

Noy

Y. I.

(1990). Attention and performance while driving with auxiliary in-vehicle displays. Ottawa, Canada: Ergonomics Division, Transport Canada, Road Safety.

13.

Perez

W. A.

Mast

T. W.

(1992). Human factors and advanced traveler information systems (ATIS). Proceedings of the 36th Annual Meeting of the Human Factors Society, 1073–1077.

14.

Pew

R. W.

(1995). The state of situation awareness measurement: Circa 1995. Paper presented at the Proceedings of an international conference on experimental analysis and measurement of situation awareness., Daytona Beach, FL.

15.

Salas

Prince

Baker

D. P.

(1995). Situation awareness in team performance: Implications for measurement and training. Human Factors, 27(1), 123–136.

16.

Sarter

Woods

(1991). Situation awareness: A critical but ill-defined phenomenon. The International Journal of Aviation Psychology, 1(1), 45–57.

17.

Smith

Hancock

(1993). Situation awareness is adaptive, externally-directed consciousness. Paper presented at the Proceedings of the International Meeting on Situational Awareness, Orlando, FL.

18.

Verwey

W. B.

(1993). How can we prevent overload of the driver. In Parkes

A. M.

Franzen

, Driving Future Vehicles (pp. 235–244). $Lodon: Taylor and Francis.