Measures and Interpretations of Vigilance Performance: Evidence against the Detection Criterion

Abstract

Operators′ performance in a vigilance task is often assumed to depend on their choice of a detection criterion. When the signal rate is low this criterion is set high, causing the hit and false alarm rates to be low. With increasing time on task the criterion presumably tends to increase even further, thereby further decreasing the hit and false alarm rates. Virtually all of the empirical evidence for this simple interpretation is based on estimates of the bias measure β from signal detection theory. In this article, I describe a new approach to studying decision making that does not require the technical assumptions of signal detection theory. The results of this new analysis suggest that the detection criterion is never biased toward either response, even when the signal rate is low and the time on task is long. Two modifications of the signal detection theory framework are considered to account for this seemingly paradoxical result. The first assumes that the signal rate affects the relative sizes of the variances of the information distributions; the second assumes that the signal rate affects the logic of the operator's stopping rule. Actual or potential applications of this research include the improved training and performance assessment of operators in areas such as product quality control, air traffic control, and medical and clinical diagnosis.

Get full access to this article

View all access options for this article.

References

Balakrishnan, J. D. (1997). Form and objective of the decision rule in absolute identification. Perception & Psychophysics, 59, 1049–1058.

Balakrishnan, J. D. (1998). Some more sensitive measures of sensitivity and response bias. Psychological Methods, 3, 68–90.

Balakrishnan, J. D. , & Ratcliff, R. (1996). Testing models of decision making using confidence ratings in classification. Journal of Experimental Psychology: Human Perception and Performance, 22, 615–633.

Craig, A. (1979). Nonparametric measures of sensory efficiency for sustained monitoring tasks. Human Factors, 21, 69–78.

Creelman, C. D. , & Donaldson, W. (1968). ROC curves for discrimination of linear extent. Journal of Experimental Psychology, 77, 514–516.

Davies, D. R. , & Parasuraman, R. (1982). The psychology of vigilance. London: Academic.

Deaton, J. E. , & Parasuraman, R. (1993). Sensory and cognitive vigilance: Effects of age on performance and subjective workload. Human Factors, 6, 71–97.

Dorfman, D. D. , & Alf, E., Jr. (1969). Maximum-likelihood estimations of parameters of signal-detection theory and determination of confidence intervals - Rating-method data. Journal of Mathematical Psychology, 6, 487–496.

Green, D. M. , & Swets, J. A. (1974). Signal detection theory and psychophysics. Huntington, NY: Krieger.

10.

Link, S. W. , & Heath, R. A. (1975). A sequential theory of psychological discrimination. Psychometrika, 40, 77–105.

11.

Lockhart, R. S. , & Murdock, B. B., Jr. (1970). Memory and the theory of signal detection. Psychological Bulletin, 74, 100–109.

12.

Luce, R. D. (1986). Response times: Their role in inferring elementary mental organization. New York: Oxford University Press.

13.

Mackworth, J. F. (1970). Vigilance and attention. Harmondsworth, England: Penguin.

14.

Mackworth, N. H. (1948). The breakdown of vigilance during prolonged visual search. Quarterly Journal of Experimental Psychology, 1, 6–21.

15.

Mackworth, N. H. (1961). Researches on the measurement of human performance. In H. W. Sinaiko (Ed.), Selected papers on human factors in the design and use of control systems (pp. 174–331). New York: Dover.

16.

Macmillan, N. A. , & Creelman, C. D. (1990). Response bias: Characteristics of detection theory, threshold theory, and “non-parametric” indexes. Psychological Bulletin, 107, 401–413.

17.

Macmillan, N. A. , & Creelman, C. D. (1991). Detection theory: A user's guide. Cambridge, England: Cambridge University Press.

18.

Maloney, L. T. , & Thomas, E. A. C. (1991). Distributional assumptions and observed conservatism in the theory of signal detectability. Journal of Mathematical Psychology, 35, 443–470.

19.

Parasuraman, R. (1979). Memory load and event rate control sensitivity decrements in sustained attention. Science, 205, 924–927.

20.

Parasuraman, R. , & Davies, D. R. (1977). A taxonomic analysis of vigilance performance. In R. R. Mackie (Ed.), Vigilance: Theory, operational performance, and physiological correlates (pp. 559–574). New York: Plenum.

21.

Parasuraman, R. , & Mouloua, M. (1987). Interaction of signal discriminability and task type in vigilance decrement. Perception & Psychophysics, 41, 17–22.

22.

Parasuraman, R. , Warm, J. S. , & Dember, W. N. (1987). Vigilance: Taxonomy and utility. In L. S. Mark , J. S. Warm , & R. L. Huston (Eds.), Ergonomics and human factors: Recent research (pp. 11–32). New York: Springer-Verlag.

23.

Proctor, R. W. , & Van Zandt, T. (1994). Human factors in simple and complex systems. Boston: Allyn and Bacon.

24.

See, J. E. , Howe, S. R. , Warm, J. S. , & Dember, W. N. (1995). Meta-analysis of the sensitivity decrement in vigilance. Psychological Bulletin, 117, 230–249.

25.

See, J. E. , Warm, J. S. , Dember, W. N. , & Howe, S. R. (1997). Vigilance and signal detection theory: An empirical evaluation of five measures of response bias. Human Factors, 39, 14–29.

26.

Swets, J. A. (1986). Indices of discrimination or diagnostic accuracy: Their ROCs and implied models. Psychological Bulletin, 99, 110–117.

27.

Thomas, E. A. C. (1971). Sufficient conditions for monotone hazard rate and application to latency-probability curves. Journal of Mathematical Psychology, 8, 303–332.

28.

Townsend, J. T. , & Ashby, F. G. (1983). Stochastic modeling of elementary psychological processes. Cambridge, England: Cambridge University Press.

29.

Vickers, D. , Leary, J. , & Barnes, P. (1977). Adaptation to decreasing signal probability. In R. R. Mackie (Ed.), Vigilance: Theory, operational performance and physiological correlates (pp. 679–703). New York: Plenum.

30.

Warm, J. S. (1984). An introduction to vigilance. In J. S. Warm (Ed.), Sustained attention in human performance (pp. 1–14). Chichester, England: Wiley.

31.

Warm, J. S. , Dember, W. N. , Murphy, A. Z. , & Dittmar, M. L. (1992). Sensing and decision-making components of the signal-regularity effect in vigilance performance. Bulletin of the Psychonomic Society, 30, 297–300.

32.

Warm, J. S. , & Jerison, H. J. (1984). The psychophysics of vigilance. In J. S. Warm (Ed.), Sustained attention in human performance (pp. 15–60). Chichester, England: Wiley.

33.

Watson, C. S. , Rilling, M. E. , & Bourbon, W. T. (1964). Receiver operating characteristics determined by a mechanical analog to the rating scale. Journal of the Acoustical Society of America, 36, 283–288.

34.

Williges, R. C. (1969). Within-session criterion changes compared to an ideal observer criterion in a visual monitoring task. Journal of Experimental Psychology, 81, 61–66.