Limitations on the Practical Applicability of d′ and β Measures

Abstract

This article summarizes several of the limitations that have occasionally been raised against the use of the conceptual model and performance measures of Signal Detection Theory (SDT) in various research situations. The statistical assumptions underlying the meaningful computation of d′ and β as independent estimates of sensitivity and criterion are emphasized, and the overall applicability of the general SDT model itself is questioned under certain research conditions in which it is typically employed. The results from three separate experiments (vigilance, visual search, and auditory detection) are presented to illustrate the potential consequences of the misapplication of SDT. These results are discussed as relevant examples of current research which faces serious difficulties in applying SDT measures to an observer's performance without a critical consideration of underyling tenets or theory.

Get full access to this article

View all access options for this article.

References

Broadbent, D. E. Decision and stress. New York: Academic Press, 1971.

Colquhoun, W. P. Sonar target detection as a decision process. Journal of Applied Psychology, 1967, 51, 187–190.

Craig, A. Broadbent and Gregory revisited: Vigilance and statistical decision. Human Factors, 1977, 19, 25–36.

Craig, A.

Is the vigilance decrement simply a response adjustment towards probability matching?

Human Factors, 1978, 20, 441–446.

Craig, A. Nonparametric measures of sensory efficiency for sustained monitoring tasks. Human Factors, 1979, 21, 69–78.

Drury, C. F. The inspection of sheet materials-Model and data. Human Factors, 1975 17, 257–265.

Erdelyi, M. H. A new look at the new look: Perceptual defense and vigilance. Psychological Review, 1974, 81, 1–25.

Glanzer, M. and Bowles, N. Analysis of the word-frequency effect in recognition memory. Journal of Experimental Psychology: Human Learning and Memory, 1976, 2, 21–31.

Green, D. M. and Swets, J. A. Signal detection theory and psychophysics. New York: John Wiley and Sons, Inc., 1966.

10.

Hochhaus, L. A table for the calculation of d' and Beta. Psychological Bulletin, 1972, 77, 375–376.

11.

Jerison, H. J. Signal detection theory in the analysis of human vigilance. Human Factors, 1967, 9, 285–288.

12.

Jerison, H. J. , Pickett, R. M. , and Stenson, H. H. The elicited observing rate and decision process in vigilance. Human Factors, 1965, 7, 107–128.

13.

Loeb, M. On the analysis and interpretation of vigilance: Some remarks on two recent articles by Craig. Human Factors, 1978, 20, 447–451.

14.

Long, G. M. , and Shelnutt, J. B. Decisional differences among individuals: A signal detection theory approach. Pensacola, FL.: Naval Aerospace Medical Research Laboratory, NAMRL Report 1185, 1973.

15.

Mackworth, J. F. Vigilance and attention. New York: Penguin Books, 1970.

16.

Mackworth, J. F. and Taylor, M. M. The d' measure of signal detectability in vigilance-like situations. Canadian Journal of Psychology, 1963, 17, 302–325.

17.

Miles, J. Eliminating the guessing factor in the multiple choice test. Educational and Psychological Measurement, 1973, 33, 637–651.

18.

Moray, N. Time sharing in auditory perception: Effect of stimulus duration. Journal of the Acoustical Society of America, 1970, 47, 660–661.

19.

Pastore, R. E. , and Scheirer, C. J. Signal detection theory: Considerations for general application. Psychological Bulletin, 1974, 81, 945–958.

20.

Pike, R. Response latency models for signal detection. Psychological Review, 1973, 80, 53–68.

21.

Pollack, I. and Norman, D. A. A non-parametric analysis of recognition experiments. Psychonomic Science, 1964, 1, 125–126.

22.

Richardson, J. T. E. Nonparametric indexes of sensitivity and response bias. Psychological Bulletin, 1972, 78, 429–432.

23.

Swets, J. A. and Kristofferson, A. B. Attention. Annual Review of Psychology, 1970, 21, 339–366.

24.

Swets, J. A. and Sewall, S. T. Invariance of signal detectability over stages of practice and levels of motivation. Journal of Experimental Psychology, 1963, 66, 120–126.

25.

Swets, J. A. , Tanner, W. P. Jr. , and Birdsall, T. G. Decision processes in perception. Psychological Review, 1961, 68, 301–340.

26.

Taylor, M. M. Detectability theory and the interpretation of vigilance data. Acta Psychologica, 1967, 27, 390–399.

27.

Tong, J. E. and Ground, D. G. Rigidity and instructions in relation to two-flash fusion measures. Psychonomic Science, 1970, 21, 355–356.

28.

Waag, W. L. The prediction of individual differences in monitoring performance. (Doctoral dissertation. Texas Tech University, 1971). Dissertation Abstracts International, 1972, 32, 5502-B.