We assessed working memory load during computer use with neural network pattern recognition applied to EEG spectral features. Eight participants performed high-, moderate-, and low-load working memory tasks. Frontal theta EEG activity increased and alpha activity decreased with increasing load. These changes probably reflect task difficulty-related increases in mental effort and the proportion of cortical resources allocated to task performance. In network analyses, test data segments from high and low load levels were discriminated with better than 95% accuracy. More than 80% of test data segments associated with a moderate load could be discriminated from high- or low-load data segments. Statistically significant classification was also achieved when applying networks trained with data from one day to data from another day, when applying networks trained with data from one task to data from another task, and when applying networks trained with data from a group of participants to data from new participants. These results support the feasibility of using EEG-based methods for monitoring cognitive load during human-computer interaction.
Get full access to this article
View all access options for this article.
References
1.
Anderson, J. R., & Boyle, S. F. (1987). Cognitive principles in the design of computer tutors. In P. Morris (Ed.), Modelling cognition (pp. 93–133). London: Wiley.
2.
Baddeley, A. & Hitch, G. (1974). Working memory. In G. Bower (Ed.), Recent advances in learning and motivation (Vol. 8, pp. 47–90). New York: Academic.
3.
Berger, H. (1969). Hans Berger on the electroencephalogram of man (P. Gloor, Trans.). Electroencephalography and Clinical Neuropsychology(Suppl. 28). (Original work published 1929)
4.
Card, S. K., Moran, T. P., & Newell, A. (1983). The psychology of human-computer interaction. Hillsdale, NJ: Erlbaum.
5.
Carlson, R. A., Sullivan, M. A., & Schneider, W. (1989). Practice and working memory effects in building procedural skill.. Journal of Experimental Psychology: Learning, Memory and Cognition, 3, 517–526.
6.
Chatrian, G. E., Petersen, M. C., & Lazarte, J. A. (1959). The blocking of the rolandic wicket rhythm and some central changes related to movement.. Electroencephalography and Clinical Neurophysiology, 11, 497–510.
7.
Du, W., Leong, H. & Gevins, A. S. (1994, June). Ocular artifact reduction by adaptive filtering. Paper presented at the Seventh IEEE SP Workshop on Statistical Signal and Array Processing, Quebec City, Canada.
8.
Efron, B. (1979). Bootstrap methods: Another look at the jackknife.. Annals of Statistics, 7, 18–26.
9.
Gevins, A. S. (1980). Pattern recognition of brain electrical potentials. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-2, 383–404.
10.
Gevins, A. S., Leong, H., Du, R., Smith, M. E., Le, J., DuRousseau, D., Zhang, J. & Libove, J. (1995). Towards measurement of brain function in operational environments.. Biological Psychology, 40, 169–186.
11.
Gevins, A. & Morgan, N. (1986). Classifier-directed signal processing in brain research. IEEE Transactions on Biomedical Engineering, BME-33, 1058–1064.
12.
Gevins, A. S., & Morgan, N. H. (1988). Applications of neuralnetwork (NN) signal processing in brain research.. IEEE Transactions on Acoustics, Speech, and Signal Processing, 36, 1152–1161.
13.
Gevins, A. S., & Schaffer, R. E. (1980). A critical review of electroencephalographic EEG correlates of higher cortical functions.. CRC Critical Reviews in Bioengineering, 4, 113–164.
14.
Gevins, A., Smith, M. E., McEvoy, L. & Yu, D. (1997). High resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty, type of processing, and practice.. Cerebral Cortex, 7, 374–385.
15.
Gevins, A. S., Yeager, C. L., Zeitlin, G. M., Ancoli, S. & Dedon, M. (1977). On-line computer rejection of EEG artifact.. Electroencephalography and Clinical Neurophysiology, 42, 267–274.
16.
Gevins, A. S., Zeitlin, G. M., Doyle, J. C., Schaffer, R. E., & Callaway, E. (1979). EEG patterns during “cognitive” tasks: II. Analysis of controlled tasks.. Electroencephalography and Clinical Neurophysiology, 47, 704–710.
17.
Gevins, A. S., Zeitlin, G. M., Doyle, J. C., Yingling, C. D., Schaffer, R. E., Callaway, E. & Yeager, C. L. (1979). EEG correlates of higher cortical functions.. Science, 203, 665–668.
18.
Gevins, A. S., Zeitlin, G. M., Yingling, C. D., Doyle, J. C., Dedon, M. F., Schaffer, R. E., Roumasset, J. T., & Yeager, C. L. (1979). EEG patterns during “cognitive” tasks: I. Methodology and analysis of complex behaviors.. Electroencephalography and Clinical Neurophysiology, 47, 693–703.
19.
Glass, A. (1966). Comparison of the effect of hard and easy mental arithmetic upon blocking of the occipital alpha rhythm.. Quarterly Journal of Experimental Psychology, 8, 142–152.
20.
Gopher, D., Brickner, M. & Navon, D. (1982). Different difficulty manipulations interact differently with task emphasis: Evidence for multiple resources.. Journal of Experimental Psychology: Human Perception and Performance, 8, 146–157.
21.
Gundel, A. & Wilson, G. F. (1992). Topographical changes in the ongoing EEG related to the difficulty of mental tasks.. Brain Topography, 5, 17–25.
22.
Humphrey, D. & Kramer, A. F. (1994). Toward a psychophysiological assessment of dynamic changes in mental workload.. Human Factors, 36, 3–26.
23.
Isreal, J. B., Wickens, C. D., Chesney, G. L., & Donchin, E. (1980). The event-related brain potential as an index of display-monitoring workload.. Human Factors, 22, 211–224.
24.
Joseph, R. D. (1961). Contributions of perceptron theory. Unpublished doctoral dissertation, Cornell University, Ithaca, NY.
25.
Kieras, D. E. (1988). Towards a practical GOMS model methodology for user interface design. In M. Helander (Ed.), The handbook of human-computer interaction (pp. 135–158). Amsterdam: North-Holland.
26.
Kramer, A. F., Sirevaag, E. J., & Braune, R. (1987). A psychophysiological assessment of operator workload during simulated flight missions.. Human Factors, 29, 145–160.
27.
Kyllonen, P. C., & Stephens, D. L. (1990). Cognitive abilities as determinants of success in acquiring logic skill.. Learning and Individual Differences, 2, 129–160.
28.
Le, J., Menon, V. & Gevins, A. (1994). Local estimate of the surface Laplacian derivation on a realistically shaped scalp surface and its performance on noisy data.. Electroencephalography and Clinical Neurophysiology, 92, 433–441.
29.
Leong, H. & Gevins, A. (1994). Subject-specific classification of mental workload using multivariate analyses of EEG and scalp EMG signals (Tech. Report SAM-TR94-1). San Francisco: SAM Technology.
30.
McCallum, W. C., Cooper, R. & Pocock, P. V. (1988). Brain slow potential and ERP changes associated with operator load in a visual tracking task.. Electroencephalography and Clinical Neurophysiology, 69, 453–468.
31.
Miyata, Y., Tanaka, Y. & Hono, T. (1990). Long term observation on Fm-theta during mental effort.. Neuroscience, 16, 145–148.
32.
Olson, J. R., & Olson, G. M. (1990). The growth of cognitive modeling in human-computer interaction since GOMS.. Human-Computer Interaction, 5, 221–265.
33.
Parasuraman, R. (1990). Event-related brain potentials and human factors research. In J. W. Rohrbaugh, R. Parasuraman, & R. J. Johnson (Eds.), Event-related brain potentials (pp. 279–300). New York: Oxford University Press.
34.
Pfurtscheller, G. & Klimesch, W. (1992). Functional topography during a visuoverbal judgment task studied with event-related desynchronization mapping.. Journal of Clinical Neurophysiology, 9, 120–131.
35.
Pfurtscheller, G., Neuper, C. & Berger, J. (1994). Source localization using event-related desynchronization (ERD) within the alpha band.. Brain Topography, 6, 269–275.
36.
Posner, M. E., & Peterson, S. E. (1990). The attentional system of the human brain.. Annual Review of Neuroscience, 13, 25–42.
37.
Posner, M. I., & Rothbart, M. K. (1992). Attentional mechanisms and conscious experience. In A. D. Milner & M. D. Rugg (Eds.), The neuropsychology of consciousness (pp. 91–111). San Diego: Academic.
38.
Reid, G. B., & Nygren, T. E. (1988). The Subjective Workload Assessment Technique: A scaling procedure for measuring mental workload. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload (pp. 185–218). Amsterdam: North-Holland.
39.
Sharbrough, F., Chatrian, G., Lesser, R. P., Luders, H., Nuwer, M. & Picton, T. W. (1990). Guidelines for standard electrode position nomenclature. Bloomfield, IL: American EEG Society.
40.
Sirevaag, E. J., Kramer, A. F., & Wickens, C. D. (1993). Assessment of pilot performance and mental workload in rotary wing aircraft.. Ergonomics, 36, 1121–1140.
41.
Sterman, M. B. (1989). Psychophysical studies of crew workload and alertness (Tech. Report 88-D-8077). Sepulveda, CA: Northrop Corp.
42.
Sterman, M. B., Mann, C. A., Kaiser, D. A., & Suyenobu, B. Y. (1994). Multiband topographic analysis of a simulated visuomotor aviation task.. International Journal of Psychophysiology, 16, 49–56.
43.
Tou, J. T., & Gonzalez, R. C. (1974). Pattern recognition principles. Reading, MA: Addison-Wesley.
44.
Viglione, S. S. (1970). Applications of pattern recognition technology. In J. M. Mendel & K. S. Fu (Eds.), Adaptive learning and pattern recognition systems (pp. 115–161). New York: Academic.
45.
Wickens, C. D. (1991). Processing resources and attention. In D. L. Damos (Ed.), Multiple-task performance (pp. 1–34). London: Taylor & Francis.
46.
Wilson, G. F., & Fisher, F. (1995). Cognitive task classification based upon topographic EEG data.. Biological Psychology, 40, 239–250.
47.
Woltz, D. J. (1988). An investigation of the role of working memory in procedural skill acquisition.. Journal of Experimental Psychology: General, 117, 319–331.
48.
Yamamoto, S. & Matsuoka, S. (1990). Topographic EEG study of visual display terminal (VDT) performance with special reference to frontal midline theta waves.. Brain Topography, 2, 257–267.
