Combined psychophysiological measures have been used to determine mental workload in operators, but the day-to-day reliability of these measures has not been determined. Data were collected four times over a one month period. Two classifiers were trained with these data and their ability to correctly discriminate between two levels of task difficulty with new data was tested. Both classifiers very accurately discriminated between the two levels of task difficulty using data collected on the same day as the training data. However, the accuracy was considerably reduced when tested on data from days different from the training data. The implications for application of these procedures are discussed.
Get full access to this article
View all access options for this article.
References
1.
BurgressA.GruzelierJ. (1993). Individual reliability of amplitude distribution in topographical mapping of EEG. Electroencephalography and clinical Neurophysiology, 86, 210–223.
2.
BerkaC.LevendowskiD. J.CvetinovicM. M.PetrovicM. M.DavisG.LumicaoM. N.ZivkovicV. T.PopovicM. V.OlmsteadR. (2004). Real-Time Analysis of EEG Indexes of Alertness, Cognition, and Memory Acquired With a Wireless EEG Headset. International Journal of Human-Computer Interaction, 17, 151–170.
3.
BishopC. M. (2006). Pattern Recognition and Machine Learning (p. 32). Springer.
4.
ComstockJ. R.ArnegardR. J. (1992). The multiattribute task battery for human operator workload and strategic behavior research. NASA Technical Memorandum No. 104174.
5.
FreemanF. G.MikulkaP. J.PrinzelL. J.ScerboM. W. (1999). Evaluation of an adaptive automation system using three EEG indices with a visual tracking task. Biological Psychology, 50, 61–76.
6.
GevinsA.SmithM.E.LeongH.McEvoyL.WhitfieldS.DuR.RushG. (1998). Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors, 40, 79–91.
7.
JasperH. H. (1958). Report of the Committee on Methods of Clinical Examination. Electroencephalography and clinical Neurophysiology, 10, 370–375.
PollockV. E.SchneiderL. S.LynessS. A. (1991). Reliability of topographic quantitative EEG amplitude in health late-middle-aged and elderly subjects. Electroencephalography and clinical Neurophysiology, 79, 20–26.
10.
RuckD. W.RogersS. K.KabriskyM.OxleyM. E.SuterB. W. (1990). The multilayer perceptron as an approximation to a Bayes optimal discriminant function. IEEE Transactions on Neural Networks, 1(4), 296–298.
11.
SalinskyM. C.OkenB. S.MoreheadL. (1991). Test-retest reliability in EEG frequency analysis. Electroencephalography and clinical Neurophysiology, 79, 383–392.
12.
WhithamE.M.PopeK.J.FitzgibbonS.P.LewisT.ClarkC.R.LovelessS. (2007). Scalp electrical recording during paralysis: Quantitative evidence that EEG frequencies above 20 Hz are contaminated by EMG. Clinical Neurophysiology, 118, 1877–1888.
13.
WilsonG. F.FisherF. (1995). Cognitive task classification based upon topographic EEG data. Biological Psychology, 40, 239–250.
14.
WilsonG. F.RussellC. A. (2003a). Operator functional state classification using psychophysiological features in an air traffic control task, Human Factors, 45(3), 635–643.
15.
WilsonG. F.RussellC. A. (2003b). Real-Time Assessment of Mental Workload Using Psychophysiological measures and artificial neural networks, Human Factors, 45, 635–643.
