Many current and emerging systems for Cognitive State Assessment have yet to achieve the goals required for application for Augmented Cognition. Numerous efforts are working towards this goal but may lack the ability to be unified into a reliable and generalizable Cognitive State Gauge. The overall purpose of this effort is to determine under what conditions multiple minimally intrusive physiological sensors can be used together and validly applied to areas within a modular cognitive state assessment framework. This study investigated the utility of various measures in detecting changes in cognitive state. We examined the differences within the output from multiple physiological sensing devices under varying levels of task difficulty during a task that was highly dependent on spatial ability (SPA). Supportive evidence for a modular cognitive state gauge (MCSG) was revealed with the finding of significant results for several physiological measures on a novel spatial task.
Get full access to this article
View all access options for this article.
References
1.
BrookhuisK.A. (2005). Psychophysiological methods. In StantonN.HedgeA.BrookhuisK.SalasE.HendrickH., Handbook of human factors and ergonomics methods (pp. 17–1–17–5). CRC Press: Boca Raton.
2.
ByrneE.A.ParasuramanR. (1996). Psychophysiology and adaptive automation. Biological Psychology, 42, 249–268.
3.
DehaeneS.SpelkeE. S.PinelP.StanescuR.TsivkinS. (1999). Source of mathematical thinking: Behavioral and brain-imaging evidence. Science, 284, 970–974.
4.
HancockP.A.ChignellM.H. (1989). Intelligent interfaces: Theory, research and design. Amsterdam: North-Holland.
5.
HilburnB.JornaP.G.ByrneE.A.ParasuramanR. (1997). The effect of adaptive air traffic control (ATC) decision aiding on controller mental workload. In MoulouaM.KoonceJ., Human-automation interaction: Research and practice (84–91). Mahwah, NJ: Erlbaum.
6.
JenningsJ.R.HallS.W. (1980). Recall, recognition and rate: Memory and the heart. Psychophysiology, 17(1), 37–46.
7.
KaberD.B.EndsleyM.R. (2004). The effects of level of automation and adaptive automation on human performance, situation awareness and workloas in a dynamic control task. Theoretical Issues in Ergonomics Science, 5, 113–153.
8.
O'donnellR.D.EggemeierF.T. (1986). Workload assessment methodology. In BoffK. R.KaufmanL.ThomasJ. P., Handbook of perception and human performance. Volume II, cognitive processes and performance. (pp 42–1–42–49). New York: Wiley.
9.
OrenM.A.HardingC.BonebrightT. (2008). Evaluation of spatial abilities within a 2D auditory platform game. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, pp. 235–236. ACM, New York.
10.
ParasuramanR.BahriT.DeatonJ.MorrisonJ.BarnesM. (1992). Theory and design of adaptive automation in aviation systems. (NAWCADWAR Report 92033–60). Warminster, PA: Naval Air Warfare Center, Aircraft Division.
11.
ParasuramanR.MoulouaM.MalloyR. (1996). Effects of adaptive task allocation on monitoring of automated systems. Human Factors, 38, 665–690.
12.
ParasuramanR.RileyV. (1997). Humans and automation: Use, misuse, disuse and abuse. Human Factors, 39, 230–253.
13.
PopeA. T.BogartE. H.BartolomeD. (1995). Biocybernetic system evaluates indices of operator engagement. Biological Psychology, 40, 187–196.
14.
PrinzelL.J.IIIParasuramanR.FreemanF.G.ScerboM.W.MikulaP.J.PopeA.T. (2003). Three experiments examining the use of Electroencephalogram, event-related potentials and heart-rate variability for real time human-centered adaptive automation design (Tech. Report NASA/TP-2003–212442). Hampton, VA:NASA Langley Research Center.
15.
ReevesL.StanneyK.AxelssonP.YoungP.SchmorrowD. (2007). Near-term, mid-term, and long-term research objectives for augmented cognition: (a) Robust controller technology and (b) mitigation strategies. In 4th International Conference on Augmented Cognition, pp. 282–289. Strategic Analysis, Inc., Arlington.
16.
ReevesLSchomorrowD. (2007). Augmented cognition foundations and future directions - Enabling “anyone, anytime, anywhere” applications. Proceedings of 3rd Augmented Cognition International, held in conjunction with HCI International 2007). Beijing China, July 22–27, 2007.
17.
RouseW.B. (1988). Adaptive aiding for human/computer control. Human Factors, 30, 431–438.
18.
ScerboM.W. (1996). Theoretical perspectives on adaptive automation. In ParasuramanR.MoulouaM., Automation and human performance: Theory and applications (pp. 37–63). Hillsdale, NJ: Erlbaum.
19.
SciariniL.W.NicholsonD. (2009). Assessing cognitive state with multiple physiological measures: A modular approach. To appear in Proceedings of HCI International 2009, San Diego, CA.
20.
SimsV.MayerR. (2002). Domain specificity of spatial expertise: The case of video game players. Applied Cognitive Psychology, 16, 97–115.
21.
St JohnM.KobusD.A.MorrisonJ.G. (2003). DARPA augmented cognition technical integration experiment (TIE) (Tech. Report 1905). San Diego, CA: United States Navy SPAWAR Systems Center.
22.
St. JohnM.KobusD. A.MorrisonJ. G.SchmorrowD. (2004). Overview of the DARPA augmented cognition technical integration experiment. International Journal of Human-Computer Interaction, 17, 131–149.
23.
VartakA.A.FidopiastisC.M.NicholsonD.M.MikhaelW.B.SchmorrowD. (2008). Cognitive state estimation for adaptive learning systems using wearable physiological sensors. Proceedings of the 1st International Conference on Biomedical Electronics and Devices. Funchal, Madeira, Portugal.
24.
WickensC.D. (1984). Processing resources in attention. In ParasuramanR.DaviesD. R., Varieties of attention (pp. 63–102). London: Academic Press.
25.
WickensC.D. (1992). Engineering psychology and human performance (2nd Ed.). New York: Harper Collins.
26.
WickensC.D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3, 150–177.
27.
WierwilleW.W.EggemeierF.T. (1993). Recommendations for mental workload measurements in a test and evaluation environment, Human Factors, 35, 263–281.
28.
WilsonG.F.RussellC.A. (2003). Real-time assessment of mental workload using psychophysiological measures and artificial neural networks. Human Factors, 45, 635–643.
29.
WilsonG. F.RussellC. A. (2004). Psychophysiologically determined adaptive aiding in a simulated UCAV task. In VincenziD. A.MoulouaM.HancockP. A., Human performance, situation awareness, and automation: Current research and trends (pp. 200–204). Mahwah, NJ: Erlbaum.
30.
WilsonG.F.RussellC.A. (2006). Psychophysiologically versus task determined adaptive aiding accomplishment. Proceedings of the 2nd Augmented Cognition conference. San Francisco, CA.
