Detecting Human Trust Calibration in Automation: A Deep Learning Approach

Delorme A. Mullen T. Kothe C. Akalin Acar Z. Bigdely-Shamlo N. Vankov A. Makeig S. (2011). EEGLAB, SIFT, NFT, BCILAB, and ERICA: New tools for advanced EEG processing. Computational Intelligence and Neuroscience, 2011.

Desmet C. Deschrijver E. Brass M. (2014). How social is error observation? The neural mechanisms underlying the observation of human and machine errors. Social Cognitive and Affective Neuroscience, 9(4), 427–435.

Dzindolet M. T. Peterson S. A. Pomranky R. A. Pierce L. G. Beck H. P. (2003). The role of trust in automation reliance. International Journal of Human Computer Studies, 58(6), 697–718.

Wang F. Zhong S. Peng J. J. J. Y. L. (2018). Data Augmentation for EEG-Based Emotion Recognition with Deep Convolutional Neural Networks. In International Conference on Multi-Media Modeling (MMM) (pp. 82–93). Springer.

Jonker C.M. Treur J. (1999). Formal analysis of models for the dynamics of trust based on experiences. In 9th European Workshop on Modelling Autonomous Agents in a Multi-Agent World, MAAMAW’99 (pp. 221–231). Valencia, Spain.

Goodyear Kimberly Parasuraman Raja Chernyak Sergey de Visser Ewart Madhavan Poornima Deshpande Gopikrishna F. K. (2017). An fMRI and effective connectivity study investigating miss errors during advice utilization from human and machine agents. Social Neuroscience, 12(5), 570–581.

Krueger F. McCabe K. Moll J. Kriegeskorte N. Zahn R. Strenziok M. . . . Grafman J. (2007). Neural correlates of trust. Proceedings of the National Academy of Sciences, 104(50), 20084–20089.

Lecun Y. Bengio Y. Hinton G. (2015). Deep learning. Nature, 521, 436–444.

Lee J. D. See K. A. (2004). Trust in Automation: Designing for Appropriate Reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society, 46(1), 50–80.

Madhavan P. Wiegmann D. A. Lacson F. C. (2006). Automation Failures on Tasks Easily Performed by Operators Undermine Trust in Automated Aids. Human Factors: The Journal of the Human Factors and Ergonomics Society, 48(2), 241–256.

McGuirl J. M. Sarter N. B. (2006). Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information. Human factors, 48(4), 656-665.

Merritt S. M. Ilgen D. R. (2008). Not All Trust Is Created Equal: Dispositional and History-Based Trust in Human-Automation Interactions. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50(2), 194–210.

Miller W. D. (2010). The U.S. Air Force-Developed Adaptation of the Multi-Attribute Task Battery for the Assessment of Human Operator Workload and Strategic Behavior. Retrieved from

Mognon A. Jovicich J. Bruzzone L. Buiatti M. (2011). ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. Psychophysiology, 48(2), 229–240.

Pop V. L. Shrewsbury A. Durso F. T. (2015). Individual differences in the calibration of trust in automation. Human Factors, 57(4), 545–556.

Riedl R. Javor A. (2012). The biology of trust: Integrating evidence from genetics, endocrinology, and functional brain imaging. Journal of Neuroscience, Psychology, and Economics, 5(2), 63–91.

Schalk G. McFarland D. J. Hinterberger T. Birbaumer N. Wolpaw J. R. (2004). BCI2000: A general-purpose brain-computer interface (BCI) system. IEEE Transactions on Biomedical Engineering, 51(6), 1034–1043.

Schmorrow D. D. Kruse A. A. (2002). DARPA’s Augmented Cognition Program-tomorrow’s human computer interaction from vision to reality: building cognitively aware computational systems. In Proceedings of the IEEE 7th Conference on Human Factors and Power Plants, 7-1-7–4.

Sharbrough F. Chatrian G. Lesser R. Luders H. Nuwer M. Picton T. (1991). American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature. Clinical Neurophysiology, (8), 200–202.

Wiegmann D. A. Rich A. Zhang H. (2001). Automated diagnostic aids: The effects of aid reliability on users’ trust and reliance. Theoretical Issues in Ergonomics Science, 2(4), 352–367.

Yang H. Sakhavi S. Ang K. K. Guan C. (2015). On the use of convolutional neural networks and augmented CSP features for multi-class motor imagery of EEG signals classification. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, 2620–2623.

Zhang J. Li S. Wang R. (2017). Pattern recognition of momentary mental workload based on multi-channel electrophysiological data and ensemble convolutional neural networks. Frontiers in Neuroscience, 11, 1–16.

de Visser E. J. De Beatty P. J. Estepp J. R. Kohn S. Abubshait A. Fedota J. R. Mcdonald C. G. (2018). Learning From the Slips of Others: Neural Correlates of Trust in Automated Agents. Frontiers in Human Neuroscience, 12, 1-15

Gómez-Herrero G. (2007). Automatic Artifact Removal (AAR) toolbox v1.3(Release 09.12.2007) for MATLAB. Tampere: Tampere University of Technology