Exploring the Linkage between Facial Expression and Mental Workload for Arithmetic Tasks

Abstract

The measurement of mental workload is a commonly used and widely accepted means of assessing cognitively driven human performance tasks. The aim of this study was to investigate the linkage between facial expression and mental workload in the performance of arithmetic tasks. Eighteen participants were recruited and asked to perform various levels of arithmetic tasks. Classical subjective and physiological measures were used to track mental workload levels; these measures included NASA Task Load Index (NASA TLX), Subjective Workload Assessment Technique (SWAT), and electroencephalogram (EEG). In addition we utilize and propose a new measurement based on facial expressions, coded with the Facial Action Coding System. The results showed that facial expression is a viable index for measuring mental workload.

Get full access to this article

View all access options for this article.

References

Capa

R.L.

Audiffren

Ragot

(2008). The interactive effect of achievement motivation and task difficulty on mental effort. International Journal of Psychophysiology, 70, 144-150.

Fairclough

S. H.

Houston

(2004). A metabolic measure of mental effort. Biological Psychology, 66(2), 177-190.

Iani

Gopher

Lavie

(2004). Effects of task difficulty and invested mental effort on peripheral vasoconstriction. Psychophysiology, 41, 789-798.

Jasper

H. H.

(1958). The ten-twenty electrode system of the International Federation. Electroencephalography and Clinical Neurophysiology, 10, 370-375.

Van Roon

A. M.

Mulder

L. J. M.

Veldman

J. B. P.

Mulder

(1995). Beat-to-beat blood-pressure measurements applied in studies on mental workload. Homeostasis, 36, 316-324.

Veldhuizen

I. J. T.

Gaillard

De Vries

A. W. K. J.

(2003). The influence of mental fatigue on facial EMG activity during a simulated workday. Biological Psychology, 63, 59-78.

Eggemeier

F. T.

(1988). Properties of workload assessment techniques. In Hancock

P. A.

Meshkati

(Eds.), Human mental workload (pp. 41-62). Amsterdam: North-Holland.

Ekman

Friesen

W.V.

(1978). Facial action coding system. Palo Alto, CA: Consulting Psychologists Press.

Frois-Wittmann

(1930). The judgment of facial expression. Journal of Experimental Psychology, 13, 113-151.

10.

Gevins

Smith

M.E.

Leong

McEvoy

Whitfield

Rush

(1998). Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors, 40, 79-91.

11.

Hart

S. G.

Staveland

L. E.

(1988). Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In Hancock

P. A.

Meshkati

(Eds.), Human mental workload (pp. 139-183). Amsterdam: North-Holland.

12.

Luximon

Goonetilleke

R.S.

(2001). Simplified subjective workload assessment technique. Ergonomics, 44, 229-243.

13.

Murata

(2005). An attempt to evaluate mental workload using wavelet transform of EEG. Human Factors, 47(3), 498-508.

14.

Reid

G. B.

Nygren

T. E.

(1988). The subjective workload assessment technique: a scaling procedure for measuring mental workload. In Hancock

P. A.

Meshkati

(Eds.), Human mental workload (pp. 185-218). Amsterdam: North-Holland.

15.

Ryu

Myung

(2005). Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. International Journal of Industrial Ergonomics, 35, 991-1009.

16.

Wickens

C. D.

(1992). Engineering psychology and human performance (2nd ed.). New York: Harper Collins.