The NASA-TLX is arguably the most widely used self-report measure of workload in the field of Human Factors and Ergonomics. Previous research utilizing factor analysis has indicated it may not actually be a good unitary measure of workload. In the present study, we have modified two of the original six items, Frustration and Performance, to better reflect workload by replacing them with Emotional Demand and Performance Monitoring Demand items. Confirmatory factor analyses indicate the new scale is an improvement but Physical Demand should also be considered for removal; this results in a five-item measure of mental workload, not overall task workload, as physical demands may not be meaningfully combinable with cognitive demands.
Get full access to this article
View all access options for this article.
References
1.
BaileyL. L.ThompsonR. C. (2001). The TLX: One or more constructs. In Proceedings of the 11th International Symposium of Aviation Psychology (pp. 1–4). Columbus: The Ohio State University.
2.
BentlerP. M. (1990). Comparative Fit Indexes in Structural Models. Psychological Bulletin, 107(2), 238-246.
3.
BlakelyM. J.SmithS. L.RussellP. N.HeltonW. S. (2021). The impact of cognitive load on climbing and climbing on cognitive performance. Applied Ergonomics, 94, 103413-103413.
4.
BrownT. A. (2014). Confirmatory factor analysis for applied research. Guilford Publications.
5.
BustamanteE. A.SpainR. D. (2008, September). Measurement invariance of the Nasa TLX. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting(Vol. 52, No. 19, pp. 1522-1526). Sage CA: Los Angeles, CA: SAGE Publications.
6.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural equation modeling, 9(2), 233-255.
7.
DarlingK. A.HeltonW. S. (2014). Dual-task interference between climbing and a simulated communication task. Experimental Brain Research, 232(4), 1367-1377.
8.
HancockP.A.RahimiM.MihalyT.MeshkatiN. (1988). Bibliographic listing of mental workload research. In: HancockP.A.MeshkatiN. (Eds.). Human Mental Workload. (pp. 329-382), Amsterdam: North-Holland.
9.
HartS. G.StavelandL. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology (Vol. 52, pp. 139-183). North-Holland.
10.
HeltonW. S.FunkeG. J.KnottB. A. (2014). Measuring workload in collaborative contexts: trait versus state perspectives. Human Factors, 56(2), 322-332.
11.
HeltonW. S.MatthewsG.WarmJ. S. (2009). Stress state mediation between environmental variables and performance: The case of noise and vigilance. Acta psychologica, 130(3), 204-213.
12.
HeltonW. S.RussellP. N. (2012). Brief mental breaks and content-free cues may Not keep you focused. Experimental brain research, 219(1), 37-46.
13.
HeltonW. S.RussellP. N. (2015). Rest is best: the role of rest and task interruptions on vigilance. Cognition, 134, 165-173.
14.
HeltonW. S.ShawT.WarmJ. S.MatthewsG.HancockP. (2008). Effects of warned and unwarned demand transitions on vigilance performance and stress. Anxiety, Stress, & Coping, 21(2), 173-184.
15.
HuL.BentlerP.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 3, 424-453.
16.
RamiroE. D.ValdehitaS. R.LourdesJ. M. G.MorenoL. (2010). Psychometric study of NASA-TLX mental workload index in a sample of Spanish workers. Revista de Psicología del Trabajo y de las Organizaciones, 26, 191–199.
17.
RubioS.DíazE.MartínJ.PuenteJ. M. (2004). Evaluation of subjective mental workload: A comparison of SWAT, NASA-TLX, and workload profile methods. Applied Psychology, 53(1), 61-86.
18.
SellersJ.HeltonW. S.NäswallK.FunkeG. J.KnottB. A. (2014, September). Development of the team workload questionnaire (TWLQ). In Proceedings of the human factors and ergonomics society annual meeting (Vol. 58, No. 1, pp. 989-993). Sage CA: Los Angeles, CA: SAGE Publications.
19.
StetsA. J.HeltonW. S. (2018). Dual-task interference: Swimming and verbal free recall. Proceedings of the Human Factors and Ergonomics Society, 62, 12771280.
20.
StetsA.SmithS. L.HeltonW. S. (2020). Dual-task interference between swimming and verbal memory. Human Factors, 62(7), 1132-1140.
21.
WickensC. D.HeltonW. S.HollandsJ. G.BanburyS. (2021). Engineering psychology and human performance. New York; Routledge.
22.
WickensC. D.HollandsJ. G. (2000). Attention, timesharing, and workload. Engineering psychology and human performance, 3, 439-479.
