Objective: The objective was to assess the validity of the Multiple Resources Questionnaire (MRQ) in predicting dual-task interference. Background: Subjective workload measures such as the Subjective Workload Assessment Technique (SWAT) and NASA Task Load Index are sensitive to single-task parameters and dual-task loads but have not attempted to measure workload in particular mental processes. An alternative is the MRQ. Method: In Experiment 1, participants completed simple laboratory tasks and the MRQ after each. Interference between tasks was then correlated to three different task similarity metrics: profile similarity, based on r2 between ratings; overlap similarity, based on summed minima; and overall demand, based on summed ratings. Experiment 2 used similar methods but more complex computer-based games. Results: In Experiment 1 the MRQ moderately predicted interference (r = +.37), with no significant difference between metrics. In Experiment 2 the metric effect was significant, with overlap similarity excelling in predicting interference (r = +.83). Mean ratings showed high diagnosticity in identifying specific mental processing bottlenecks. Conclusion: The MRQ shows considerable promise as a cognitive-process-sensitive workload measure. Application: Potential applications of the MRQ include the identification of dual-processing bottlenecks as well as process overloads in single tasks, preparatory to redesign in areas such as air traffic management, advanced flight displays, and medical imaging.
Get full access to this article
View all access options for this article.
References
1.
Adams, C.M., & Biers, D.W. (2000). ModSWAT and TLX: Effect of paired comparison weighting and weighting context. In Proceedings of the XIVth Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (pp. 6.610-6.613). Santa Monica, CA: Human Factors and Ergonomics Society .
2.
Astin, A., & Nussbaum, M.A. (2002). Interactive effects of physical and mental workload on subjective workload assessment. In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting (pp. 1100-1104). Santa Monica, CA: Human Factors and Ergonomics Society.
3.
Barnes, S., & Burke, R.S. (1988). What is Apple-Psych? Behavior Research Methods , Instruments, and Computers, 20, 150-154.
4.
Biers, D.W., & Anthony, C. (2000). Context effects in the measurement of subjective workload: Prolonged exposure to the same or different contexts. In Proceedings of the XIVth Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (pp. 6.614-6.616). Santa Monica, CA: Human Factors and Ergonomics Society.
5.
Boles, D.B. (1991). Factor analysis and the cerebral hemispheres: Pilot study and parietal functions. Neuropsychologia, 29, 59-91.
6.
Boles, D.B. (1992). Factor analysis and the cerebral hemispheres: Temporal, occipital and frontal functions. Neuropsychologia , 30, 963-988.
7.
Boles, D.B. (1996). Factor analysis and the cerebral hemispheres: "Unlocalized" functions. Neuropsychologia, 34, 723-736.
8.
Boles, D.B. (1998). Relationships among multiple task asymmetries: II. A large-sample factor analysis. Brain and Cognition, 36, 268-289.
9.
Boles, D.B. (2002). Lateralized spatial processes and their lexical implications. Neuropsychologia, 40, 2125-2135.
10.
Boles, D.B., & Adair, L.P. (2001). The Multiple Resources Questionnaire (MRQ). In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 1790-1794). Santa Monica, CA: Human Factors and Ergonomics Society.
11.
Boles, D.B., & Law, M.B. (1998). A simultaneous task comparison of differentiated and undifferentiated hemispheric resource theories. Journal of Experimental Psychology: Human Perception and Performance, 24, 204-215.
12.
Boles, D.B., Phillips, J.B., Bursk, J.H., & Perdelwitz, J.R. (2004). Application of the Multiple Resources Questionnaire (MRQ) to a complex gaming environment. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 1968-1972). Santa Monica, CA: Human Factors and Ergonomics Society.
13.
Coyne, J.T., & Baldwin, C.L. (2003). Comparison of the P300 and other workload assessment techniques in a simulated flight task. In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting (pp. 601-605). Santa Monica, CA: Human Factors and Ergonomics Society .
14.
Dienes, Z. (2000). Using SPSS: Two-way repeated-measures ANOVA. Retrieved October 17, 2006, from http://www.lifesci.sussex.ac.uk/home/Zoltan_Dienes/SPSS%202-way%20rm.html
15.
Fracker, M.L., & Wickens, C.D. (1989). Resources, confusions, and compatibility in dual-axis tracking: Displays, controls, and dynamics. Journal of Experimental Psychology: Human Perception and Performance, 15, 80-96.
16.
Friedman, A., Polson, M.C., Dafoe, C.G., & Gaskill, S.J. (1982). Dividing attention within and between hemispheres: Testing a multiple resources approach to limited-capacity information processing . Journal of Experimental Psychology: Human Perception and Performance, 8, 625-650.
17.
Glass, G.V., & Stanley, J.C. (1970). Statistical methods in education and psychology . Englewood Cliffs, NJ: Prentice-Hall .
18.
Hart, S.G., & Staveland, L.E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In P. A. Hancock, & N. Meshkati (Eds.), Human mental workload (pp. 139-183). Amsterdam: North-Holland.
19.
Hitchcock, E.M., Dember, W.N., Warm, J.S., Moroney, B.W., & See, J.E. (1999). Effects of cueing and knowledge of results on workload and boredom in sustained attention. Human Factors , 41, 365-372.
20.
Kilmer, K.J., Knapp, R., Burdsal, C., Borresen, R., Bateman, R., & Malzahn, D. (1988). Techniques of subjective assessment: A comparison of the SWAT and modified Cooper-Harper scales. In Proceedings of the Human Factors Society 32nd Annual Meeting (pp. 155-159). Santa Monica, CA: Human Factors and Ergonomics Society .
21.
Klein, M.I., Riley, M.A., Warm, J.S., & Matthews, G. (2005). Perceived mental workload in an endoscopic surgery simulator. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 1014-1018). Santa Monica, CA: Human Factors and Ergonomics Society.
22.
Metzger, U., & Parasuraman, R. (2005). Automation in future air traffic management: Effects of decision aid reliability on controller performance and mental workload. Human Factors, 47, 35-49.
Noy, Y.I. (1990). Selective attention with auxilliary automobile displays. In Proceedings of the Human Factors and Ergonomics Society 34th Annual Meeting (pp. 1533-1537). Santa Monica, CA: Human Factors and Ergonomics Society.
25.
Reid, G.B., & Nygren, T.E. (1988). The Subjective Workload Assessment Technique: A scaling procedure for measuring mental workload. In P. A. Hancock, & N. Meshkati (Eds.), Human mental workload (pp. 185-218). Amsterdam: North-Holland.
26.
Ruthruff, E., Johnston, J.C., & Van Selst, M. (2001). Why practice reduces dual-task interference. Journal of Experimental Psychology: Human Perception and Performance , 27, 3-21.
27.
Schaab, B.B., & Dressel, J.D. (2001). Training digital system skills: Increasing transfer and reducing workload. In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 1820-1822). Santa Monica, CA: Human Factors and Ergonomics Society .
28.
Vidulich, M.A., & Tsang, P.S. (1985). Assessing subjective workload assessment: A comparison of SWAT and the NASA-bipolar methods. In Proceedings of the Human Factors Society 29th Annual Meeting (pp. 71-75). Santa Monica, CA: Human Factors and Ergonomics Society.
29.
Wickens, C.D. (1984). Engineering psychology and human performance. Columbus, OH: Charles E. Merrill.
30.
Wickens, C.D., Goh, J., Helleberg, J., Horrey, W.J., & Talleur, D.A. (2003). Attentional models of multitask pilot performance using advanced display technology. Human Factors, 45, 360-380.
31.
Wickens, C.D., Sandry, D.L., & Vidulich, M. (1983). Compatibility and resource competition between modalities of input, central processing, and output. Human Factors, 25, 227-248.
