Typically, detailed quantitative and computer models of human operators performing real world tasks cannot easily be developed. We propose a technique that more easily allows for that development. We propose that when a cognitive task analysis has been carried out, a computer simulation model useful for approximations of task completion time is often within reach. The first step is to construct an activity network or order-of-processing diagram from the task analysis. Second, activity durations are found in the literature or approximated through multidimensional scaling. Finally, equations are written for calculating task completion time, or a program is written for simulations to estimate this time. Resulting models can be useful for optimizing system design. The approach is illustrated with an activity network by W. D. Gray, B. E. John, and M. E. Atwood (1993) for a telephone operator task. Simulations demonstrate the feasibility of using multidimensional scaling to obtain approximate activity durations. The approach is also illustrated with an order-of-processing diagram representing drivers reading roadside message displays. We point out that if a more detailed picture of unobservable mental processes in a task is needed, techniques have been developed for this through analysis of response times. Actual or potential applications of this research include system design, human-computer interaction, message comprehension, and simulation of information-processing tasks.
Get full access to this article
View all access options for this article.
References
1.
Annett, J., & Duncan, K. D. (1967). Task analysis and training design. Occupational Psychology, 41, 211–221.
2.
Ashby, F. G., & Townsend, J. T. (1980). Decomposing the reaction time distribution: Pure insertion and selective influence revisited. Journal of Mathematical Psychology, 21, 93–123.
3.
Atwood, M. E., Gray, W. D., & John, B. E. (1996). Project Ernestine: Analytic and empirical methods applied to a real world CHI problem. In M. Rudsill, C. Lewis, P. B. Polson, & T. D. McKay (Eds), Human-computer interface design: Success stories, emerging methods and real-world context (pp. 122–134). San Mateo, CA: Morgan Kaufmann.
4.
Baber, C., & Mellor, B. (2001). Using critical path analysis to model multimodal human-computer interaction. International Journal of Human-Computer Studies, 54, 613–636.
5.
Card, S. K., Moran, T. P., & Newell, A. (1983). The psychology of human computer interaction. Hillsdale, NJ: Erlbaum.
6.
Chipman, S. F., Schraagen, J. M., & Shalin, V. L. (2000). Introduction to cognitive task analysis. In J. M. Schraagen, S. F. Chipman, & V. L. Shalin (Eds.), Cognitive task analysis (pp. 3–23). Mahwah, NJ: Erlbaum.
7.
Cox, T. F., & Cox, M. A. A. (1994). Multidimensional scaling. London: Chapman and Hall.
8.
Diaper, D. (1989). Task analysis for human computer interaction. Chichester: Wiley.
9.
Elmaghraby, S. E. (1964). An algebra for the analysis of generalized activity networks. Management Science, 10, 494–514.
10.
Elmaghraby, S. E. (1966). The design of production systems. New York: Reinhold.
11.
Elmeghraby, S. E. (1977). Activity networks: Project planning and control by network models. New York: Wiley.
12.
Fisher, D. L., & Goldstein, W. M. (1983). Stochastic PERT networks as models of cognition: Derivation of the mean, variance, and distribution of reaction time using order-of-processing (OP) diagrams. Journal of Mathematical Psychology, 27, 121–115.
13.
Gilbreth, F. B., & Gilbreth, L. M. (1921). Process charts. Transactions of the American Society of Mechanical Engineers, 43, 1029–1050.
14.
Gray, W. D., & Boehm-Davis, D. A. (2000). Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of Experimental Psychology: Applied, 6, 322–335.
15.
Gray, W. D., John, B. E., & Atwood, M. E. (1993). Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world task performance. Human-Computer Interaction, 8, 237–309.
16.
John, B. E. (1990). Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information. In Proceedings of the CHI '90 Conference on Human Factors in Computing Systems (pp. 107–115). New York: Association for Computing Machinery.
17.
John, B. E. (1996). TYPIST: A theory of performance in skilled typing. Human-Computer Interaction, 11, 321–355.
18.
John, B. E., & Gray, W. D. (1992, May). GOMS analysis for parallel activities. Tutorial presented at the CHI `92 Conference on Human Factors in Computing Systems, Monterey, CA.
19.
Kieras, D. E. (1988). Towards a practical GOMS model methodology for human interface design. In M. Helander (Ed.), The handbook of human-computer interaction (pp. 135–158). Amsterdam: North-Holland.
20.
Kieras, D. E. (1996). GOMS modeling of user interfaces using NGOMSL. In M. Helander & T. Landauer (Eds.), The handbook of human-computer interaction (2nd ed., pp. 142–161). Amsterdam: North-Holland.
21.
Kieras, D. E., & Meyer, D. E. (2000). The role of cognitive task analysis in the application of predictive models of human performance. In J. M. Schraagen, S. F. Chipman, & V. L. Shalin (Eds.), Cognitive task analysis (pp. 237–260). Mahwah, NJ: Erlbaum.
22.
Kieras, D. E., Wood, S. D., & Meyer, D. E. (1997). Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task. ACM Transactions on Computer-Human Interaction, 4, 230–275.
23.
Kirwan, B. & Ainsworth, L. K. (Eds.). (1992). A guide to task analysis. London: Taylor & Francis.
24.
Kohfeld, D. L., Santee, J. L., & Wallace, N. D. (1981). Loudness and reaction time: II. Identification of detection components at different intensities and frequencies. Perception and Psychophysics, 29, 550–562.
25.
Kruskal, J. B. (1964a). Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika, 29, 1–27.
26.
Kruskal, J. B. (1964b). Nonmetric multidimensional scaling: A numerical method. Psychometrika, 29, 115–129.
27.
Luce, R. D. (1986). Response times: Their role in inferring elementary mental organization. New York: Oxford University Press.
28.
Modor, J. J., & Phillips, C. R. (1970). Project management with CPM and PERT (2nd ed.). New York: Van Nostrand Reinhold.
29.
Nelder, J. A., & Mead, R. (1965). A simplex method for function minimization. Computer Journal, 7, 308–313.
30.
Olson, J. R., & Olson, G. M. (1990). The growth of cognitive modeling in human-computer interaction since GOMS. Human Computer Interaction, 5, 221–265.
31.
Press, W. H., Flannery, B. P., Teukolsky, S. A., & Vetterling, W. T. (1988). Numerical recipes in C: The art of scientific computing, Cambridge, UK: Cambridge University Press.
32.
Pritsker, A. A. B. (1979). Modeling and analysis using Q-GERT networks (2nd ed.). New York: Wiley.
33.
Rayner, K., & Duffy, S. A. (1986). Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity. Memory and Cognition, 14, 191–201.
34.
Rayner, K. & Fischer, M. H. (1996). Mindless reading revisited: Eye movements during reading and scanning are different. Perception and Psychophysics, 58, 734–747.
35.
Reichle, E. D., Pollatsek, A., Fisher, D. L., & Rayner, K. (1998). Toward a model of eye movement control in reading. Psychological Review, 105, 125–157.
36.
Schweickert, R. (1978). A critical path generalization of the additive factor method: Analysis of a Stroop task. Journal of Mathematical Psychology, 18, 105–139.
37.
Schweickert, R., Fisher, D., & Goldstein, W. (1992). General latent network theory: Structural and quantitative analysis of networks of cognitive processes. (Tech. Report 92-1). West Lafayette, IN: Purdue University Mathematical Psychology Program.
38.
Shepard, R. N. (1962a). The analysis of proximities: Multidimensional scaling with an unknown distance function I. Psychometrika, 27, 125–140.
39.
Shepard, R. N. (1962b). The analysis of proximities: Multidimensional scaling with an unknown distance function II. Psychometrika, 27, 219–246.
40.
Shepard, R. N. (1966). Metric structures in ordinal data. Journal of Mathematical Psychology, 3, 287–315.
41.
Shepherd, A. (2001). Hierarchical task analysis. London: Taylor & Francis.
42.
Wiest, J. D., & Levy, F. K. (1977). A management guide to PERT/CPM (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.
43.
Williams, K. E. (2000). An automated aid for modeling human-computer interaction. In J. M. Schraagen, S. F. Chipman, & V. L. Shalin (Eds.), Cognitive task analysis (pp. 165–180). Mahwah, NJ: Erlbaum.
