The goal of expert systems is to provide competent advice and assistance to users in tasks that require some degree of specialized knowledge. The success of expert systems depends not only on the quality and completeness of the knowledge elicited from experts but also on the compatibility of the recommendations and decisions with the end user's conceptualization of the task. This paper discusses the critical psychological and human factors issues that must be addressed in the design, prototyping, and acceptance of expert systems. Specifically, human factors considerations are addressed from the development, rapid proto typing, and end-user perspectives. Where possible, human factors guidelines are offered for each knowledge-processing stage underlying expert system development, prototyping, evaluation, and acceptance.
Get full access to this article
View all access options for this article.
References
1.
Anderson, J. R. (1980). Cognitive psychology and its implications. San Francisco: W. H. Freeman.
2.
Anderson, J. R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.
3.
Barr, A., Cohen, P. R., and Feigenbaum, E. A. (Eds.). (1981-1982). The handbook of artificial intelligence (vols. 1-3). Los Altos, CA: William Kaufman.
4.
Bobrow. D. G., and Collins, A. (Eds.). (1975). Representation and understanding studies in cognitive science. New York: Academic Press.
5.
Bobrow, D. G., and Winograd, T. (1977). An overview of KRL. a knowledge representation language. Cognitive Science, 1, 3–46.
6.
Clancey, W. J. (1985, March). Heuristic classification (KSL Memo 85-5). Stanford, CA: Stanford University.
7.
Clancey, W. J. (1986, August). From GUIDON to NEOMYCIN and HERACLES in twenty short lessons: ORN final report 1979-1985. The AI Magazine, Conference Issue.
8.
Cleaves, D. A. (1987). Cognitive biases and corrective techniques: Proposals for improving elicitation procedures for knowledge-based systems. International Journal of Man-Machine Systems, 27, 155–166.
9.
Cohen, J., Dearnaley, E. J., and Hansel, C. E. K. (1958). The mutual effect of two uncertainties. Durham Research Review, 2, 215–222.
10.
Cohen, P. R. (1985). Heuristic reasoning about uncertainty: An artificial intelligence approach. Boston: Pitman.
11.
Committee on Human Factors and the National Research Council. (1983). Research Needs for Human Factors, (pp. 1–11). Washington, DC: National Academy Press.
12.
Edwards, W., and Phillips, L. D. (1964). Man as transducer for probabilities in Bayesian command and control systems. In M. W. Shelly II and G. L. Bryan (Eds.), Human Judgment and Optimality (pp. 360–401). New York: Wiley.
13.
Fischhoff, B. (1982). Debiasing. In D. Kahneman, P. Siovic, and A. Tversky (Eds.). Judgment under uncertainty: Heuristics and biases (pp. 422–444). New York: Cambridge University Press.
14.
Fischhoff, B. (1984). Eliciting information from experts. In Research Needs for Human Factors (pp. 33–48). Washington, DC: National Academy Press.
15.
Gentner, D., and Stevens, A. L. (Eds.). (1983). Mental models. Hillsdale, NJ: Erlbaum.
16.
Harmon, P., and King, D. (1985). Expert systems: Artificial intelligence in business. New York: Wiley.
17.
Hayes-Roth, F., Waterman, D., and Lenat, D. (Eds.). (1983). Building expert systems. New York: Addison-Wesley.
18.
Hogarth, R. M. (1980). In Judgment and choice: Strategies for decision.New York: Wiley.
19.
Hunt, E. (1983). On the nature of intelligence. Science, 219, 141–146.
20.
Kahneman, D., and Tversky, A. (1972). On prediction and judgment. ORI Research Monograph, 12.
21.
Kahneman, D., and Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80, 751–757.
22.
Lenat, D. B. (1976, July). AM: Artificial intelligence approach to discovery in mathematics as heuristic search (Tech. Report STAN-CS-76-570). Stanford, CA: Stanford University, Computer Science Department.
23.
Lindsay, P. H., and Norman, D. A. (1977). Human information processing: An introduction to psychology (2nd ed.). New York: Academic Press.
24.
Lichtenstein, S., and Fischhoff, B. (1980). Training for calibration. Organizational behavior and human performance, 26, 149–171.
25.
Mackie, R. R. (1980). Design criteria for decision aids: The user's perspective. In Proceedings of the Human Factors Society 24th Annual Meeting (pp. 80–84). Santa Monica, CA: Human Factors Society.
26.
Madni, A. M., and Chu, Y. (1985). Network model-guided expert knowledge acquisition. In Proceedings of the 1985 IEEE International Conference on Systems, Man and Cybernetics (pp. 10–13). New York: IEEE.
27.
Madni, A. M., Margalit, G., and Chu, Y. (1985, May). Pilot's associate definition study: Structured piloting task analysis for AI expert systems applicability, part II (Report PFTR-1I76-85-6). Woodland Hills, CA: Perceptronics, Inc.
28.
Madni, A. M., and Moses, F. (1985, November). An intelligent soldier-vehicle interface for close combat vehicles. In Proceedings of the 1985 International Conference on Systems, Man and Cybernetics (pp. 754–756). New York: IEEE.
29.
Madni, A. M., Brenner, M. A., Costea, I., MacGregor, D., and Meshkinpour, F. (1985, November). Option generation: Problems, principles, and computer-based aiding. In Proceedings of the 1985 IEEE International Conference on Systems, Man, and Cybernetics (pp. 747–760). New York: IEEE.
30.
Madni, A. M., Chu, Y., Purcell, D., and Brenner, M. A. (1983, September). Design for maintainability with modified Petri nets (MPNs) (Tech. Report PTR-1125-83-9). Arlington, VA: Shipboard Propulsion System Application, Office of Naval Research (ONR).
31.
McDermott, J. (1986). Transcripts of plenary session: Interactive tools. In: First AAAI Workshop on Knowledge Acquisition for Knowledge-Based Systems, Banff, Canada.
32.
Merrill, M. D. (1983). Component display theory. In C. M. Reigeluth (Ed.), Instructional design theories and models: An Overview of their current status (279–333). Hillsdale, NJ: Erlbaum.
33.
Minsky, M. (1975). A framework for representing knowledge. In P. Winston (Ed.), The psychology of computervision (pp. 211–277). New York: McGraw-Hill.
34.
Nilsson, N. J. (1971). Problem-solving methods in artificial intelligence. New York: McGraw-Hill.
35.
Peterson, C. R., Schneider, R. J., and Miller, A. J. (1965). Sample size and the revision of subjective probability. Journal of Experimental Psychology, 69, 522–527.
36.
Pople, H. E., Jr. (1982). Heuristic methods for imposing structure on ill-structured problems: The structuring of medical diagnostics. In P. Szolovits (Ed.), Artificial intelligence in medicine (pp. 119–190). Boulder, CO: Westview Press.
37.
Posner, M.I. (1973). Cognition: An introduction. Glenview, IL: Scott, Foresman.
38.
Quillian, M. R. (1968). Semantic memory. In M. Minsky (Ed.), Semantic information processing. (pp. 216–270). Cambridge, MA: MIT Press.
39.
Rasmussen, J. (1983). Skills, rules, and knowledge: Signals, signs, symbols, and other distinctions in human performance models. IEEE Transactions on Systems, Man and Cybernetics, 13, 257–266.
40.
Schank, R. C., and Abelson, R. P. (1977). Scripts, plans, goals, and understanding. Hillsdale, NJ: Erlbaum.
41.
Schank, R. C., and Riesbeck, C. K. (Eds.). (1981). Inside computer understanding: Five programs plus miniatures. Hillsdale, NJ: Erlbaum.
42.
Simon, H. A. (1979). Models of thought. New Haven, CT: Yale University Press.
43.
Spetzler, C. S., and Stael Von Holstein, C. (1975). Probability encoding in decision analysis. Management Science, 22, 340–358.
44.
Tulving, E., and Donaldson, W. (Eds.). (1972). Organization of memory. New York: Academic Press.
45.
Tversky, A., and Kahneman, D. (1973). Availability: A heuristic for judging frequency and probability. Cognitive Psychology, 5, 207–232.
46.
Tversky, A., and Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1125–1131.
47.
Tversky, A., and Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211, 453–458.
48.
Waterman, D. A., and Hayes-Roth, F. (Eds.). (1978). Pattern-directed inference systems. New York: Academic Press.
49.
Weiner, W. B., and Palermo, D. S. (Eds.). (1974). Cognition and the symbolic processes. Hillsdale, NJ: Erlbaum.
50.
Wilensky, R. (1983). Planning and understanding: A computational approach to human reasoning. Reading, MA: Addison-Wesley.
51.
Winograd, T. (1975). Frame representations and the declarative/procedural controversy. In D. G. Bobrow and A. Collins (Eds.), Representation and understanding: Studies in cognitive science (pp. 185–210). New York: Academic Press.
52.
Winston, P. H. (1977). Artificial intelligence. Reading, MA: Addison-Wesley.
53.
Winston, P. H. (1984). Artificial intelligence (2nd ed.). Reading, MA: Addison-Wesley.
