Sage Journals: Discover world-class research

Abstract

Computational models of motivation are tools that artificial agents can use to identify, prioritize, select and adapt the goals they will pursue autonomously. Previous research has focused on developing computational models of motivation that permit artificial agents to exhibit characteristics such as adaptive exploration, problem-finding behavior, competence-seeking behavior, and creativity. This permits self-motivated agents to identify novel or interesting goals not specifically programmed by system engineers, or adapt in complex or uncertain environments where it is difficult for system engineers to identify all possible goals in advance. However, existing computational models of motivation cover only a small subset of psychological motivation theories. There remains potential to draw on other psychological motivation theories to create artificial agents with new behavioral characteristics. This includes agents that can strive for standards of excellence, both internal and external; agents that can proactively socialize and build relationships with others; and agents that can exert their influence to gain control of resources. With these objectives in mind, this article expands our ‘‘motivation toolbox’’ with three new computational models of motivation for achievement, affiliation, and power motivation. The models are designed such that they can be used in isolation or together, embedded in an artificial ‘‘motive profile.’’ To validate the new models of motivation, three experiments are presented that compare the goal-selecting behavior of artificial agents with different motive profiles with that of humans with corresponding motive profiles. Results show that agents with different motive profiles exhibit different goal-selection characteristics, and that these various characteristics are statistically similar to behavioral trends observed experimentally in humans. The article concludes by discussing areas for the future development of each motivation model and the future roles and applications of agents with different motive profiles.

Keywords

Achievement affiliation power motivation intelligent agent goal selection

Get full access to this article

View all access options for this article.

References

Atkinson, J.W. ( 1957). Motivational determinants of risk-taking behavior . Psychological Review, 64, 359-372.

Atkinson, J.W. , & Litwin, G.H. ( 1960). Achievement motive and test anxiety conceived as motive to approach success and motive to avoid failure. Journal of Abnormal and Social Psychology, 60, 52-63.

Bailly, R.C. ( 1987). The influence of gender of purposes and outcomes of alcohol use. Unpublished master’s thesis, University of Wyoming , Laramie.

Braubach, L. , Pokahr, A. , Moldt, D. , & Lamersdorf, W. (2005). Goal representation for BDI agent systems. In R. H. Bordini, M. Dastani, J. Dix & A. E. Seghrouchni (Eds.), 2nd International Workshop on Programming Multiagent Systems: Languages and Tools . Springer-Verlag (pp. 9-20).

Brody, N. ( 1983). Human motivation: commentary on goal-directed action . New York: Academic Press .

Brown, J.S. ( 1948). Gradients of approach and avoidance responses and their relation to models of motivation. Journal of Comparative and Physiological Psychology, 41, 450-465.

Camerer, C. , Ho, T.-H. , & Chong, J. ( 2001). Behavioral game theory: thinking, learning and teaching . California Institute of Technology.

Dignum, F. , & Conte, R. ( 1998). Intentional agents and goal formation. In M. P. Singh , A. S. Rao & M. Wooldridge (Eds.), Intelligent Agents IV: Agent Theories, Architectures and Languages (pp. 231-243). Berlin: Springer.

Edmonds, B. , & Moss, S. ( 2001). The importance of representing congnitive processes in multi-agent models. In G. Dorffner , H. Bischof & K. Hornik (Eds.), Artificial Neural Networks-ICANN 2001. Springer-Verlag (pp. 759-766).

10.

Hazy, J.K. ( 2007). Computer models of leadership: foundations of a new discipline or meaningless diversion? The Leadership Quarterly, 18(4), 391-410.

11.

Heckhausen, J. , & Heckhausen, H. (2008). Motivation and action . New York: Cambridge University Press.

12.

Huang, X. , & Weng, J. ( 2007). Inherent value systems for autonomous mental development . International Journal of Humanoid Robotics, 4(2), 407-433.

13.

Lee, R. , Walker, R. , Meeden, L. , & Marshall, J. ( 2009). Category-based intrinsic motivation. In: L. Canamero, P.-Y. Oudeyer & C. Balkenius (Eds.), 9th International Conference on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems (pp. 81-88). Lund: Lund University Cognitive Studies.

14.

Li, S. , Wang, Z.-J. , & Li, Y.-M. ( 2010). Is there a violation of Savage’s sure-thing principle in the prisoner’s dilemma game? Adaptive Behavior , 18(3-4), 377-385.

15.

Litwin, G.H. ( 1966). Achievement motivation, expectancy of success and risk-taking behavior. In J. W. Atkinson & N. T. Feather (Eds.), A theory of achievement behavior (pp. 103-105). New York: Wiley .

16.

Locke, E.A. , & Latham, G.P. ( 1990). A theory of goal setting and task performance . Englewood Cliffs, NJ: Prentice Hall.

17.

Mandler, G. , & Sarason, S.B. ( 1952). A study of anxiety and learning. Journal of Abnormal and Social Psychology, 47, 166-173.

18.

Marshall, J. , Blank, D. , & Meeden, L. ( 2004). An emergent framework for self-motivation in developmental robotics. In J. Triesch & T. Jebara (Eds.), 3rd International Conference on Developmental Learning. UCSD Institute for Neural Computation (pp. 104-111).

19.

Marsland, S. , Nehmzow, U. , & Shapiro, J. ( 2000). A real-time novelty detector for a mobile robot . In EUREL European Advanced Robotics Systems Masterclass and Conference, University of Salford, Manchester, UK.

20.

McClelland, D.C. ( 1975). Power: the inner experience. New York : Irvington.

21.

McClelland, D.C. , Atkinson, J.W. , Clark, R.A. , & Lowell, E.L. ( 1958). A scoring manual for the achievement motive. In J.W. Atkinson (Ed.), Motives in fantasy, action and society (pp. 179-204). Princeton, NJ : D. Van Nostrand Company, Inc.

22.

McClelland, D.C. , & Watson, R.I. ( 1973). Power motivation and risk-taking behavior. Journal of Personality, 41, 121-139.

23.

Merrick, K. ( 2010). A comparative study of value systems for self-motivated exploration and learning by robots. IEEE Transactions on Autonomous Mental Development, 2(2), 119-131 (Special Issue on Active Learning and Intrinsically Motivated Exploration in Robots).

24.

Merrick, K. ( 2011). A computational model of achievement motivation for artificial agents. In International Conference on Autonomous Agents and Multi-Agent Systems. (in press).

25.

Merrick, K. , & Maher, M.L. ( 2009). Motivated reinforcement learning: curious characters for multiuser games. Berlin: Springer .

26.

Murray, H.A. ( 1938). Explorations in personality. New York : Oxford University Press.

27.

Nilsson, N.J. ( 1996). Introduction to machine learning. http://ai.stanford.edu/people/nilsson/mlbook.html (Accessed January, 2006).

28.

Oudeyer, P.-Y. , Kaplan, F. , & Hafner, V.V. ( 2007). Intrinsic motivation systems for autonomous mental development . IEEE Transactions on Evolutionary Computation , 11(2), 265-286.

29.

Rapoport, A. , & Chammah, A. ( 1965). Prisoner’s dilemma. Ann Arbor, MI: University of Michigan Press.

30.

Russell, S.J. , & Norvig, P. ( 1995). Artificial intelligence: a modern approach. Englewood Cliffs, NJ: Prentice Hall.

31.

Saunders, R. ( 2001). Curious design agents and artificial creativity. Unpublished doctoral dissertation, University of Sydney , Sydney.

32.

Saunders, R. , & Gero, J.S. ( 2001). The digital clockwork muse: a computational model of aesthetic evolution. In G. Wiggins (Ed.), Proceedings of the AISB’01 Symposium on AI and Creativity in Arts and Science, SSAISB (pp. 12-21).

33.

Saunders, R. , & Gero, J.S. ( 2004). Curious agents and situated design evaluations. Artificial Intelligence for Engineering Design, Analysis and Manufacturing , 18(2), 153-161.

34.

Savage, T. ( 2000). Artificial motives: a review of motivation in artificial creatures. Connection Science, 12, 211-277.

35.

Schmidhuber, J. ( 1991). A possibility for implementing curiosity and boredom in model-building neural controllers. In J.A. Meyer & S.W. Wilson (Eds.), International Conference on Simulation of Adaptive Behaviour: From Animals to Animats (pp. 222-227). Cambridge, MA: MIT Press/ Bradford Books.

36.

Schultheiss, O.C. , Wirth, M.M. , Waugh, C.E. , Stanton, S.J. , Meier, E.A. , & Reuter-Lorenz, P. (2008). Exploring the motivational brain: effects of implicit power motivation on brain activation in response to facial expressions of emotion. Social Cognitive and Affective Neuroscience, 3(4), 333-343.

37.

Simkins, C. , Isbell, C. , & Marquez, N. ( 2010). Deriving behavior from personality: a reinforcement learning approach. In D. D. Salvucci & G. Gunzelmann (Eds.), International Conference on Cognitive Modelling. Drexel University (pp. 229-234).

38.

Simsek, O. , & Barto, A.G. ( 2004). Using relative novelty to identify useful temporal abstractions in reinforcement learning. In Proceedings of the 21st International Conference on Machine Learning, Banff, Canada (pp. 751-758).

39.

Singh, S. , Barto, A.G. , & Chentanez, N. ( 2005). Intrinsically motivated reinforcement learning . In L. K. Saul , Y. Weiss & L. Bottou (Eds.), Advances in Neural Information Processing Systems, 17 (NIPS). MIT Press (pp. 1281-1288).

40.

Terhune, K.W. ( 1968). Motives, situation and interpersonal conflict within prisoner’s dilemma. Journal of Personality and Social Psychology, Monograph Supplement, 8, 1-24.

41.

Van Benthem, J. ( 2008). Logic and Reasoning: do the facts matter? Studia Logica, 88(1), 67-84.

42.

Weng, J. , McClelland, J. , Pentland, A. , Sporns, O. , Stockman, I. , & Sur, M. et al (2001). Artificial intelligence: autonomous mental development by robots and animals. Science, 291, 599-600.

Achievement,affiliation,and power: Motive profiles for artificial agents

Abstract

Keywords

Get full access to this article

References