Recent neuroscientific evidence in human and non-human primates indicates that the regions that become active during motor execution and motor observation overlap extensively in the cerebral cortex. This suggests that to observe an action, these primates employ their motor and somatosensation areas in order to simulate it internally. In line with this finding, in the current paper, we examine relevant neuroscientific evidence in order to design a computational agent that can facilitate observational learning of reaching movements. For this reason, we develop a novel motor control system, inspired from contemporary theories of motor control, and demonstrate how it can be used during observation to facilitate learning, without the active involvement of the agent’s body. Our results show that novel motor skills can be acquired only by observation, by optimizing the peripheral components of the agent’s motion.
BaldisseraF.CavallariP.CraigheroL.FadigaL. (2001). Modulation of spinal excitability during observation of hand actions in humans. European Journal of Neuroscience, 13(1), 90–94.
2.
Baron-CohenS.Tager-FlusbergH.CohenD. J. (1993). Understanding other minds: perspectives from autism. Oxford: Oxford University Press.
3.
BartoA. G. (1994). Adaptive critics and the basal ganglia. In HoukJ. C.DavisJ. L.BeiserD. G. (Eds.), Models of information processing in the basal ganglia. Cambridge: MIT Press.
4.
BentivegnaD. C.AtkesonC. G. (2002). Learning how to behave from observing others. In Proceedings of the SAB’02- Workshop on Motor Control in Humans and Robots: On the interplay of real brains and artificial devices, Edinburgh, UK, August.
5.
BillardA.HayesG. (1999). DRAMA, a connectionist architecture for control and learning in autonomous robots. Adaptive Behavior, 7(1), 35–63.
6.
BizziE.Mussa-IvaldiF. A.GiszterS. F. (1991). Computations underlying the execution of movement: A novel biological perspective. Science, 253, 287–291.
7.
ByrneR.WhitenA. (1989). Machiavellian intelligence: Social expertise and the evolution of intellect in monkeys, apes, and humans. Oxford, UK: Oxford Science Publications.
8.
CaspersS.ZillesK.LairdA. R.EickhoffS. B. (2010). ALE meta-analysis of action observation and imitation in the human brain. NeuroImage, 50, 1148–1167.
9.
CorkeP. I. (1996) A robotics toolbox for MATLAB. IEEE Robotics and Automation Magazine, 1, 24–32.
10.
ChaminadeT.MeltzoffA. N.DecetyJ. (2005). An fMRI study of imitation: Action representation and body schema. Neuropsychologia, 43(1), 115–127.
11.
DautenhahnK.NehanivC. K. (2002). Imitation in animals and artifacts. Cambridge, MA: MIT Press.
12.
DecetyJ.PhilipponB.IngvarD. H. (1988). rCBF landscapes during motor performance and motor ideation of a graphic gesture. European Archives Psychiatry and Neurological Sciences, 238, 33–38.
13.
DecetyJ.RydingE.StenbergG.IngvarD. H. (1990). The cerebellum participates in mental activity: Tomographic measurements of regional cerebral blood flow. Brain Research, 535(2), 313–317.
14.
DecetyJ.PeraniD.JeannerodM.Bettinardi TadaryB.WoodsR.MazziottaJ. C.FazioF. (1994). Mapping motor representations with PET. Nature, 371, 600–602.
15.
DegallierS.IjspeertA. (2010). Modeling discrete and rhythmic movements through motor primitives: A review. Biological Cybernetics, 103(4), 319–338.
16.
DemirisY.HayesG. (2002). Imitation as a dual-route process featuring predictive and learning components: A biologically-plausible computational model. In DautenhahnK.NehanivC. (Eds.), Imitation in animals and artifacts. Cambridge, MA: MIT Press.
17.
DemirisY.SimmonsG. (2006). Perceiving the unusual: Temporal properties of hierarchical motor representations for action perception. Neural Networks, 19(3), 272–284.
18.
DenisM. (1985). Visual imagery and the use of mental practice in the development of motor skills. Canadian Journal of Applied Sport Science, 10, 4–16.
19.
ElshawM.WeberC.ZochiosA.WermterS. (2004). An associator network approach to robot learning by imitation through vision, motor control and language. International Joint Conference on Neural Networks, Budapest, Hungary.
20.
Fabbri-DestroM.RizzolattiG. (2008). Mirror neurons and mirror systems in monkeys and humans. Physiology23, 171–179.
21.
FieldmanJ. B.CohenL. G.JezzardP.PonsT.SadatoR.TurnerR.. (1993). Functional neuroimaging with echo-planar imaging in humans during execution and mental rehearsal of a simple motor task. 12th Annual Meeting of the Society of Magnetic Resonance in Medicine, 1416.
22.
GalleseV.FadigaL.FogassiL.RizzolattiG. (1996). Action recognition in the premotor cortex. Brain, 119, 593–609.
23.
GeorgopoulosA.KalaskaJ.CaminitiR.MasseyJ. (1982). On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. Journal of Neuroscience, 2, 1527–1537.
24.
GiszterS. FMussa-IvaldiF. A.BizziE. (1993). Convergent force fields organized in the frog’s spinal cord. Journal of Neuroscience, 13(2), 467.
25.
HarunoM.WolpertD. M.KawatoM. (2001). Mosaic model for sensorimotor learning and control. Neural Computation, 13(10), 2201–2220.
26.
HourdakisE.TrahaniasP. (2011a). Computational modeling of online reaching, European Conference on Artificial Life, ECAL11, Paris, France.
27.
HourdakisE.TrahaniasP. (2011b). Observational learning based on overlapping pathways. Second International Conference on Morphological Computation, MORPHCOMP11, Venice, Italy.
28.
HourdakisE.SavakiE.TrahaniasP. (2011). Computational modeling of cortical pathways involved in action execution and action observation. Neurocomputing, 74(7), 1135–1155.
29.
IacoboniM. (2009). Imitation, empathy, and mirror neurons. Annual Review of Psychology, 60, 653–670.
30.
JeannerodM. (1994). The representing brain: Neural correlates of motor imagery and intention. Behavioral and Brain Sciences, 17, 187–245.
31.
MaassW.NatschlaegerT.MarkramH. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations, Neural Computation, 14(11), 2531–2560.
32.
OztopE.ArbibM. A. (2002). Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics, 87, 116–140.
33.
ParsonsL. M.GabrieliJ. D. E.PhelpsE. A.GazzanigaM. S. (1998). Cerebrally lateralized mental representations of hand shape and movement. Journal of Neuroscience, 18, 6539–6548.
34.
RaosV.EvangeliouM. N.SavakiH. E. (2004). Observation of action: Grasping with the mind’s hand. NeuroImage, 23(1), 193–201.
35.
RaosV.EvangeliouM. N.SavakiH. E. (2007). Mental simulation of action in the service of action perception. NeuroImage, 27(46), 12675–12683.
36.
RichardsonA. (1967). Mental practice: A review and discussion, Part 1. Research Quarterly, 38, 95–107.
37.
RizzolattiG.FadigaL. (1998). Grasping objects and grasping action meanings: The dual role of monkey rostroventral premotor cortex (area F5). New York: Wiley.
38.
RolandP. E.SkinhojE.LassenN. A.LarsenB. (1980). Different cortical areas in man in organization of voluntary movements in extrapersonal space. Journal of Neurophysiology, 43, 137–150.
39.
SaundersJ.NehanivC. L.DautenhahnK. (2004). An experimental comparison of imitation paradigms used in social robotics. 13th IEEE International Workshop on Robot and Human Interactive Communication, ROMAN 2004, 691–696.
40.
SavakiE. (2010). How do we understand the actions of others? By mental simulation not mirroring. Cognitive Critique, 2, 99–140.
41.
ScassellatiB. (1999). Imitation and mechanisms of joint attention: A developmental structure for building social skills. In NehanivC. L. (Ed.), Computation for metaphors, analogy and agents, vol. 1562, 176–195. Springer Lecture Notes in Artificial Intelligence. Berlin, Germany: Springer.
42.
SchaalS. (1999). Is imitation learning the route to humanoid robots?Trends in Cognitive Sciences, 3, 233–242.
43.
SchaalS.IjspeertA.BillardA. (2003) Computational approaches to motor learning by imitation. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 358(1431), 537–547.
44.
SchultzW.TremblayL.HollermanJ. R. (2000). Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral Cortex, 10(3), 272.
45.
TaniJ.ItoM.SugitaY. (2004). Self-organization of distributed represented multiple behavior schemata in a mirror system: Reviews of robot experiments using RNNPB. Neural Networks, 17(8–9), 1273–1289.
46.
TouwenB. C. L. (1998). The brain and development of function. Developmental Review, 18(4), 504–526.
