Improving the understanding of navigational commands by adapting a robot’s directional perception based on the environment

Abstract

Intelligent service robots are being developed for emerging areas of robotics applications. Human-friendly interactive features are preferred for these service robots since these robots are anticipated to be operated by non-experts. Humans prefer to use voice instructions for exchanging the ideas between peers. Such voice instructions often include distance and direction related language descriptors that are fuzzy in nature. Therefore, these service robots must be capable of interpreting the meaning of such fuzzy notions in language instructions in order to enhance the rapport between the robots and their users. This paper proposes a method to interpret the directional notions in motional and positional navigational commands by considering the fuzziness associated with linguistic notions. A fuzzy inference system has been developed in order to adapt a robot’s perception of fuzzy directional notions based on the environment. This adaptation is realized by weighting the output membership function with the distribution of free space around the robot or a reference object. Experiments have been conducted in an artificially created domestic environment with heterogeneous characteristics. According to the experimental results, the proposed system is capable of enhancing the understanding of navigational commands with fuzzy notions.

Keywords

Understanding of fuzzy language notions human–robot interactions human-friendly robotics service robotics social robotics

Get full access to this article

View all access options for this article.

References

Aaltonen,

Arvola,

Heikkilä and

Lammi, Hello pepper, may I tickle you?: Children’s and adults’ responses to an entertainment robot at a shopping mall, in: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human–Robot Interaction, ACM, 2017, pp. 53–54.

R.C.

Arkin, Behavior-Based Robotics, MIT Press, 1998.

C.L.

Bethel and

R.R.

Murphy, Review of human studies methods in HRI and recommendations, International Journal of Social Robotics 2(4) (2010), 347–359. doi:10.1007/s12369-010-0064-9.

Chatterjee,

Pulasinghe,

Watanabe and

Izumi, A particle-swarm-optimized fuzzy-neural network for voice-controlled robot systems, IEEE Transaction on Industrial Electronics 52(6) (2005), 1478–1489. doi:10.1109/TIE.2005.858737.

M.-T.

Chu,

Khosla,

S.M.S.

Khaksar and

Nguyen, Service innovation through social robot engagement to improve dementia care quality, Assistive Technology (2016).

P.D.

Ellis, The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and the Interpretation of Research Results, Cambridge University Press, 2010.

J.F.

Ferreira and

Dias, Attentional mechanisms for socially interactive robots – a survey, IEEE Transactions on Autonomous Mental Development 6(2) (2014), 110–125, ISSN 1943-0604. doi:10.1109/TAMD.2014.2303072.

H.-M.

Gross,

Scheidig,

Debes,

Einhorn,

Eisenbach,

Mueller,

Schmiedel,

T.Q.

Trinh,

Weinrich,

Wengefeld,

Bley and

Martin, ROREAS: Robot coach for walking and orientation training in clinical post-stroke rehabilitation – prototype implementation and evaluation in field trials, Autonomous Robots (2016), 1–20.

Guadarrama,

Riano,

Golland,

Go,

Jia,

Klein,

Abbeel,

Darrell et al., Grounding spatial relations for human–robot interaction, in: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2013, pp. 1640–1647. doi:10.1109/IROS.2013.6696569.

10.

Hemachandra,

Duvallet,

T.M.

Howard,

Roy,

Stentz and

M.R.

Walter, Learning models for following natural language directions in unknown environments, in: 2015 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2015, pp. 5608–5615. doi:10.1109/ICRA.2015.7139984.

11.

Hunt, Jspeech grammar format, W3C Note, June 2000.

12.

A.G.B.P.

Jayasekara,

Watanabe and

Izumi, Understanding user commands by evaluating fuzzy linguistic information based on visual attention, Artificial Life and Robotics 14(1) (2009), 48–52. doi:10.1007/s10015-009-0716-8.

13.

A.G.B.P.

Jayasekara,

Watanabe,

Kiguchi and

Izumi, Interpreting fuzzy linguistic information by acquiring robot’s experience based on internal rehearsal, Journal of System Design and Dynamics 4(2) (2010), 297–313. doi:10.1299/jsdd.4.297.

14.

A.G.B.P.

Jayasekara,

Watanabe,

Kiguchi and

Izumi, Adaptation of robot’s perception of fuzzy linguistic information by evaluating vocal cues for controlling a robot manipulator, Artificial Life and Robotics 15(1) (2010), 5–9. doi:10.1007/s10015-010-0755-1.

15.

Jayawardena,

Kuo,

Broadbent and

B.A.

MacDonald, Socially assistive robot HealthBot: Design, implementation, and field trials, IEEE Systems Journal (2014), 1–12, ISSN 1932-8184. doi:10.1109/JSYST.2014.2337882.

16.

Jayawardena,

Watanabe and

Izumi, Controlling a robot manipulator with fuzzy voice commands using a probabilistic neural network, Neural Computing and Applications 16(2) (2007), 155–166. doi:10.1007/s00521-006-0056-8.

17.

Kawamura,

Bagchi and

Park, An intelligent robotic aid system for human services, in: NASA Conference Publication, NASA, 1994, pp. 413–420.

18.

Lanillos,

J.F.

Ferreira and

Dias, Designing an artificial attention system for social robots, in: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015, pp. 4171–4178. doi:10.1109/IROS.2015.7353967.

19.

C.-T.

Lin and

M.-C.

Kan, Adaptive fuzzy command acquisition with reinforcement learning, IEEE Transaction on Fuzzy Systems 6(1) (1998), 102–121. doi:10.1109/91.660811.

20.

Mavridis, A review of verbal and non-verbal human–robot interactive communication, Robotics and Autonomous Systems 63 (2015), 22–35. doi:10.1016/j.robot.2014.09.031.

21.

M.A.V.J.

Muthugala and

A.G.B.P.

Jayasekara, Enhancing human–robot interaction by interpreting uncertain information in navigational commands based on experience and environment, in: 2016 IEEE International Conference on Robotics and Automation (ICRA), 2016, pp. 2915–2921. doi:10.1109/ICRA.2016.7487456.

22.

M.A.V.J.

Muthugala and

A.G.B.P.

Jayasekara, MIRob: An intelligent service robot that learns from interactive discussions while handling uncertain information in user instructions, in: 2016 Moratuwa Engineering Research Conference (MERCon), IEEE, 2016, pp. 397–402.

23.

M.A.V.J.

Muthugala and

A.G.B.P.

Jayasekara, Interpreting fuzzy directional information in navigational commands based on arrangement of the surrounding environment, in: 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), 2017, pp. 1–7. doi:10.1109/FUZZ-IEEE.2017.8015542.

24.

M.A.V.J.

Muthugala and

A.G.B.P.

Jayasekara, A review of service robots coping with uncertain information in natural language instructions, IEEE Access 6 (2018), 12913–12928. doi:10.1109/ACCESS.2018.2808369.

25.

Portet,

Vacher,

Golanski,

Roux and

Meillon, Design and evaluation of a smart home voice interface for the elderly: Acceptability and objection aspects, Personal and Ubiquitous Computing 17(1) (2013), 127–144. doi:10.1007/s00779-011-0470-5.

26.

Pulasinghe,

Watanabe,

Izumi and

Kiguchi, Modular fuzzy-neuro controller driven by spoken language commands, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 34(1) (2004), 293–302. doi:10.1109/TSMCB.2003.811511.

27.

Schiffer and

Ferrein, Decision-theoretic planning with fuzzy notions in GOLOG, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 24 (2016), 123–143. doi:10.1142/S0218488516400134.

28.

Schiffer,

Ferrein and

Lakemeyer, Reasoning with qualitative positional information for domestic domains in the situation calculus, Journal of Intelligent & Robotic Systems 66(1–2) (2012), 273–300. doi:10.1007/s10846-011-9606-0.

29.

Skubic,

Matsakis,

Chronis and

Keller, Generating multi-level linguistic spatial descriptions from range sensor readings using the histogram of forces, Autonomous Robots 14(1) (2003), 51–69. doi:10.1023/A:1020927503616.

30.

Tan,

Ju and

Liu, Grounding spatial relations in natural language by fuzzy representation for human–robot interaction, in: 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), IEEE, 2014, pp. 1743–1750. doi:10.1109/FUZZ-IEEE.2014.6891797.

31.

Tapus,

M.J.

Mataric and

Scasselati, The grand challenges in socially assistive robotics, IEEE Robotics and Automation Magazine 14(1) (2007), 35–42. doi:10.1109/MRA.2007.339605.

32.

Tellex,

Kollar,

Dickerson,

M.R.

Walter,

A.G.

Banerjee,

Teller and

Roy, Understanding natural language commands for robotic navigation and mobile manipulation, in: Proc. Twenty-Fifth AAAI Conference on Artificial Intelligence, AAAI Press, 2011, pp. 1507–1514.

33.

Whitney,

Eldon,

Oberlin and

Tellex, Interpreting multimodal referring expressions in real time, in: 2016 IEEE Int. Conf. Robotics and Automation (ICRA), IEEE, 2016, pp. 3331–3338. doi:10.1109/ICRA.2016.7487507.