A suggested virtual reality methodology allowing people with cognitive disabilities to communicate their knowledge and experiences of public transport systems

Abstract

This paper presents a suggested methodology based on virtual reality (VR) technology that enables people with cognitive disabilities to communicate their knowledge and experiences of public transport systems. The users interacted with the VR system by verbally describing their actions to the person controlling the VR system and/or pointing with a laser pointer while seated in front of three screens on which the virtual environment (VE) was projected. A surround sound system was used to add realism. The users were video filmed as they took a virtual bus trip and were then asked to think aloud about their experience while watching the video material. The VR methodology was evaluated on seven people with stroke. Overall, the results suggested that the VR methodology is feasible for people with cognitive disabilities. Despite some initial difficulties, the subjects managed to communicate their intentions, some by combining verbalisations and pointing with the laser pointer in a very efficient manner. They were engaged in the virtual bus trip and made comments on the experience, including comments on emotional aspects. Interestingly, the subjects' verbal descriptions of what they wanted to do revealed in parts aspects of how they reasoned when taking the bus trip.