Sage Journals: Discover world-class research

Abstract

In this paper we introduce a novel assistant for autonomous navigation of partially sighted people. The system, called ALICE, offers information about the location and possible directions a visual impaired user must follow in order to reach the desired destinations. The navigation is completed with a novel computer vision method that is able to detect and classify, in real-time, both static and dynamic obstacles without any a priori information about the obstacle type, size, position or location. The GPS localization is enriched with a visual landmark recognition technique. Finally, through audio feedback a set of warnings is launched so that the user is alerted of potential hazards. For the feedback, audio bone conduction headphones are employed in order to allow the visually impaired to hear the systems warnings, but also other sounds from the environment. At the hardware level, the system is totally integrated on a smartphone which makes it easy to wear, non-invasive and low-cost.

Keywords

Visual impaired mobility navigation assistant obstacle detection and classification smartphone device

Get full access to this article

View all access options for this article.

References

[1]

Bay,

Tuytelaars and

Gool, Surf: Speeded up robust features, in: European Conference on Computer Vision – ECCV, Vol. 3951, Springer, Berlin, Heidelberg, 2006, pp. 404–417.

[2]

Black and

Anandan, A framework for robust estimation of optical flow, in: International Conference on Computer Vision CVPR, 1993, pp. 231–236.

[3]

B.B.

Blasch,

W.R.

Wiener and

R.L.

Welsh, Foundations of Orientation and Mobility, 2nd edn, American Foundation for the Blind, New York, ISBN 0891289461, 1997.

[4]

Cardin,

Thalmann and

Vexo, A wearable system for mobility improvement of visually impaired people, Visual Computers23(2) (Jan. 2007), pp. 109–118.

[5]

Cimiano,

Hotho and

Staab, Comparing conceptual, divisive and agglomerative clustering for learning taxonomies from text, in: 16th Proc. of the European Conference on Artificial Intelligence (ECAI), 2004, pp. 435–439.

[6]

Dakopoulos,

S.K.

Boddhu and

Bourbakis, A 2D vibration array as an assistive device for visually impaired, in: 7th IEEE International Conference on Bioinformatics and Bioengineering (ICBBE), Boston, 2007, pp. 930–937.

[7]

Dakopoulos and

Bourbakis, Preserving visual information in low resolution images during navigation of visually impaired, in: 1st International Conference on PErvasive Technologies Related to Assistive Environments, Greece, July 2008, pp. 1–6.

[8]

Dakopoulos and

N.G.

Bourbakis, Wearable obstacle avoidance electronic travel aids for blind: A survey, IEEE Transactions on Systems Man and Cybernetics, Part C (Applications and Reviews)40(1) (Jan. 2010), 25–35.

[9]

Dalal and

Triggs, Histograms of oriented gradients for human detection, in: International Conference on Computer Vision and Pattern Recognition (CVPR), New York, USA, Vol. 1, 2005, pp. 886–893.

10.

[10]

Dalal and

Triggs, Object detection using histograms of oriented gradients, in: European Conference on Computer Vision (ECCV), Workshop on Pascal VOC’06, 2006, pp. 220–233.

11.

[11]

C.R.

Dance,

Csurka,

Fan,

Willamowski and

Bray, Visual categorization with bags of keypoints, in: Workshop on Statistical Learning in Computer Vision at European Conference on Computer Vision (ECCV), Prague, 2004, pp. 1–22.

12.

[12]

Ding and

He, K-means clustering via principal component analysis, in: 21th International Conference on Machine Learning (ICML), New York, USA, 2004, pp. 29–37.

13.

[13]

J.W.

Durham and

Bullo, Smooth nearness-diagram navigation, in: International Conference on Intelligent Robots and Systems (IROS), Sept. 2008, pp. 690–695.

14.

[14]

R.G.

Golledge,

J.R.

Marston and

C.M.

Costanzo, Attitudes of visually impaired persons towards the use of public transportation, Journal of Visual Impairment and Blindness (JVIB)90(1) (1997), 446–459.

15.

[15]

J.L.

Gonzalez-Mora,

Rodriguez-Hernandez,

L.F.

Rodriguez-Ramos,

Diaz-Saco and

Sosa, Development of a new space perception system for blind people, based on the creation of a virtual acoustic space, in: Engineering Applications of Bio-Inspired Artificial Neural Networks, Vol. 1607, 1999, pp. 321–330.

16.

[16]

Hub,

Diepstraten and

Ertl, Design and development of an indoor navigation and object identification system for the blind, in: ACM SIGACCESS Accessibility Computing, Vol. 77, 2004, pp. 147–152.

17.

[17]

Ito,

Okamoto,

Akita,

Ono,

Gyobu,

Tagaki,

Hoshi and

Mishima, CyARM: An alternative aid device for blind persons, in: Proc. CHI05, Portland, OR, Apr. 2005, pp. 1483–1488.

18.

[18]

L.A.

Johnson and

C.M.

Higgins, A navigation aid for the blind using tactile-visual sensory substitution, in: 28th IEEE Engineering in Medicine and Biology Society, Vol. 1, 2006, pp. 6289–6292.

19.

[19]

Khan,

Moideen,

Khoo,

Zhu and

Lopez, KinDetect: Kinect detecting objects, in: 13th International Conference on Computers Helping People with Special Needs, LNCS, Vol. 7383, Springer, Berlin, Heidelberg, 2012, pp. 588–595.

20.

[20]

M.M.

Kuritsky and

M.S.

Goldstein, Inertial navigation, in: Autonomous Robot Vehicles,

I.J.

Cox and

G.T.

Wilfong, eds, Springer-Verlag, New York, 1990.

21.

[21]

Lee and

Kim, Robust estimation of camera homography using fuzzy RANSAC, Computational Science and Its Applications – ICCSA4705 (2007), 992–1002.

22.

[22]

D.G.

Lowe, Object recognition from local scale-invariant features, in: IEEE International Conference on Computer Vision, Vol. 2, 1999, pp. 1150–1157.

23.

[23]

Lowe, Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision60(2) (2004), 91–110.

24.

[24]

Lucas and

Kanade, An iterative technique of image registration and its application to stereo, in: IJCAI’81 Proc. of the 7th International Joint Conference on Artificial Intelligence, Vol. 2, 1981, pp. 674–679.

25.

[25]

Manduchi, Mobile vision as assistive technology for the blind: An experimental study, in: 13th International Conference on Computers Helping People with Special Needs, LNCS, Vol. 7383, Springer, Berlin, Heidelberg, 2012, pp. 9–16.

26.

[26]

Meers and

Ward, A substitute vision system for providing 3D perception and GPS navigation via electro-tactile stimulation, in: 1st International Conference on Sensing Technology, 2005, pp. 21–23.

27.

[27]

P.B.L.

Meijer, An experimental system for auditory image representations, IEEE Transactions on Biomedical Engineering39(2) (Feb. 1992), 112–121.

28.

[28]

Millonig and

Schechtner, Developping landmark based pedestrian navigation systems, Intelligent Transportation System, IEEE Transactions8 (2007), 43–49.

29.

[29]

Muja and

D.G.

Lowe, Fast approximate nearest neighbors with automatic algorithm configuration, in: VISAPP International Conference on Computer Vision Theory and Applications, 2009, pp. 331–340.

30.

[30]

S.M.

Oh,

Tariq,

B.N.

Walker and

Dellaert, Map-based priors for localization, in: Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), Sendai, Japan, Vol. 3, 2004, pp. 2179–2184.

31.

[31]

Pascolini and

S.P.

Mariotti, Global data on visual impairments 2010, in: World Health Organization, Geneva, 2012.

32.

[32]

Peng,

Peursum,

Li and

Venkatesh, A smartphone-based obstacle sensor for the visually impaired, in: Ubiquitous Intelligence and Computing, LNCS, Vol. 6406, Springer, Berlin, Heidelberg, 2010, pp. 590–604.

33.

[33]

Pradeep,

Medioni and

Weiland, Robot vision for the visually impaired, in: IEEE Computer Vision and Pattern Recognition Workshop, 2010, pp. 15–22.

34.

[34]

Rodríguez,

J.J.

Yebes,

Alcantarilla,

Bergasa,

Almazán and

Cela, Assisting the visually impaired: Obstacle detection and warning system by acoustic feedback, Sensors12(12) (2012), 17476–17496.

35.

[35]

J.M.

Saez,

Escolano and

Penalver, First steps towards stereo-based 6DOF SLAM for the visually impaired, in: IEEE Computer Vision and Pattern Recognition Workshops, Vol. 3, 2005, p. 23.

36.

[36]

J.M.

Saez and

Escolano, Stereo-based aerial obstacle detection for the visually impaired, in: Workshop on Computer Vision Applications for the Visually Impaired, Marseille, France, 2008, pp. 1–14.

37.

[37]

Shah,

Bouzit,

Youssef and

Vasquez, Evaluation of RU-netra tactile feedback navigation system for the visually impaired, in: International Workshop on Virtual Rehabilitation, 2006, pp. 72–77.

38.

[38]

Shao,

Svoboda1,

Tuytelaars and

Van Gool, HPAT indexing for fast object/scene recognition based on local appearance, in: Image and Video Retrieval,

Bakker,

Lew,

Huang,

Sebe and

Zhou, eds, LNCS, Vol. 2728, Springer, Berlin, Heidelberg, 2003, pp. 71–80.

39.

[39]

Tong and

Chang, Support vector machine active learning for image retrieval, in: Proc. of the Ninth ACM International Conference on Multimedia, 2001, pp. 107–118.

40.

[40]

Zelek,

Audette,

Balthazaar and

Dunk, A stereo-vision system for the visually impaired, Technical Report 2000-41x-1, School of Engineering, University of Guelph, Canada, 2000, pp. 1–9.

41.

[41]

Zhang and

Zhou, A k-nearest neighbor based algorithm for multilabel classification, in: IEEE International Conference on Granular Computing, Vol. 2, 2005, pp. 718–721.

ALICE: A smartphone assistant used to increase the mobility of visual impaired people

Abstract

Keywords

Get full access to this article

References