Video-based Indoor Human Gait Recognition Using Depth Imaging and Hidden Markov Model: A Smart System for Smart Home

Abstract

Smart homes that are capable of home healthcare and e-Health services are receiving much attention due to their potential for better care of the elderly and disabled in an indoor environment. Recently the Center for Sustainable Healthy Buildings at Kyung Hee University has developed a novel indoor human activity recognition methodology based on depth imaging of a user’s activities. This system utilizes Independent Component Analysis to extract spatiotemporal features from a series of depth silhouettes of various activities. To recognise the activities from the spatiotemporal features, trained Hidden Markov Models of the activities would be used. In this study, this technique has been extended to recognise human gaits (including normal and abnormal). Since this system could be of great significance for the caring of the elderly, to promote and preserve their health and independence, the gait recognition system would be considered a primary function of the smart system for smart homes. The indoor gait recognition system is trained to detect abnormal gait patterns and generate warnings. The system works in real-time and is aimed to be installed at smart homes. This paper provides the information for further development of the system for their application in the future.

Keywords

Smart home Video sensor Human activity recognition Indoor gait Depth silhouettes PCA ICA HMM

Get full access to this article

View all access options for this article.

References

Chan M. , Estève D. , Escriba C. , Campo E. : A review of smart homes-present state and future challenges: Comput Methods Programs Biomed 2008;91(1):55-81.

Elger G. , Furugren B. : ‘‘SmartBO’’ - An ICT and computer based demonstration home for disabled, in improving the quality of life for the European citizen : Technology for Inclusive Design and Equality Assistive Technology Research Series 1998;4:392-395.

Chan M. , Campo E. , Estève D. : PROSAFE, a multisensory remote monitoring system for the elderly or the handicapped in Independent Living for Persons with Disabilities and Elderly People: in Proceedings of the 1st International Conference on Smart Homes and Health Telematics, 1-6 January, Melbourne, 2003, pp. 89-95.

Kidd CD , Orr RJ , Abowd GD , Atkeson CG , Essa IA , MacIntyre B. , Mynatt E. , Starner TE , Newstetter W. : The aware home: a living laboratory for ubiquitous computing research : in Proceedings of 2nd International Workshop on Cooperative buildings, 1-2 October, Pittsburg, 1999 , pp. 191-198.

Skubic M. , Alexander G. , Popescu M. , Rantz M. , Keller J. : A smart home application to eldercare: Current status and lessons learned : Technol Health Care 2009;17(3):183-201.

Niu F. , Abdel-Mottaleb M. : View-invariant human activity recognition based on shape and motion features , In: Proceedings of the IEEE Sixth International Symposium on Multimedia Software Engineering, 13-15 December, Miami, FL, 2004, pp. 546-556.

Niu F. , Abdel-Mottaleb M. : HMM-based segmentation and recognition of human activities from video sequences : in Proceedings of IEEE International Conference on Multimedia & Expo, 6-9 July, Amsterdam , 2005, pp. 804-807. 8 Uddin MZ , Lee JJ , Kim TS : Independent shape component-based human activity recognition via hidden markov model: Appl Intell 2008;33(2):193-206.

Uddin MZ , Truc PTH , Lee JJ , Kim TS : Human activity recognition using independent component features from depth images: in Proceedings of the 5th International Conference on Ubiquitous Healthcare, Busan, Republic of Korea, 2008, pp. 181-183.

Muñoz-Salinas R. , Medina-Carnicer R. , Madrid-Cuevas FJ , Carmona-Poyato A. : Depth silhouettes for gesture recognition: Pattern Recogn Lett 2008;29(3):319-329.

10.

Center for Sustainable Healthy Buildings (CSHeB): Available at: http://www.csheb.org (accessed February 5, 2009).

11.

Nikolaos VB , Zhiwei XC : Human gait recognition based on matching of body components: Pattern Recogn 2006;40(6):1763-1770.

12.

Linde Y. , Buzo A. , Gray R. : An algorithm for vector quantizer design: IEEE Trans Commun 1980;28(1):84-94.

13.

Iwai Y. , Hata T. , Yachida M. : Gesture recognition based on subspace method and hidden markov model : in Proceedings of the IEEE/ RSJ International Conference on Intelligent Robots and Systems, 7-11 September, Grenoble , France, 1997, pp. 960-966.