Sage Journals: Discover world-class research

Abstract

We describe case studies of clinically significant changes in sedentary behavior of older adults captured with a novel computer vision algorithm for depth data. An unobtrusive Microsoft Kinect sensor continuously recorded older adults’ activity in the primary living spaces of TigerPlace apartments. Using the depth data from a period of ten months, we develop a context aware algorithm to detect person-specific postural changes (sit-to-stand and stand-to-sit events) that define sedentary behavior. The robustness of our algorithm was validated over 33,120 minutes of data for 5 residents against manual analysis of raw depth data as the ground truth, with a strong correlation ( $r = 0.937$ , $p < 0.001$ ) and mean error of 17 minutes/day. Our findings are highlighted in two case studies of sedentary activity and its relationship to clinical assessments of functional decline. Our findings show strong potential for future research towards a generalizable platform to automatically study sedentary behavior patterns with an in-home activity monitoring system.

Keywords

Activity recognition depth images Gerontechnology Kinect sensor sit-to-stand analysis

Get full access to this article

View all access options for this article.

References

Atkin,

Gorely,

S.A.

Clemes,

Yates,

Edwardson,

Brage,

Salmon,

S.J.

Marshall and

S.J.H.

Biddle, Methods of measurement in epidemiology: Sedentary behavior, Int. J. Epidemiol. 41(5) (2012), 1460–1471. doi:10.1093/ije/dys118.

Baker,

Roth,

Scharstein,

Black,

Lewis and

Szeliski, A database and evaluation methodology for optical flow, in: Proc. IEEE International Conference in Computer Vision, 2007.

Banerjee,

J.M.

Keller and

Skubic, Detecting foreground disambiguation of depth images using fuzzy logic, in: Proceedings, IEEE International Conference on Fuzzy Systems, Hyderabad, India, 2013, pp. 7–10.

Banerjee,

J.M.

Keller,

Skubic and

Stone, Day or night activity recognition from video using fuzzy clustering techniques, Fuzzy Systems, IEEE Transactions on 22(3) (2014), 483–493. doi:10.1109/TFUZZ.2013.2260756.

Bezdek,

Ehrlich and

Full, FCM: The fuzzy c-means clustering algorithm, Comput. Geosci. 10(2) (1984), 191–203. doi:10.1016/0098-3004(84)90020-7.

J.M.

Bland and

D.G.

Altman, Measuring agreement in method comparison studies, Statistical Methods in Medical Research 8(2) (1999), 135–160. doi:10.1191/096228099673819272.

Bruhn ,

Weickert and

Schnorr, Lucas/Kanade meets Horn/Schunk: Combining local and global optical flow methods, International Journal of Computer Vision (IJCV) 61(3) (2005), 211–231. doi:10.1023/B:VISI.0000045324.43199.43.

J.B.J.

Bussmann and

R.J.G.

van den Berg-Emons, To total amount of activity and beyond: Perspectives on measuring physical behavior, Front. Psychol. 4 (2013), 463.

Centers for Disease Control and Prevention, Residents Living in Residential Care Facilities: United States, 2010. 2012. Available at http://www.cdc.gov/nchs/data/databriefs/db91.htm#definitions.

10.

Clark ,

S.P.

Azen,

Carlson,

Mandel,

LaBree,

Hay,

Zemke,

Jackson and

Lipson, Embedding health promoting changes into the daily lives of independent-living older adults, The Journals of Gerontology Series B, Psychology Sciences and Social Science 56 (2001), 60–63. doi:10.1093/geronb/56.1.P60.

11.

D.E.

Conroy,

J.P.

Maher,

Elavsky,

A.L.

Hyde and

S.E.

Doerksen, Sedentary behavior as a daily process regulated by habits and intentions, Health Psychology. 32(11) (2013), 1149–1157. doi:10.1037/a0031629.

12.

P.E.

Cuddihy,

Yardibi,

Z.J.

Legenzoff,

Liu,

C.E.

Phillips,

Abbott,

Galambos,

J.M.

Keller,

Popescu,

Back,

Skubic and

M.J.

Rantz, Radar walking speed measurements of seniors in their apartments: Technology for fall prevention, in: Proceedings, 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, August 28–September 1, 2012, pp. 260–263.

13.

Demiris,

Skubic,

Rantz,

Keller,

Aud,

Hensel and

He, Smart home sensors for the elderly: A model for participatory formative evaluation, in: Proceedings, IEEE EMBS Intl. Special Topic Conf. on Information Technology in Biomedicine, 2006, pp. 1–4.

14.

Dunlop,

Song,

Arnston,

Semanik,

Lee,

Chang and

J.M.

Hootman, Sedentary time in U.S. older adults associated with disability in activities of daily living independent of physical activity, Journal of Physical Activity & Health 12(1) (2014), 93–101. doi:10.1123/jpah.2013-0311.

15.

Dziuda,

F.W.

Skibniewski,

Krej and

Lewandowski, Monitoring respiration and cardiac activity using fiber bragg grating-based sensor, IEEE Trans. Biomed. Eng. 59(7) (2012), 1934–1942. doi:10.1109/TBME.2012.2194145.

16.

K.R.

Evenson,

D.M.

Buchner and

K.B.

Morland, Objective measurement of physical activity and sedentary behavior among US adults aged 60 years or older, Prev Chronic Dis 9 (2012), 110–119.

17.

Galambos ,

Skubic,

Wang and

Rantz, Management of dementia and depression utilizing in-home passive sensor data, Gerontechnology 11(3) (2013), 457–468. doi:10.4017/gt.2013.11.3.004.00.

18.

Gorman,

H.M.

Hanson,

P.H.

Yang,

K.M.

Khan,

Liu-Ambrose and

M.C.

Ashe, Accelerometry analysis of physical activity and sedentary behavior in older adults: A systematic review and data analysis, Eur Rev Aging Phys. Act 11 (2014), 35–49. doi:10.1007/s11556-013-0132-x.

19.

Hajihashemi,

Yefimova and

Popescu, Detecting daily routines of older adults using sensor time series clustering, in: Proceedings in the 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, 2014, pp. 26–30.

20.

Hajihashemi,

Yefimova and

21.

Heise ,

Rosales,

Sheahen,

B.Y.

Su and

Skubic, Non-invasive measurement of heartbeat with a hydraulic bed sensor: Progress, challenges, and opportunities, in: Proceedings, 2013 IEEE International Instrumentation & Measurement Technical Conference, Minneapolis, MN, May 6–9, 2013, 2013, pp. 4356–4360.

22.

Heise,

Rosales,

Sheahen,

B.Y.

Su and

23.

Hinterstoisser,

Holzer,

Cagniart,

Ilic,

Konolige,

Navab and

Lepetit, Multimodal templates for real-time detection of texture-less objects in heavily cluttered scenes, in: Proc. IEEE International Conference in Computer Vision, 2011.

24.

C.L.

Kemp, Negotiating transitions in later life: Married couples in assisted living, Journal of Applied Gerontology 27 (2008), 231–251. doi:10.1177/0733464807311656.

25.

M.P.

Lawton, Residential environment and self-directedness among older people, Am. Psychol. 45(5) (1990), 638–640. doi:10.1037/0003-066X.45.5.638.

26.

Li,

Banerjee,

Popescu and

Skubic, Improvement of acoustic fall detection using kinect depth sensing, in: Proceedings, IEEE 2013 International Conference of the Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, July 3–7, 2013.

27.

Mahnot and

Popescu, FUMIL-fuzzy multiple instance learning for early illness recognition in older adults, in: Proceedings, IEEE World Congress on Computational Intelligence (IEEE WCCI), Brisbane, Australia, June 10–15, 2012, pp. 2102–2106.

28.

Microsoft Developer Network, Kinect Skeletal Tracking. Available at http://msdn.microsoft.com/en-us/library/hh973074.aspx.

29.

Mitty, An assisted living community environment the optimizes function: Housing enabler assessment, Geriatric Nursing 31(6) (2010), 448–451.

30.

T.H.

Monk,

D.J.

Buysse,

Hall,

E.A.

Nofzinger,

W.K.

Thompson,

S.A.

Mazumdar and

C.F.

Reynolds, Age-related differences in the lifestyle regularity of seniors experiencing bereavement, care giving, insomnia, and advancement into old-old age, Chronobiol Int 23(4) (2006), 831–841. doi:10.1080/07420520600827152.

31.

Monkaresi,

R.A.

Calvo and

Yan, A machine learning approach to improve contactless heart rate monitoring using a webcam, IEEE J. Biomed. Health Inform. 18(4) (2014), 1153–1160. doi:10.1109/JBHI.2013.2291900.

32.

Owen,

Sugiyama,

E.E.

Eakin,

Gardiner,

M.S.

Tremblay and

J.F.

Sallis, Adults’ sedentary behavior determinants and interventions, Am. J. Prev. Med. 41(2) (2011), 189–196. doi:10.1016/j.amepre.2011.05.013.

33.

Podsiadlo and

Richardson, The timed “Up & Go”: A test of basic functional mobility for frail elderly persons, J Am Geriatr Soc 39 (1991), 142–148. doi:10.1111/j.1532-5415.1991.tb01616.x.

34.

M.J.

Rantz,

Skubic,

R.J.

Koopman,

Phillips,

G.L.

Alexander,

S.J.

Miller and

R.D.

Guevara, Using sensor networks to detect urinary tract infections in older adults, in: Proceedings in IEEE 13th International Conference on E-Health Networking, Applications and Services, 2011, pp. 142–149.

35.

M.J.

Rantz,

Skubic,

S.J.

Miller,

Galambos,

Alexander,

Keller and

Popescu, Sensor technology to support aging in place, Journal of the American Medical Directors Association 14(6) (2013), 386–391. doi:10.1016/j.jamda.2013.02.018.

36.

Rougier ,

Auvinet,

Rousseau,

Mignotte and

Meunier, Fall detection from depth map video sequences, in: Proc. ICOST, 2011, pp. 121–128.

37.

Savitzky and

M.J.E.

Golay, Smoothing and differentiation of data by simplified least squares procedures, Analytical Chemistry 36 (1964), 1627–1639. doi:10.1021/ac60214a047.

38.

Skubic,

Alexander and

Popescu, A smart home application to eldercare: Current status and lessons learned, Technol. Heal. Care 17(3) (2009), 183–201.

39.

Stone and

Skubic, Unobtrusive, continuous, in-HomeGait measurement using the microsoft kinect, IEEE Transactions on Biomedical Engineering 60(10) (2013), 2925–2932. doi:10.1109/TBME.2013.2266341.

40.

Taraldsen,

S.F.M.

Chastin,

I.I.

Riphagen,

Vereijken and

J.L.

Helbostad, Physical activity monitoring by use of accelerometer-based body-worn sensors in older adults: A systematic literature review of current knowledge and applications, Maturitas 71(1) (2012), 13–19. doi:10.1016/j.maturitas.2011.11.003.

41.

Thibaud,

Bloch,

Tournoux-Facon,

Brèque,

A.S.

Rigaud,

Dugué and

Kemoun, Impact of physical activity and sedentary behavior on fall risks in older people: A systematic review and meta-analysis of observational studies, Eur. Rev. Aging Phys. Act. 9(1) (2011), 5–15. doi:10.1007/s11556-011-0081-1.

42.

Tomasi and

Manduchi, Bilateral filtering for gray and color images, in: Proc. IEEE International Conference in Computer Vision, 1998, pp. 839–846.

43.

Wang,

Skubic and

Zhu, Activity density map visualization and dissimilarity comparison for eldercare monitoring, IEEE Trans. Inf. Technol. Biomed. 16(4) (2012), 607–614. doi:10.1109/TITB.2012.2196439.

44.

Xu,

Li,

M.-C.

Huang,

Amini and

Sarrafzadeh, Ecushion: An etextile device for sitting posture monitoring, in: Body Sensor Networks (BSN), 2011, pp. 194–199.

45.

Yin, Case Study Research: Design and Methods, 3rd edn, Thousand Oaks, CA, Sage, 2003.

46.

Zisberg,

Zysberg,

H.M.

Young and

K.G.

Schepp, Trait routinization, functional and cognitive status in older adults, The International Journal of Aging and Human Development 69(1) (2009), 17–29. doi:10.2190/AG.69.1.b.

Exploratory analysis of older adults’ sedentary behavior in the primary living area using kinect depth data

Abstract

Keywords

Get full access to this article

References