Embodied conversational agents (ECA) are possible enablers of assistive technologies, in particular for older adults with cognitive impairment. Yet, dedicated interaction management techniques addressing the specificities of this public are needed.
OBJECTIVES:
We assess whether the interaction management framework of the LOUISE (Lovely User Interface for Servicing Elders) ECA has the potential to overcome the user interface constraints linked to cognitive impairment.
METHODS:
LOUISE supports key target-specific features: personalization; attention management; context reminders; image and video displays; a conversation manager for task-oriented interactions; and the foundations for a domain-specific XML-based language for task-oriented assistive scenarios. LOUISE’s usability and acceptance were evaluated at the Broca geriatric hospital in Paris. with a group of 14 older adults with either mild cognitive impairment (MCI) or Alzheimer’s disease (AD) through four simple but realistic assistive scenarios: drinking, taking medicine, measuring blood pressure and choosing the lunch menu.
RESULTS:
Most of our participants were able to interact with the ECA, succeeded in completing the proposed tasks and enjoyed our design.
CONCLUSION:
The field usability evaluation of LOUISE’s interaction management framework suggests that this suite of interaction techniques can be effective in enabling interfaces for users with MCI or AD.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5). American Psychiatric Pub; 2013.
2.
World Health Organization, Alzheimer’s Disease International. Dementia: a public health priority; 2012.
3.
DavisFD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly.1989; p. 319-340.
4.
ChenKChanA. A review of technology acceptance by older adults. Gerontechnology.2011; 10(1): 1-12.
5.
MorandellMHochgattererAFagelSWassertheurerS. Avatars in Assistive Homes for the Elderly: A User-Friendly Way of Interaction? HCI and Usability for Education and Work.2008; p. 391-402.
6.
CarrascoEEpeldeGMorenoAOrtizAGarciaIBuizaC, et al. Natural Interaction between Avatars and Persons with Alzheimer’s Disease. In: MiesenbergerKKlausJZaglerWKarshmerA, editors. Computers Helping People with Special Needs. Springer Berlin Heidelberg; 2008; p. 38-45.
7.
HuangHHMatsushitaHKawagoeKSakaiYNonakaYNakanoY, et al. Toward a memory assistant companion for the individuals with mild memory impairment. In: Cognitive Informatics & Cognitive Computing (ICCI* CC), 2012; IEEE 11th International Conference on. IEEE; 2012. p. 295-299.
8.
YaghoubzadehRKramerMPitschKKoppS. Virtual Agents as Daily Assistants for Elderly or Cognitively Impaired People. In: AylettRKrennBPelachaudCShimodairaH, editors. Intelligent Virtual Agents. Springer Berlin Heidelberg; 2013; p. 79-91.
9.
YasudaKAoeJIFuketaM. Development of an Agent System for Conversing with Individuals with Dementia. In: The 27th Annual Conference of the Japanese Society for Artificial Intelligence; 2013.
10.
ChittaroLIeronuttiLRiguttiS. Supporting presentation techniques based on virtual humans in educational virtual worlds. In: Cyberworlds, 2005 International Conference on. IEEE; 2005. p. 8.
11.
OrtizAdel Puy CarreteroMOyarzunDYanguasJJBuizaCGonzalezMF, et al. Elderly Users in Ambient Intelligence: Does an Avatar Improve the Interaction? In: StephanidisCPieperM, editors. Universal Access in Ambient Intelligence Environments. No. 4397 in Lecture Notes in Computer Science. Springer Berlin Heidelberg; 2007. p. 99-114.
12.
BickmoreTSchulmanDYinL. Maintaining engagement in long-term interventions with relational agents. Applied Artificial Intelligence.2010; 24(6): 648-666.
13.
BickmoreTWSillimanRANelsonKChengDMWinterMHenaultL, et al. A Randomized Controlled Trial of an Automated Exercise Coach for Older Adults. Journal of the American Geriatrics Society.2013; 61(10): 1676-1683.
14.
VardoulakisLPRingLBarryBSidnerCLBickmoreT. Designing Relational Agents as Long Term Social Companions for Older Adults. In: NakanoYNeffMPaivaAWalkerM, editors. Intelligent Virtual Agents. No. 7502 in Lecture Notes in Computer Science. Springer Berlin Heidelberg; 2012. 289-302.
15.
RingLBarryBTotzkeKBickmoreT. Addressing loneliness and isolation in older adults: Proactive affective agents provide better support. In: Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on. IEEE; 2013. p. 61-66.
16.
ZancanaroMGabrielliSJamesonALeonardiCNotEPianesiF. Virtual helper or virtual card player? Contrasting responses of older users. In: Your Virtual Butler. Springer; 2013; p. 70-78.
17.
FagelSHilbertAMorMMayerC. The Virtual Counselor Automated Character Animation for Ambient Assisted Living. In: Proceedings of 6th International Conference on Advances in Computer-Human Interactions (ACHI’13). IARIA; 2013. p. 184-187.
18.
MaidenND’SouzaSJonesSMüllerLPanneseLPittsK, et al. Computing technologies for reflective, creative care of people with dementia. Communications of the ACM.2013; 56(11): 60-67.
19.
KelleyJF. An Iterative Design Methodology for User-friendly Natural Language Office Information Applications. ACM Transactions on Information Systems.1984 Jan; 2(1): 26-41.
20.
MorandellMMHochgattererAWöcklBDittenbergerSFagelS. Avatars@Home InterFACEing, The Smart Home for Elderly People. In: HolzingerAMiesenbergerK, editors. HCI and Usability for e-Inclusion. No. 5889 in Lecture Notes in Computer Science. Springer Berlin Heidelberg; 2009. p. 353-365.
21.
YaghoubzadehRPitschKKoppS. Adaptive grounding and dialogue management for autonomous conversational assistants for elderly users. In: Intelligent Virtual Agents. Springer; 2015; p. 28-38.
22.
HankeSSandnerEKadyrovSStainer-HochgattererA. Daily life support at home through a virtual support partner. In: 2nd IET International Conference on Technologies for Active and Assisted Living (TechAAL 2016); 2016. p. 1-7.
23.
AlmNAstellAGowansGEllisMDyeRVaughanP, et al. Cognitive Prostheses: Findings from Attempts to Model Some Aspects of Cognition. In: KurosuM, editor. Human Centered Design. No. 6776 in Lecture Notes in Computer Science. Springer Berlin Heidelberg; 2011. p. 275-284.
24.
VichitvanichphongSTalaei-KhoeiAKerrDGhapanchiAH. Adoption of Assistive Technologies for Aged Care: A realist review of recent studies. In: System Sciences (HICSS), 2014 47th Hawaii International Conference on. IEEE; 2014. p. 2706-2715.
25.
SanfordJA. Universal design as a rehabilitation strategy: design for the ages. Springer Publishing Company; 2012.
26.
CookAMPolgarJM. Assistive technologies: Principles and practice. Elsevier Health Sciences; 2014.
27.
BogerJPoupartPHoeyJBoutilierCFernieGMihailidisA. A decision-theoretic approach to task assistance for persons with dementia. In: Proceedings of the 19th international joint conference on Artificial intelligence. Morgan Kaufmann Publishers Inc.; 2005. p. 1293-1299.
28.
HoeyJPoupartPvon BertoldiACraigTBoutilierCMihailidisA. Automated handwashing assistance for persons with dementia using video and a partially observable Markov decision process. Computer Vision and Image Understanding.2010; 114(5): 503-519.
29.
CzarnuchSMihailidisA. The COACH: A real-world efficacy study. Alzheimer’s & Dementia.2012; 8(4): P446.
30.
HamadaTKuwaharaNMorimotoKYasudaKAkiraUAbeS. Preliminary Study on Remote Assistance for People with Dementia at Home by Using Multi-media Contents. In: StephanidisC, editor. Universal Access in Human-Computer Interaction. Addressing Diversity: 5th International Conference, UAHCI 2009, Held as Part of HCI International 2009, San Diego, CA, USA, July 19–24, 2009. Proceedings, Part I. Berlin, Heidelberg: Springer Berlin Heidelberg; 2009. p. 236-244. from: http//dx.doi.org/10.1007/978-3-642-02707-9_26.
31.
PetersCHermannTWachsmuthSHoeyJ. Automatic task assistance for people with cognitive disabilities in brushing teeth – A user study with the TEBRA system. ACM Transactions on Accessible Computing (TACCESS).2014; 5(4): 10.
32.
PollackME. Intelligent technology for an aging population: The use of AI to assist elders with cognitive impairment. AI Magazine.2005; 26(2): 9.
33.
LoprestiEFBodineCLewisC. Assistive technology for cognition [Understanding the Needs of Persons with Disabilities]. IEEE Engineering in Medicine and Biology Magazine.2008; 27(2): 29-39.
34.
CarmienS. Assistive Technology Design for Intelligence Augmentation. Morgan & Claypool Publishers; 2016.
35.
KoppSKrennBMarsellaSMarshallANPelachaudCPirkerH, et al. Towards a Common Framework for Multimodal Generation: The Behavior Markup Language. In: GratchJYoungMAylettRBallinDOlivierP, editors. Intelligent Virtual Agents. No. 4133 in Lecture Notes in Computer Science. Springer Berlin Heidelberg; 2006. p. 205-217.
36.
SchererSMarsellaSStratouGXuYMorbiniFEganA, et al. Perception Markup Language Towards a Standardized Representation of Perceived Nonverbal Behaviors In: NakanoYNeffMPaivaAWalkerM, editors. Intelligent Virtual Agents. No. 7502 in Lecture Notes in Computer Science. Springer Berlin Heidelberg; 2012. p. 455-463.
37.
BenkaouarWVaufreydazD. Multi-sensors engagement detection with a robot companion in a home environment. In: Workshop on Assistance and Service robotics in a human environment at IEEE International Conference on Intelligent Robots and System (IROS2012); 2012. p. 45-52. from: http//hal.inria.fr/hal-00735150/.
38.
LiLXuQTanYK. Attention-based Addressee Selection for Service and Social Robots to Interact with Multiple Persons. In: Proceedings of the Workshop at SIGGRAPH Asia. WASA’12 New York, NY, USA: ACM; 2012. p. 131-136.
39.
StrickerRHommelSMartinCGrossHM. Realtime User Attention and Emotion Estimation on a Mobile Robot. In: Proceedings of 55th Ilmenau International Scientific Colloquium; 2010. p. 13-17.
40.
WargnierPMalaiséAJacquemotJBenvenisteSJouvelotPPinoM, et al. Towards attention monitoring of older adults with cognitive impairment during interaction with an embodied conversational agent. In: 3rd IEEE VR International Workshop on Virtual and Augmented Assistive Technology (VAAT); 2015. p. 23-28|.
41.
WargnierPCarlettiGLaurent-CorniquetYBenvenisteSJouvelotPRigaudAS. Field Evaluation with Cognitively-Impaired Older Adults of Attention Management in the Embodied Conversational Agent Louise. In: 4th IEEE International Conference on Serious Games and Applications for Health (SeGAH); 2016.
42.
WargnierP. Virtual human technologies for cognitively-impaired older adults’ care: the LOUISE and Virtual Promenade experiments. Paris Sciences et Lettres Research University;2017; [online] available at https//pastel.archives-ouvertes.fr/tel-01531137.
43.
ThiebauxMMarsellaSMarshallANKallmannM. SmartBody: Behavior Realization for Embodied Conversational Agents. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems. vol. 1 of AAMAS ’08. International Foundation for Autonomous Agents and Multiagent Systems; 2008. p. 151-158.
44.
ZajicekM. A methodology for interface design for older adults. In: Enterprise Information Systems Vi. Springer; 2006. p. 285-292.
45.
PejsaTAndristSGleicherMMutluB. Gaze and Attention Management for Embodied Conversational Agents. ACM Transactions on Interactive Intelligent Systems (TiiS).2015; 5(1): 3.
46.
RichCPonslerBHolroydASidnerCL. Recognizing engagement in human-robot interaction. In: Human-Robot Interaction (HRI), 2010 5th ACM/IEEE International Conference on. IEEE; 2010. p. 375-382.
47.
HeerinkMKröseBEversVWielingaB. Assessing acceptance of assistive social agent technology by older adults: the Almere model. International Journal of Social Robotics.2010; 2(4): 361-375.
48.
MacefieldR. How to Specify the Participant Group Size for Usability Studies: A Practitioner’s Guide. J Usability Studies.2009; Nov; 5(1): 34-45. from: http//dl.acm.org/citation.cfm?id=2835425.2835429.
49.
PetersenRC. Mild cognitive impairment as a diagnostic entity. Journal of Internal Medicine.2004; 256(3): 183-194.
50.
YoungVMihailidisA. Difficulties in automatic speech recognition of dysarthric speakers and implications for speech-based applications used by the elderly: A literature review. Assistive Technology.2010; 22(2): 99-112.
51.
AmanFVacherMRossatoSPortetF. Speech recognition of aged voice in the AAL context: Detection of distress sentences. In: Speech Technology and Human-Computer Dialogue (SpeD), 2013 7th Conference on. IEEE; 2013. p. 1-8.
52.
CarlettiG. Linguistic anthropology PhD thesis; 2018 (to appear).
