Abstract
Tailoring assistive systems for guiding and monitoring an individual in daily living activities is a complex task. This paper presents ALI, an assistive system combining a formal possibilistic argumentation system and an informal model of human activity: the Cultural-Historic Activity Theory, facilitating the delivery of tailored advices to a human actor. We follow an activity-centric approach, taking into consideration the human’s motives, goals and prioritized actions. ALI tracks a person in order to I) determine what activities were performed over a period of time (activity recognition tracking), and II) send personalized notifications suggesting the most suitable activities to perform (decision-making monitoring). The ALI system was evaluated in a formative pilot study related to promote social activities and physical exercise.
Keywords
Introduction
Providing tailored and appropriate guidance or recommendations to individuals with the purpose of improving their performance of daily living activities is a complex task. One of the major challenges is motivating an individual to change their behavior to a healthier lifestyle pattern, as is evidenced in numerous approaches [47,50,58].
Different methods have been developed for building behavior change and persuasive systems in order to influence a person’s performance of activity. A number of authors in the Artificial Intelligence (AI) and Computer Science fields have used psychological cues of persuasion, considering different information sources such as human-centric (
Against this background, we introduce an
We summarize the main contributions of this research as follows:
A formal integration between an argument-based possibilistic decision-making framework and CHAT in order to recognize, argue, justify and provide argumentative explanations for human activities.
Argument extensions are interpreted based on CHAT for selecting and formulating messages.
A real time activity-support system that collects uncertain and incomplete observations of the human’s context and implements 1) and 2).
A system evaluated in a formative pilot study, which provided results concerning how increasing the persuasiveness of the application.
The rest of the paper is divided as follows. In Section 2 the methods used in our approach are introduced. In Section 3, results regarding our integration between a Social Science approach and an argumentation-based decision-making framework are presented. In Section 4 we present a novel approach for constructing messages from structured arguments. Section 5 presents the prototype architecture of ALI; in Section 6, a pilot study of ALI is introduced. In Section 7 we compare our approach with different literature discussing our contributions and limitations. In Section 8 conclusions are provided, in addition to future work. In Appendix A the syntax and semantics of the formal language capturing complex activities is described. Appendix B presents the formal description of a possibilistic decision-making framework [56] used in capturing complex activities is described. Appendix B presents a formal description of possibilistic logic programs [56] used in our approach.
Methods and instruments
In this section we introduce theories used in our approach.
Theories about human activity and user scenario
Cultural-Historical Activity Theory (CHAT) offers a philosophical and cross-disciplinary perspective for analyzing diverse human practices as development processes in which both individual and social levels are interlinked [35]. With its recent emphasis on Information Systems, CHAT helps in exploring and understanding interactions in their social context, multiple contexts and cultures, and the dynamics and development of particular activities. In order to represent and model information about human activities we therefore use CHAT.
CHAT is suitable to describe the dynamics of goal-based human activities such as, “maintain physical condition”, which requires the achievement of different goals e.g., “exercise during the week”, “eat healthy”, “ride a bike instead of use a car”, etc. CHAT considers an activity as a hierarchy of goal-oriented activities and sub-activities [44]. Consequently, an hierarchy if goals and sub-goals can be formed (see Fig. 1). Each action at the lowest level, consists of a set of operations, which are not goal-oriented in the perspective of CHAT. We are interested in generating observations of these operations as shown in Fig. 1. This figure describes the so called human
The structure of a complex activity is dynamic [38], e.g., driving a car, can be an activity for a person, but for experienced driver it can be a goal, with the car driving as one of actions to fulfill an activity.

Representation of a hierarchical goal-based activity using CHAT.
The role of our AT system ALI is 1) to monitor a person’s goal-based activity, and 2) deliver encouraging messages, which may have the potential to affect the person’s activity behavior. A running example describing how we use CHAT to capture an activity is presented as follows:
Kim is a young adult. A therapist has reason to meet Kim, and discuss her situation. Kim would like to see some changes in her everyday life, which the therapist supports. Generic patterns of behavior, which can be seen as potentially “unhealthy”, are identified and focused on, such as Kim’s tendency to avoid leaving the house and getting stuck by the computer without much physical exercise.
In this scenario, Kim and her therapist agreed that
A scheme representing the hierarchical goal-based activity is presented in Fig. 2.

Kim scenario, based on CHAT.
The ACKTUS platform (Activity-Centered Modeling of Knowledge and Interaction Tailored to Users) [46] was developed for enabling health professionals model domain knowledge to be used in knowledge-based applications, and design the interaction content and flow for supporting different types of activities (e.g., diagnosis, risk assessment, support for conducting Activities of Daily Living (ADL)) [45]. ACKTUS contains a number of knowledge-bases, assessment applications and dedicated user interfaces for different knowledge domains. In this work, ACKTUS is used for the following purposes: 1) as an instrument for assessing a user’s health status, preferred activities, preferences and goals, through the ACKTUS application
User study
A pilot evaluation study of ALI was conducted as a part of a broader study presented in [47]. The study addresses the following research questions: 1) how does information about the context, preferences and personalized suggestions contribute to building arguments?; 2) how is the human–computer interaction performed through a mobile phone?; and 3) how does the user react to positive and encouraging messages? These questions are partially answered, based on the analyses of data obtained by ALI and ACKTUS I-Help and through interviews with the test subjects. The study was formative, aiming to provide results which can be fed into the ongoing development of ALI. The evaluation study focused on the analysis of location and locomotion features obtained from the mobile phone of an individual and building arguments supported by knowledge obtained from the ACKTUS repositories.
Whether or not the behavior of an individual actually changes when personalized suggestions are received through the ALI system is a subject for future work.
Methods, participants and procedure
In this paper, we focus on the decreasing well-being among young individuals between the ages of 18 and 24 years old. The two subjects who volunteered to participate in our study were not necessarily suffering from any of these conditions. The test subjects were informed about the purpose of the study and gave informed consent.
The two female adolescents were first interviewed by a therapist who made an initial assessment, in which priorities and goals were identified. The initial assessment was performed using the ACKTUS application I-Help, through which data was captured and stored in an actor repository. This information about the two test subjects was retrieved by ALI and functioned as the source for person-specific information such as preferred goals and prioritized activities. Subject A and Subject B prioritized physical activity as the main activity to be supported, in order to achieve a healthy and regular activity pattern over day and night.
Subjects were also asked to formulate personalized recommendations, or arguments, which they preferred to be given, and under what conditions they should be presented, which were added to their actor repositories. This was in accordance with the purpose of the messages in ALI, in which positive and encouraging feedback messages follow an approach to coping with depression and anxiety, using an introspective natural dialogue (creating messages to oneself), which has been shown to be an important determinant of physical activity in youth [8,74]. In this manner, the personalized view represents a trusted source for recommendations, since listening to or reading recommendations from another source or person requires confidence and trust.
The two subjects agreed to carry a smart-phone over a period of one week. They agreed to carry the phone throughout all activities and were explained what kind of data would be collected. Over the evaluation period, the two subjects were asked to try to maintain the phone switched on both day and night.
An argumentation-based possibilistic decision-making framework integrating CHAT
Formal argumentation is concerned primarily with reaching conclusions through logical reasoning, that is, claims based on premises. In the past few years, formal models of argumentation have been steadily gaining importance in artificial intelligence, where they have found a wide range of applications in specifying semantics for logic programs, decision-making, generating natural language text and supporting multi-agent dialogue, among others.
Dung made an important contribution to the research field of argumentation in [21] by showing that argumentation can be “viewed” as Logic Programming (LP). Dung provided a meta-schema of such systems, defining a general architecture for meta-interpreters for argumentation systems.
Extending Dung’s approach, we can represent an argumentation system as a “three-step” system, starting with a knowledge base and obtaining argument-based conclusions as output (Fig. 3). This chain resembles an inference process, starting with

Meta-interpreter for an argumentation system.
The scenario about Kim introduced in Example 1 presents a decision-making process, which deals with uncertainty. ALI has to make argument-based decisions based on Kim’s preferred goals by obtaining sets of possible worlds (or interpretations) of her context. Different approaches based on argumentation theory have been developed dealing with the different forms of information for justifying/explaining rational decisions. A number of approaches based on Logical Argumentation, formalizing argument-based decision-making under uncertainty [41,60] and Possibilistic Logic [1,4,56] have been proposed.
In fact, in common life scenarios, descriptions of uncertain observations such as “I think that…”, “chances are…”, or like “it seems like…” usually appeal to our experience or our common sense. A possibilistic logic framework based on possibility theory can be used to model these pieces of knowledge, which are pervaded with uncertainty (like in the Kim scenario). Such framework is also useful when representing preferences expressed as sets of prioritized goals [20]. We argue that a possibilistic logic framework is suitable for representing the exemplified scenario.
In the logic programming literature, different logic programming semantics exist, which capture possibilistic logic programs in order to infer information from a given possibilistic logic program [55,59]. Given that ALI is expected to support processes like decision-making and recommendations in real time, In Appendix B a definition of the Possibilistic Argument-based Decision Framework is introduced.
A PADF is a tuple a knowledge base which is defined by a possibilistic normal logic program a set of decisions a set of goals
where
Kim agrees with therapists to use ALI to monitor her physical activity patterns. ALI is set up on her mobile phone. In this setting, ALI obtains a register of her location and locomotion activities over a period of time. More details about how location and locomotion observations are obtained is described in Section 5.

Sub-scenario for giving Kim encouraging advice.
Following the Kim scenario, and following its representation in Fig. 2, we obtain an alternative sub-scenario, for example, encouraging Kim to do exercise, as described in the sub-scenario depicted in Fig. 4 where ALI observes that Kim
Since the information obtained from the mobile sensors is pervaded by vagueness, each piece of knowledge will be attached to
Possibilistic decision-making framework
In Table 1, the set of 18 rules of
By using a PADF framework, The
The argument definition (1) is illustrated by using the sub-scenario introduced in Fig. 4. In this case,
In order to illustrate the process of argument construction, 44 arguments were obtained from
Arguments subset of an extension in the Kim Scenario
Once the arguments are constructed, we compare the strengths of those arguments. In this setting, one can identify two types of disagreement between arguments, which are usually called
In other words, we can say that
The attack relationships among the set of arguments obtained from the possibilistic decision-making framework (Table 1) were identified using the WizArg tool [30]. The attack relationships are presented in Fig. 5, where each argument is represented by a node and each attack relation is represented by an edge.

Argument attack relationships display using
Dung [21] defined the so called
Given an AF, one can look for subsets of arguments, which suggest coherent points of views from the disagreements among the arguments. The selection pattern of arguments is usually supported by the so called
A basic argumentation semantics
In order to compute Dung’s argumentation semantics in ALI, we use the
In the Kim scenario, these nine extensions represent sets of justified and conflict-free arguments, which will be used in integrating assessment information obtained by the therapist.
We are interested in representing extensions and their arguments in terms of goals, which in our scenario are already defined by Kim and her therapist. As a consequence, let us consider that given an argumentation framework
Observe that
An intuitive reading for Eq. (2) in the Kim scenario, is the possibility to represent justified and conflict-free arguments (extensions) w.r.t. the goals of those arguments. These notations will be used in the next section where an interpretation of the extension sets using CHAT in the context of the Kim scenario is introduced.
Conclusion inference
CHAT is an approach in social sciences that aims to understand individual human beings in their
This representation of an activity (3) is consistent with the idea of an extension of a PADF (2), both of them w.r.t. goals to be achieved. The representation of an activity, in terms of goals, allows us to integrate a decision-making framework directly into a hierarchy of activities, following the distinctions described in CHAT. In this setting, we can define the set of all the activities that an individual can perform as follows:
Let
Definition 1 describes
As discussed in Section 1, ALI is intended to be a complementary tool for a health-care team, providing extra information for assessment and monitoring individuals. In this setting, part of the importance of ALI lies in the method of presenting such notifications with positive feedback or encouraging messages. So far, we have been presenting a logical, sound method for decision-making, which is the “reasoner” component, and which provides a set of argument-based alternative explanations (PADF extensions), solving in a logical, sound manner the question of “when” to guide a person in changing her mental state and beginning an activity.
In the remainder of this section, we introduce two main contributions of ALI, which solve the second research question regarding “how” to provide persuasive notifications. The first contribution is a quantification of the activity performance using an integration of CHAT and PADF, and the second is a method for building persuasive messages using a
With the previously introduced goal-oriented integration, let us define the concept
(Status of activities).
Let us consider an argumentation framework Complete: iff Partial: iff Indifferent: iff for all
In order to exemplify Definition 2, let us consider the extensions obtained by arguments in Example 2 and the scenario in Fig. 6. Kim’s therapist analyzes her activities based on the observations collected by ALI through the mobile and the recommendations, which were presented to her. The therapist notices that there are goals, which were achieved, and there are others for which ALI does not have information. For instance, there are no observations that the action

Kim scenario 2, considering sub-activities with multiple goals.
On the other hand, ALI performs the recommendation in real time using the weight of each argument in the set of extensions. The weight is defined by the goal preferences (defined in our scenario by Kim and therapists) and by the degree of confidence of each rule (possibilistic degree). In ALI, this degree is attached to the
In order to exemplify the selection of rules, let us consider Example 2, one of the set of the nine extensions, which is presented in Table 2 and the scenario depicted in Fig. 2, in which ALI detects that Kim is running (argument
In this section we present a novel method for building pseudo-natural language from possibilistic argument-based hypotheses. We define an
Intuitively, our aim is to use well-formed hypotheses which explain what a person is currently doing, to create messages with the contained information. Our approach associates a decision/action with a type of scheme3
Let us call
Let
In Definition 3, the interaction between the activity and the goal produces the nucleus of the sentence and Kim’s message will be the satellite. Let us consider the following example:
Let us consider the Kim scenario and the CHAT-PADF integration represented in Fig. 2, we have:
The activity–goal scheme can be re-written as follows:
Let
In a positive feedback activity–goal scheme (Definition 4) we consider satellite units with compliment common messages like: “Mycket bra jobbat!” (Swedish)/“Very good job!”, and, integrating these satellites to the activity-goal nucleus. We can exemplify this approach by using our running example as follows:
In Kim scenario a positive feedback activity–goal scheme contains the structure:
Structures described in Definition 3 and Definition 4 are different. The order of

ALI System Architecture.
We introduce in this section the ALI system architecture. The two main modules of ALI are described (Fig. 7): (1) the ALI mobile application; (2) the ALI centralized modules. Some of the relevant functionalities of ACKTUS are introduced in Section 2.2. The ALI application was introduced to therapists as an initial step for validating the approach and testing each functionality.
ALI was implemented as a dual service, running as a data collector and, at the same time, delivering notifications in the mobile module.
Data sensing and notification delivery (on{X} service)
The detection task is accomplished by using a mobile application implemented with

An example of an encouraging notification sent to Kim’s mobile, which is running the ALI application.
The collected raw data was used for obtaining detailed data about the individual’s location, which was correlated with timestamp data from the

Different type of messages delivered to Kim (top). Traces of Kim’s activity (bottom).
The ALI Centralized Modules contain inference and recommendation modules. These are briefly described as follows.
Data collection storing
Data sent from mobile phone via
Argument Builder
The XSB system [67] is used for building arguments. The Argument Builder module captures the rules from the Data Collection Module, and, using XSB framework, rules are evaluated in the form of dependency graphs. These are evaluated following the Well-Founded Semantics through a full SLG resolution with tabling (see further details in [67]). The Argument Builder module is implemented in Java and linked to XSB using InterProlog [15] as a middleware.
Argument Evaluation
An extension-based argumentation semantics solver library is used for argument evaluation.
Activity Recommender sub-module
This module obtains the best decision from the arguments and prepares a persuasive notification with the purpose of convincing the individual to perform the action.
Message adaptation
This module obtains the recommendation and transforms it into an HTTP message to be visualized by the phone. This module sends the notification via Web Rest services.
ALI records all the
Pilot study results
The results are divided into results related to the argument building process and the generation of tailored messages and the interaction between the users and the ALI application.
Building argument-based explanations on different human-centric information sources
The outcomes of the assessment performed by therapists are described in natural language and follow the topics that the individual have created arguments about. Consequently, there are two main sources of human-centric arguments (the individual as a baseline view and the therapist, based on their expertise and knowledge of the client), which are supplemented with the current opinions that the individual holds in a particular situation in which an argumentative dialogue is performed. These opinions may not necessarily be the opinions that the individual holds as a baseline set of opinions. In our pilot study, we applied only the arguments formulated by the individual.
One example of an encouraging message is presented in Fig. 8. The message is presented when Argument 7 (see Table 2) is triggered. This notification was suggested by Subject A, talking to herself in order to “move” and do any kind of outdoor activity, because she had stayed at home more than two days, which was included as a trigger time observation.
Interaction between ALI and the study subjects
Interviews were conducted in order to investigate the positive and negative aspects of using a mobile phone to receive notifications, as perceived by the two participants. Subject A pointed out that one of the disadvantages was that she frequently forgot to bring along the charger for the mobile phone, which was one of the causes for only obtaining data on two days of activity. Subject A, on the other hand, had no problems with forgetting the charger, since she was at home most of the time. She also highlighted that she was receiving some notifications regarding going and doing exercise, but she was sick, and ALI continued sending notifications. Subject A suggested that she was interested in establishing a direct dialogue with the system in order to state that she was unable to do the exercise and had a good argument for not complying with the suggestions.
The question of whether the individual changed her behavior or not as a consequence of using ALI was not a subject of this pilot study. However, the following was observed, which creates a base for future studies. Given the data log, when Subject A received an encouraging message, she left her home, and ALI detected that she was out of town. It was confirmed later that she was visiting relatives, which was considered as complying with the Ali notifications. However, taking into account the location analysis and the number of notifications sent, we can infer that Subject A and Subject B were not attending to all the recommendations immediately.
A different kind of information was obtained using the GPS Visualizer. The plotted images were shown to Subject A, who responded with interest and curiosity and wanted to see exactly where she had been walking in a forest nearby. Her interest in the potential feedback in the form of a map of her routes offered suggestions for a future improved version of ALI. The top map of Fig. 9, shows when and what type of notification was sent and shows Subject A’s position before and after. The bottom map shows the different locations where Subject B was located in her home.
Discussion and related work
In this section we discuss our contributions with respect to other approaches, considering that our focus was the development of new approaches for improving two capabilities in AT systems: rational decision-making under uncertainty and tailored service delivering.
Integrating a possibilistic argument-based decision-making framework and CHAT
In argumentation literature, there are different approaches where human-centric perspective define partially or totally decision-making processes such as [18,32,53] among others. In
By contrast to informal and practical argumentation, other approaches such as [2,31,63] focus on providing sound and consistent argument-based explanations regardless a human-centric perspective. In this setting, the main general contribution of our approach is the combining of focus to goal-based activities of an individual, which enables a human-centric perspective that includes driving forces for conducting activity. This is particularly important when applications are aimed at supporting behavior change, as in our case, changing behavior towards a more healthy pattern of behavior.
In argumentation literature, Abstract Argumentation Frameworks (AAFs) ([13,21], among others) provide a theoretical basis for exploring issues of defeasible reasoning. The ALI approach follows the line of AAFs introduced in [21]. However, it is closer to approaches in which the knowledge is coded in the structure of arguments and argumentation semantics is used to determine the acceptability of arguments.
Dung in his seminal work [21] made one of the major contributions to the argumentation field by showing that logic programming can be shown as a form of argumentation, and at the same time, argumentation itself can be viewed as logic programming with
Indeed some authors from abstract argumentation branch of AI, have been made to use formal models of abstract argumentation as a basis for practical reasoning such as [66] or integrating at the same time different approaches of reasoning, epistemic and practical reasoning [64]. Our decision-making approach takes different advantages of WFS to create an implementation. Some other approaches can be currently unfeasible for implementing such as the case of practical reasoning with a complex management of natural language.
Using CHAT for argument interpretation
By considering a psychology framework for the interpretation of a sound set of acceptable arguments, a human-centric perspective is developed, obtaining as a contribution a quantification of the human activity performance and the possibility of planning analysis as a future work. CHAT is a more complex framework for human behavior analysis, involving not only the hierarchy
Consequently, the integration of CHAT into a formal decision-making process, offers two different paths for future work. First, a further deepened human-centric analysis can be integrated. Argument-based explanations can be obtained for conscious and unconscious causes for human activities, which makes it possible to analyze the different aspects of human activity, both the hierarchical characteristics (activities–goals–operations), and motives and needs. It was suggested by Karwowski and coworkers that
Second, the goal-centered analysis of human activities where an activity is based on human-centric goals:

Relationship between different activity-theoretical concepts: press, needs, motives, and goals [39].
In literature, there is an important amount of persuasive and guiding systems. Persuasive approaches have different perspectives depending on the underlying reasoning approach and the
Our approach has some similarities with the work introduced in [12,53,61], where
The generation of persuasive messages in ALI, based on an
A modular architecture for recognizing human activity in a non-intrusive manner
The approach presented in this work fulfills three major requirements; 1) a non-intrusive human recognition alternative; 2) dealing with uncertain and incomplete information from sensors with no data training; and 3) the activity recommendation should be supported and monitored by a health-care team. The prototype was oriented towards modularize the sensors in order to being able to integrate other from an Ambient Assisted Living systems in future.
This work differs from simpler approaches for human activity recognition such as those described in [5,24,40]. There is a significant difference in this implementation compared to approaches, which use sensors placed on different parts of the body of a person in an Ambient Assisted Living environment [26,42]. This is sometimes not feasible due to practical reasons. Uncertain and incomplete data from sensors were also analyzed in Ambient Assisted Living contexts (e.g., [5] and [42]). This approach uses a different alternative, where more than one possible scenario (set of argument extensions) is inferred in real time based on an argumentation semantics.
A formative pilot evaluation study
In order to test different parts of ALI architecture, a pilot study was conducted. Regarding the building process of natural arguments, the architecture obtains from the individual their preferences and feedback and encouraging messages. The information is used for building human-centric arguments, which are implemented in an introspective natural dialogue between a human agent and the system agent.
The evaluation study, where location sensors from the mobile phones were used, showed the following advantages: 1) ALI is a non-intrusive solution; 2) young users are familiar with mobile phones, and 3) the approach is a low cost alternative. The identified obstacles to use mobile phones for the purpose were: 1) inaccuracy of location sensors (Fig. 9 shows the inaccuracy of Kim’s location when she was in her home); 2) real time data transmission failed when the user was outside of the mobile Internet service coverage area, and 3) battery limitations.
In order to improve the argumentative dialogue between the user and the system (i.e., interaction), future work includes the implementation of a functionality in the next version of the prototype where the user can provide a response in natural language to the arguments provided by the system. In the pilot study, only the arguments formulated by the individual were applied. In future work, there will be three agents involved in the dialogues: 1) ALI as an agent, mediating the user’s baseline view including the arguments created by the user; 2) the therapist as an agent, mediating the domain professional’s view, and 3) the human agent, contributing with her current opinion about her situation at the moment of a dialogue.
Conclusions and future work
This paper presents ALI, which is an assistive technology system using an argument-based approach reasoning. This approach combines formal argumentation systems and informal models of human activity. This facilitates the tailoring of advices to the human actor, taking into consideration the human’s motives, goals and prioritized actions. The contributions of this work are the following:
A non-intrusive argument-based approach for tracking and monitoring an individual’s activities.
An argument-based framework for decision-making, framed on the Cultural-Historical Activity Theory, a theory for describing human activities.
A recommender system architecture, inferring the best decisions for selecting messages to support human’s goal-based activities.
Different perspectives were used in this interdisciplinary work for the purpose of recognizing and providing recommendations tailored to a person’s goals and preferences. Diverse lines of research will be pursued as part of future work, for instance: 1) include human’s motives, needs and different aspects of the cultural and historical perspective of a person for tailoring assistive technology, this include to investigate persuasion and behavior change approaches in Health and Artificial Intelligence fields; 2) further improvements of the interactive dialog between the human and ALI system will be performed by applying methods inspired by informal argumentation, particularly using New Rhetoric and natural language approaches; 3) methods for handling changes of preferences and verifying the validity of arguments with respect to time are part also of our future work. Furthermore, different user studies will be conducted which will involve more subjects and a longer test period. Allowing the use of assistive technology as ALI over a longer period of time, we will have further insight into how this technology affects the user’s decision-making and activity performance.
Footnotes
Syntax and semantics of the formal language for activity reasoning
In this section, the syntax of the formal language capturing complex activities is described. We also present the semantics for evaluating such language.
A possibilistic argument-based decision framework
Originally introduced in [59].
