Abstract
User security is an important consideration for robots that interact with humans, especially for upper-limb rehabilitation robots, during the use of which stroke patients are often more susceptible to injury. In this paper, a novel safety supervisory control method incorporating fuzzy logic is proposed so as to guarantee the impaired limb's safety should an emergency situation occur and the robustness of the upper-limb rehabilitation robot control system. Firstly, a safety supervisory fuzzy controller (SSFC) was designed based on the impaired-limb's real-time physical state by extracting and recognizing the impaired-limb's tracking movement features. Then, the proposed SSFC was used to automatically regulate the desired force either to account for reasonable disturbance resulting from pose or position changes or to respond in adequate time to an emergency based on an evaluation of the impaired-limb's physical condition. Finally, a position-based impedance controller was implemented to achieve compliance between the robotic end-effector and the impaired limb during the robot-assisted rehabilitation training. The experimental results show the effectiveness and potential of the proposed method for achieving safety and robustness for the rehabilitation robot.
1. Introduction
Neurologic injuries such as strokes and spinal cord injuries (SCI) cause dysfunction to the neural system and motor function, which generally results in upper-limb impairment and motion disabilities [1, 2, 3]. Conventionally, manual physical therapy is used to help patients with upper-limb impairments regain functional mobility [4]. In the last few years, there has been an increasing interest in using robotic devices to provide rehabilitation therapy for neurologic injuries [5, 6] and most of the paradigms that have been explored have been concerning physical interaction during movement training [7, 8]. Due to the particular conditions of the participants, safety and robustness are strongly addressed in controller design, which has been a critical issue for the rehabilitation robot.
In recent decades, many researchers have done a lot of work on safety in hardware and software designs [9]. For emergency situations, an emergency-stop button and some specialized mechanical structures have been designed. D.E. Barkana designed a quick-release hand attachment device to deal with any physical safety-related events [10]. A new reflex mechanism structure based on an instinctive response behaviour pattern was adopted to ensure no harm or minimal harm to the user [9]. In ref. [11], a robotic task-practice system for the functional rehabilitation of arms was presented which maximized operational safety by designing a small overall workspace, not strapping the patent in and choosing only a-rotary-movement functional tasks. In order to improve security during functional recovery therapy, some therapy robots have been developed with pneumatic actuators [12, 13].
Generally, the role of the software is to monitor the distance between the user and the robotic arm, to check for dangerous proximity between the payload and other links to the robot, and to calculate the distance between the robot and nearby obstacles, which effectively prevents against collision [14]. Furthermore, some parameters (such as the force, torque and velocity) have limitations placed upon them to ensure control safety [3, 15, 16]. In ref. [17], a motion control method with an estimated danger index was proposed to monitor the user's safety and initiate proper safety actions in case of danger. In addition, impedance control has been extensively adopted to achieve compliance and security for human-machine interactions, creating a dynamic relationship between the force and position [18].
All the above-mentioned safety-based designs, whether with hardware or software, are effective to some extent, but the hardware-based methods are not online inherently and the software-based methods, having limited parameters, lack flexibility with regards to clinical application. However, most of the works are focused on collision prevention caused by exterior emergency factors, and few are concerned with sudden emergencies caused by interior factors, such as a spasm or twitch. Moreover, during rehabilitation exercises, many interior factors, such as pose or position changes and even coughing, usually cause some disturbance to the rehabilitation system. Thus, the designed control system should combine robustness and safety, and be able to effectively manage reasonable disturbances and sudden emergencies.
In this work, we investigate safety and robustness during rehabilitation exercises, assuming a training-impaired-limb is the object of the exercises. A real-time control system based on a safety supervisory strategy is designed, which mainly involves evaluating the physical state of the training impaired limb (PSTIL), a SSFC and a position-based impedance controller. The proposed SSFC makes decisions to adapt the desired force in response to reasonable disturbances, or to quickly stop the rehabilitation robot without doing harm to the training impaired limb when it suffers from a sudden spasm or twitch. Considering the essential characteristics of the PSTIL, the developed control system effectively combines robustness and safety and will perform a better rehabilitation exercise.
2. Feature Extraction
The upper-limb rehabilitation robot is a typical human-machine interaction system and usually the subject's affected limb comes into physical contact with the robotic end-effector in the course of the robot-aided movement treatments. During the robot-aided exercise, the training impaired-limb is not in an ideal static physical state, and there are many uncertain factors which affect the PSTIL, e.g., pose or position changes, sudden twitches, occasional tremors and even coughing or other external disturbances, which are partly subject to human control (another unresolved controller) [15]. Therefore, the PSTIL is dynamically variable, which influences the performance of the robotic control. It means that pose or position changes or sudden twitches made by the training impaired limb affect the performance of the position-velocity tracking. Thus, features of the position-velocity tracking errors represent the PSTIL to a certain extent.
The raw tracking error signals with noise are not directly used as input information to reflect the PSTIL. Therefore, certain features of the tracking errors are extracted in order to efficiently reflect the PSTIL. Among various extracted features, e.g., mean absolute value, average rectified value, mean absolute value slope, root mean square, mean square error (MSE), value range, and slope sign changes, MSE value is selected, in this paper, as a feature of tracking errors that can be extracted. The MSE value is widely used in applications for its good practicability and effectiveness in real-time control. The common MSE equation is expressed as the following:
where
where
3. Control System
3.1 Safety Supervisory Fuzzy Controller
Fuzzy control technology has been developed to achieve human-like comprehensive judgment. It is credited in various applications as a powerful tool providing robust approximation for systems [19]. Fuzzy control is well suited for rehabilitation robots for several reasons. Firstly, the rehabilitation-robot system is essentially nonlinear, which is difficult to accurately portray with a model. Focusing on a nonlinear system is an outstanding application for fuzzy control; therefore it is a reasonable control strategy for rehabilitation robots. Secondly, the rehabilitation robot is a real-time control system and must be managed using a quick-and-effective method of control. Fuzzy control well meets this requirement.
Safety and robustness are the primary principles in designing robot-aided neuro-rehabilitation control systems [20, 21]. We develop a SSFC to meet the requirements from the essential point of the PSTIL, which are of course essential to the mechanism. The designed SSFC consists of an input, fuzzy controller and a decision-making section, as per Fig. 1, which can automatically modify the desired force according to the PSTIL, or halt the robot in time if the user suffers from a sudden twitch.

Structure of the SSFC
As mentioned above, the features of the position and velocity tracking errors are used to represent the PSTIL. Therefore, the fuzzy controller is adopted with two inputs and one output type. In order to achieve good performances under conditions of reasonable disturbances and emergencies, the inputs of the controller should include the information of the features and tracking-error variations. The used position and velocity information (Ψ
where
The corresponding output of the fuzzy controller is denoted by ρ which is related to the evaluated PSTIL. During the fuzzification and defuzzification, the inputs (Ψ
Fuzzy inference rules for output ρ

Input-output membership functions for SSFC. (a) Input membership functions; (b) Output membership functions
where

Control surface map for SSFC
The decision-making section manages the rehabilitation training based on the evaluations of the PSTIL. In this research, in response to reasonable disturbance, the desired force is adapted with the following equation.
where
Moreover, when the training impaired limb suffers from a sudden spasm or twitch, the emergency signal is given, which is shown as the following.
where
3.2 Rehabilitation Robotic Control System
Upper-limb rehabilitation robots are used to assist those with neural injuries to help improve their motion function using rehabilitation trainings. One of the major difficulties in carrying out rehabilitation with robots is the controller design. The control system must be safe and robust enough, given the particular conditions of the subjects. As mentioned above, during robot-aided rehabilitation training, the PSTIL is dynamically variable. Therefore, suitable compliant behaviour between the robotic end-effector and the impaired limb is one of the primary requirements in designing the control system, especially with regards to the physical-contact rehabilitation robot. A well-established framework for managing this task is given by impedance control [22], which is an inherent model-based approach. According to the implement mode of target impedance, there are two general approaches, namely, position-based impedance control and torque-based impedance control [23]. In contrast to the torque-based control, the position-based control is more mature and the performance is more stable [18, 24]. Thus in this paper, the position-based impedance control is adopted to design the control system.
Impedance control achieves compliant motion by regulating the dynamic relationship between the robotic end-effector position/velocity and contact force. In this paper, the desired impedance equation of the rehabilitation robot can be represented by
where
During the rehabilitation exercise, the subject is part of the dynamic system and the PSTIL is also uncertain. Therefore, in this research, the control system of the rehabilitation robot is designed by incorporating the position-based impedance control and the proposed intelligent SSFC.
The overall control system block diagram is shown in Fig. 4, which mainly consists of an impedance controller, a position controller, the developed SSFC (including a feature generator, a fuzzy controller and decision-making response sections). The impedance controller brings about compliant behaviour between the robotic end-effector and the impaired limb and then the position controller is applied to execute the position tracking. In intelligent SSFC, the feature generator reflects the PSTIL in real time and the fuzzy controller supplies an output corresponding to the PSTIL to the response sections which automatically adapt the desired force or halt the device using the so-designed decision-making mechanism. As analyzed above, the designed rehabilitation robotic control system is promises to be characterized by safety and robustness.

Control system block diagram for rehabilitation robot
4. Experiments
4.1 Simulation Experiment
4.1.1 Simulation Model and setup
With regards to physical contact during the rehabilitation training, the complete dynamics [22, 25] of rigid serial n-link robot manipulator with n-degree-of-freedom revolute joints can be presented in the joint space as:
where
The existing rehabilitation robot is usually designed with revolute joints to carry out the movement. In essence, the developed control algorithm manages the movement by controlling each joint rotation. Moreover, most of the trainings are executed with plane motions. Thus, in this research, in order to investigate the effectiveness of the proposed method, a two-link rehabilitation robot model (see Fig. 5) is used and several group simulation experiments were carried out on it.

A two-link rehabilitation robot model
The dynamics of the robot are given as:
In the simulation experiments, the parameters for the rehabilitation manipulator were selected as
4.1.2 Predefined Trajectory and Simulated Signal
Reach and grasp skill training is critical for patients in their attempts to return to a reasonable quality of life [11, 26], because many daily living activities involve the use of the upper extremities [4, 27]. The linear reaching exercise [15, 28] is largely used at the early stages of rehabilitation, in order to reduce spasticity [8] and prevent contracture [29]. Circular movement is also commonly used in clinic robot-aided rehabilitation training [15, 18]. In this work, we designed the two typical movement trajectories, namely, linear and circular training trajectories.
The linear movement trajectory was predefined in the Y direction and the length was 0.8m with the starting position: (1.2, 0.4) and end position: (1.2, 1.2) and the cycle time was 16s (see Fig. 5). In Cartesian space, it is expressed as
The circular movement trajectory was predetermined with the centre point: (1, 1) and radius: 0.5m (see Fig. 5). In Cartesian space, it is expressed as
To investigate the performance of the proposed method effectively, the planned movement ranges of predefined trajectories might be larger than those applied in clinics but this does not affect the analysis of control performances at all.
During rehabilitation exercises, the PSTIL generally presents three main types, these are ‘rational state’, the presence of reasonable disturbance and the occurrence of a sudden emergency. The interactive force is the only information shared between the impaired limb and robotic end-effector. Thus, in this research, interactive forces, corresponding to the different types of PSTIL, were used to investigate the control performances of the proposed strategy. Tremor is an involuntary, somewhat rhythmic, muscle contraction and relaxation involving to-and-fro movements (oscillations or twitching) of one or more body parts [30]. Neurological disorders or conditions (such as multiple sclerosis, stroke, traumatic brain injury and a number of neurodegenerative diseases that damage or destroy parts of the brainstem or the cerebellum) are liable to evoke tremors. Generally, the tremor is characterized by 3-to-8Hz oscillations or twitching [31]. Based on the characteristics of a tremor, we simulated interactive forces which are meant to represent a reasonable disturbance and a sudden emergency, respectively. In order to investigate the cases thoroughly, three kinds of interactive force, namely, regular sinusoid, sawtooth and complex sinusoid, were considered, which are shown in Table 2.
Simulation Signals for the PSTIL
4.1.3 Feature Extraction Results
To demonstrate the performance of the feature extraction with SMSE, three kinds of experiments were carried out, namely, with S1, S2 and S3, respectively. In each experiment, the common interactive force between the end-effector and the impaired limb was set at 6N and the reasonable and emergency disturbances were applied during the sections 3∼4s and 5∼6s, respectively, of the total execution time of 10s. The experiments were carried out using a predefined circular trajectory and the simulated forces were exerted in X direction. The performances of feature extraction for position and velocity tracking errors in X direction were demonstrated in Fig. 6.
In Fig. 6, it can be clearly seen that the extracted features of position/velocity tracking errors in X direction during 3∼4s, 5∼6s and other sections are obviously different and the features under emergency (5∼6s section) are remarkable, whether with S1, S2 or S3 disturbance. It indicates that the extracted features can represent the different PSTIL types, especially the emergency. From further analysis of Fig. 6, we see that the extracted features for different kinds of simulated states are consistent, which verifies the effectiveness of the proposed SMSE method for practical application. Comparing the feature during 3∼4s with the one during 5∼6s, the emergency can be detected easily. In other words, the extracted feature is only related to the upper-limb physical state to some extent.

Feature extraction under different kinds of disturbances. (a) S1; (b) S2; (c) S3
4.1.4 Control Performance Results
As mentioned in section 3.2, impedance control has shown to be promising in achieving compliant behaviour; therefore many researchers have adopted and developed this method for their control strategies. In this paper, in order to ensure robustness and safety, a method has been suggested which develops the intelligent SSFC (see Fig. 4) by combining it with the traditional position-based impedance control [8, 24, 32]. To investigate the control performances of the two methods, namely, the proposed method and traditional position-based impedance control, diverse experiments were planned. The simulations were carried out with predefined linear and circular trajectories, respectively, and two formal simulated signals (S1 and S3) were selected to test the control performance for each trajectory movement in order to verify the universal effectiveness of the proposed method. During the movement of the circular trajectory, the method of exerting the simulated disturbances of the different PSTIL was the same as mentioned in section 4.1.3. During the movement of the linear trajectory, the simulated disturbances were exerted in Y direction. The overall comparison of the control performances of linear movement is shown in Figs. 7 and 8, for S1 and S3, respectively. By comparing the velocity-tracking performances in Y direction between the proposed and traditional position-based impedance control, it is evident in Fig. 7(b) and 8(b) that, at the beginning, the proposed strategy presents a preferable initial response. Meanwhile, the proposed method presents a better position tracking performance than the traditional method, which is demonstrated in Fig. 7(d) and 8(d). Furthermore, it can effectively detect an emergency in real time, which represents a notable advantage with respect to safety. Emergency signals are supplied at 5.02s and 5.19s according to the evaluated PSTIL, as shown in Figs. 7(a) and 8(a), respectively, which correspond to the imitative impaired-limb condition.

Control performances of linear movement and emergency detection: S1. (a) Emergency signal; (b) Velocity tracking comparison; (c) Actual force with S1; (d) Trajectory tracking comparison

Control performances of linear movement and emergency detection: S3. (a) Emergency signal; (b) Velocity tracking comparison; (c) Actual force with S3; (d) Trajectory tracking comparison
Figs. 9 and 10 show the compared control performances for circular movement, for S1 and S3, respectively. The velocity tracking errors in X direction for S1 and S3 are shown in Fig. 9(b) and 10(b). The same conclusion is drawn as previously: that the suggested strategy presents a better initial response than the traditional method. Figs. 9(a) and 10(a) show the detecting performances of the proposed method and the emergency was detected at 5.01s and 5.17s for S1 and S3, respectively. The end-effector tracking performances in Fig. 9(d) and 10(d) reveal that the proposed strategy also provides better position tracking capability for circular movement.

Control performances of circular movement and emergency detection: S1. (a) Emergency signal; (b) Velocity tracking comparison; (c) Actual force with S1; (d) Trajectory tracking comparison

Control performances of circular movement and emergency detection: S3. (a) Emergency signal; (b) Velocity tracking comparison; (c) Actual force with S3; (d) Trajectory tracking comparison
To come to an overall appraisal of the proposed and traditional methods, the results were further analyzed with three indices, namely, overshoot (the maximum absolute error during the adjusting procedure), the sum of the absolute error (SAE) and maximum deviation (MD, the maximum absolute error during the 3∼5s). Here, the recording data from 0∼5s was selected to investigate the performance because the proposed strategy halted the robot in real time due to a simulated emergency. Two cases (position and velocity tracking errors) were studied to demonstrate the control performances. The analyses of the results of control performances are shown in Tables 3 and 4, for S1 and S3, respectively. According to the results, the method proposed with smaller overshoot provides better stability than the traditional method. Meanwhile, the results indicate that the novel control system with proposed method outperforms the traditional control system on trajectory tracking. Most importantly, the proposed method can effectively detect emergencies and works more safely and robustly.
Control performance comparisons for S1. During the circular movement, the position tracking error is defined along the radial direction and the analyzed velocity is in X direction. The sample frequency is set at 1kHz.
Control performance comparisons for S3. During the circular movement, the position tracking error is defined along the radial direction and the analyzed velocity is in X direction. The sample frequency is set at 1kHz.
4.2 Real Experiment
4.2.1 Experiment setup
Additionally, the proposed control strategy was further verified on a WAM rehabilitation robot. The WAM rehabilitation system mainly consists of the Barrett WAM Arm, a 3-D force sensor [33], an arm supported device, and an external PC, as shown in Fig. 11. The standard WAM Arm is a four degree-of-freedom (DOF) highly dexterous, naturally back-drivable manipulator, which stretches the impaired limb for movement exercises. The improved 3-D force sensor was designed and installed on the end-effector to record the interactive force during the exercises and the arm supported device was designed to support the forearm of the stroke participant. The proposed control strategy was developed on an external PC with Ubuntu Linux system. More detailed information on WAM rehabilitation systems is given in ref. [20].

WAM rehabilitation system
4.2.2 Experiment scheme
A shoulder extension/flexion, horizontal movement trajectory was predefined, whose range, expressed in the WAM Arm's world coordinates, was defined as 0.45 rad in flexion and −0.45 rad in extension (XOY plane), with 18.1s for each session. A healthy adult male volunteer was instructed to deliberately simulate the different PSTIL during the rehabilitation exercise. The volunteer was required to simulate each type of physical state (reasonable disturbance and sudden twitch) as much as possible with the same action and at the same position.
4.2.3 Control Performance
To demonstrate the superiority of the proposed strategy, the proposed and traditional control methods were used on the WAM rehabilitation system, respectively. The position and velocity tracking errors were recorded during the experimental exercise and at the same time the emergency signal was also recorded when the rehabilitation system was running with the proposed method. The experimental results are shown in Fig.12. The subject simulated reasonable disturbance and emergency at 8∼10s and 26.5∼28.5s, respectively.

Control Performance comparison
In Fig.12, comparing the position and velocity tracking errors of two control methods, it can be concluded that the proposed method presents a better tracking performance, which is strikingly similar to the result of simulation experiments. The proposed method supplied an emergency signal to halt the rehabilitation exercise at 27.48s when the impaired limb was suffering from an emergency, which demonstrates remarkable superiority with regards to safety. The data from the first exercise session was further analyzed to present the control performances of the proposed and traditional methods. Note that the data of the second session is exclusive, because the proposed method halted the rehabilitation exercise due to an emergency to protect the impaired limb. Two indices, the maximum of the absolute error (MAE) and the sum of absolute error (SAE) of the trajectory tracking errors, were adopted to evaluate position and velocity tracking performances of two controllers. The outcomes are presented in Table 5. The analyzed results also show that the proposed method runs rehabilitation training with a better tracking performance than the traditional method in the presence of reasonable disturbance.
Control performance comparison of proposed and traditional methods
5. Conclusions
System security and the robustness of the controller are the critical considerations when designing a rehabilitation robot. In this paper, we present a novel safety supervisory control strategy to meet the demands that the system be robust when faced with reasonable disturbance and safe enough in emergencies. The proposed method is highly suitable for the real-time safety monitor. Regarding the training impaired limb itself, the features of the position and velocity tracking errors were extracted to evaluate the physical state of the limb in real time. A safety supervisory fuzzy controller was developed to achieve systematic safety and robustness. The fuzzy controller automatically adapts the desired force between the end-effector and impaired limb to ensure robustness in the event of reasonable disturbance. Furthermore, the fuzzy controller can effectively detect an emergency such as a sudden spasm or twitch etc, and halt the robot quickly enough so as to avoid causing the impaired limb further harm during the emergency. Meanwhile, a position-based impedance controller has been designed to achieve interactive compliance during the rehabilitation trainings. The diverse simulation and real experimental results have verified the effectiveness and practicability of the proposed method to achieve security and robustness for an upper-limb rehabilitation robot.
Footnotes
6. Acknowledgements
The authors appreciate the help of all their colleagues in the Remote Measuring and Control Laboratory, who made valuable contributions to this work. This work was supported by the National Natural Science Foundation of China (No. 61104206, No. 61105048, No. 61272379), the Natural Science Foundation of JiangSu Province (BK2010063), the Technology Project Foundation of JiangSu Province (BE2012740), the Industrial Technology Project Foundation of the ChangZhou Government (CE20120085), and the Ph.D. Program Foundation of the Ministry of Education of China (No. 20110092120034). The authors would also like to thank the anonymous reviewers for their very useful comments.
