Abstract
This article presents a human–robot cooperation controller towards the lower extremity exoskeleton which aims to improve the tracking performance of the exoskeleton and reduce the human–robot interaction force. Radial basis function neural network is introduced to model the human–machine interaction which can better approximate the non-linear relationship than the general impedance model. A new method to calculate the inverse Jacobian matrix is presented. Compared to traditional damped least squares method, the novel method is proved to be able to avoid the orientation change of the velocity of the human–robot interaction point by the simulation result. This feature is very important in human–robot system. Then, an improved non-linear robust sliding mode controller is designed to promote the tracking performance considering system uncertainties and model errors, where a new non-linear integral sliding surface is given. The stability analysis of the proposed controller is performed using Lyapunov stability theory. Finally, the novel methods are applied to the swing leg control of the lower extremity exoskeleton, its effectiveness is validated by simulation and comparative experiments.
Keywords
Introduction
Lower extremity exoskeleton is a special kind of man–machine interaction system which can combine the highly developed sensory, balancing, path planning capabilities of the wearer and the large payload capacity of the robot.1,2 Obviously, it has numerous potential applications; for instance, it can help soldiers to walk or run with weights and it can provide accident rescue workers and other emergency personnel with the ability to carry heavy loads, such as rescue equipment, food and first-aid kit.3,4 So exoskeletons have attracted great interests from many famous universities, military and the industry. The first energetically autonomous lower extremity exoskeleton (Berkeley lower extremity exoskeleton (BLEEX)) is designed to augment soldiers’ capability of carrying a heavy backpack.5,6 Recently, a hybrid leg exoskeleton is designed to augment load-carrying by introducing novel Hy-Mo actuators. 7 A series of hybrid assistive leg (HAL) is developed to assist the hip and knee joint. 8 Raytheon has developed the second-generation exoskeleton called XOS2 for US Army. It can enhance the human strength, agility and endurance capabilities of the soldier in it. A research into a powered hip exoskeleton is presented and an anthropomorphic structure is designed with only six degrees of freedom. 9 In one word, a successful exoskeleton must be able to enhance the user’s strength and endurance and guarantee the agility and freedom of the user.
The effectiveness of the lower extremity exoskeleton depends on the control system’s ability to bring the wearer’s advantage of providing balance, navigation and path-planning into play while ensuring that the exoskeleton can support most of the payload.10,11 So the exoskeleton needs to shadow the movement of the wearer in an intuitive and unobtrusive manner.12,13 It also means to minimize the human–machine interaction force so that the wearer nearly can’t feel the existence of the exoskeleton and the payload. 14 The control of HAL is based on hybrid control method which used electromyography (EMG) sensors to measure human’s muscle biological information and generate the desired actuators control signals. 15 Sometimes the information from EMG sensors is not reliable and it is greatly influenced by the skin conditions where it is located. 16 A novel control scheme is executed in BLEEX which is called sensitivity amplification control. It needs no direct measurement from the human–machine interaction force, so it can eliminate the problems associated with measuring interaction forces or human muscle activity. However, it needs a very wide control bandwidth and has little robustness to parameter variations. 17 Another intuitive way of minimizing the human–machine interaction force is to measure the interaction force directly which is commonly used in upper-limb exoskeleton. 18 Lee got the generation of desired position of the exoskeleton by modelling human–robot interaction into virtual mechanical impedance. 19 Miranda adopted a spring to model the human–machine interaction and calculated the user’s intention. 20 Considering the complexity and application of the human–machine model, Lee also proposed a Proportional-Integral (PI) model to infer the wearer’s movement intention.19,21 Kwon utilized artificial neural network (NN) to approximate the non-linear relation between surface EMG and upper-limb motions. 13 The control system is very complicated which needs to get the signals from five upper-limb muscles and angular velocities of the limb joints.
In this article, radial basis function (RBF) NN is adopted to model the relationship between the force sensor and lower extremity exoskeleton which can approximate any continuous functions with approximate parameters.22–24 Thus it can depict the non-linear relation of the human interaction in detail. When the exoskeleton approaches the kinematic singularity, the inverse Jacobian matrix becomes a singular matrix which makes the exoskeleton unstable and possibly causes an accident. A new method is proposed to solve the singularity problem with the pseudo-inverse Jacobian matrix which is more suitable for exoskeletons than damped least squares (DLSs). Finally, to ensure the swing leg of the exoskeleton shadows the wearer with minimal interaction force, an improved non-linear robust sliding mode control method is proposed and a new non-linear integral sliding surface is introduced to deal with the effect of parametric uncertainties and uncertainties of the system. Effectiveness of the proposed algorithms is verified by simulation and experiment.
A brief overview of the article is given as follows: in section ‘Architecture’, the lower extremity exoskeleton is introduced which is designed to aim the wearer to hold payload. In section ‘Human–robot interaction modelling’, RBF NN is recommended to model human–robot interaction in exoskeleton and is verified by simulation. In section ‘Swing leg modelling’, we proposed a new method to obtain the pseudo-inverse Jacobian matrix which is more suitable to apply in human–robot system and simulation has proved the result compared to other methods. In section ‘Controller design’, a novel non-linear sliding mode controller (INSM) with a non-linear integral sliding surface is proposed and the Lyapunov stability of the control law is proved. Finally, in section ‘Simulation experiment’, the comparative simulation and experiments are performed to verify the effectiveness of the proposed method. Section ‘Conclusion’ concludes this article.
Architecture
Human walking is a cyclic process that can be divided into stance phase and swing phase. Swing phase occupies approximately 40% of one cycle during the normal gait. 1
The exoskeleton is shown in Figure 1 and consists of two anthropomorphic legs and a spine which is used to carry load. It belongs to pseudo-anthropomorphic architecture. This means although it has hip, knee and ankle joints like a human, the details of these joints are different from humans. 14 Overall, this lower extremity exoskeleton has seven distinct degrees of freedom per leg: three degrees of freedom at the hip, one degree of freedom at the knee and three degrees of freedom at the ankle. When the operator wears the exoskeleton, it will be attached at the feet, legs and upper body. According to some research studies, most of the power needed for walking is in the sagittal plane. So only the freedoms of hip and knee in sagittal plane are powered.6,14

The lower extremity exoskeleton.
Human–robot interaction modelling
The first step to realize the aim actuating the swing leg to shadow the wearer synchronously is to get the wearer’s motion intention. It is identified using a six-axis force sensor mounted at the shank and encoders mounted at the joints. The swing leg tracks the motion intention so that the interface force converges to zero.
As shown in Figure 2, the exoskeleton is attached to the back, shank and feet of the wearer. Interaction force is generated by the connected shank interface. It also shows that human–robot interface is modelled using artificial NN which can approximate the non-linear relationship between interaction force and leg motions at any precision. 25

Human–robot interaction model using the RBF NN. RBF NN: radial basis function neural network.
RBF NN includes three feedforward layers. The network input terms are the interaction force and joint angles of hip and knee. The input vector is described as
where θ1 means the joint angle of hip in sagittal plane by angle encoder, θ2 means the joint angle of knee in sagittal plane by angle encoder, Fx means the component force along shank and Fy means the component force whose direction is perpendicular to the shank.
The output terms are the angular velocities of knee and hip
The number of hidden neurons is important to depict the non-linear relationship, so we tried to find the optimal number of hidden neurons based on the iterative method. The control algorithm of one hidden neuron can be described as
where
To evaluate the network, we defined a judgement function based on approximation error and variable parameters. It is described as
where
When the wearer moves the swing leg of the lower extremity exoskeleton, the input information of the RBF NN is stored based on related sensors. The MATLAB NN toolbox is used to train the network based on the stored information.
One thousand and eight hundred sampling input signals of the RBF NN are used to test the system, and another 200 sampling input signals are used to verify the trained neural system. Figure 3 shows the results, where (a) represents the obtained velocity by neural system compared to the real velocity and (b) represents the tracking error of the velocity. Obviously, it proves the mapping between the input vector x shown in equation (1) and velocities of human–machine interaction point is useful. Intuitively, the method is more accurate than impedance model in depicting non-linear relation.

Simulation of the RBF NN. RBF NN: radial basis function neural network.
Accurate estimation of wearer’s motion intention generates accurate movement of the lower extremity exoskeleton, and it is a time-variant desired trajectory. Finally, the block diagram to control the lower extremity exoskeleton to shadow the wearer based on the human–machine cooperation is designed as shown in Figure 4.

Block diagram of the control system for human–robot cooperation of the lower extremity exoskeleton.
Swing leg modelling
Although it is straightforward to obtain a model as a serial chain, closed-chain mechanisms are less intuitive and harder to analyse. A partitioned approach is used to analyse a closed-chain mechanism by deriving the dynamic model of the two separate parts. 26 So we will focus on the swing leg which is also important to ensure the exoskeleton system shadow the operator in synchrony. It demands large degrees of joints movement and small human–robot interaction force.
The swing leg has similar degrees of freedom to those of the human body. Therefore, we set the joint coordinate systems in Figure 5, and the kinematics model is obtained based on the Denavit–Hartenberg parameter method.

Coordination system, link parameters and DH parameters of the swing leg of the lower extremity exoskeleton. DH: Denavit–Hartenberg.
Based on the D-H parameters in Figure 5, the homogeneous transformation matrix is calculated in equation (6). Then, the Jacobian matrix is derived as shown in equation (7).
where
As shown in Figure 5, when the swing leg reaches the kinematic regularity, the inverse Jacobian matrix becomes singular, which causes the system to be unstable. In this case, it’s dangerous for the wearer because the exoskeleton may vibrate and collide. So DLS method is adopted to avoid this problem in upper-limb exoskeleton.19,27 The DLS method is described in equation
where
To evaluate the effect of the DLS method used in lower extremity exoskeleton, we designed a simulation as follows
where
Through Figure 6, where ω
1 represents the angular velocity of the hip joint and ω
2 represents the angular velocity of the knee joint, the DLS method really decreases the angular velocity of the joints with the factor α. the norm ratio of the vector v1 and v: the vector angle difference between v1 and v:

Angular velocity in joint space by the DLS method.
We suppose the parameters value as follows: θ1 = 0°, θ2 = −5° and the terminal velocity in operational space
When we set the origin of the velocity vector in the same point and connect the terminal point of the vector, Figure 7 is plotted. It is obvious to show the real velocity differs from the calculated velocities by DLS method in amplitude and orientation. To justify the variation, we have defined two evaluation indexes and Figure 7 exhibits the norm ration and vector angle difference between the velocities. Obviously, the minimal value of k decreases and the maximal value of γ increases as α increases.

DLS method (a) Velocity in the operation space and (b) ratio and angle difference of the velocity.
Although Figure 6 proves the DLS method can really avoid the too large joint angle velocity, the different direction of velocities will amplify the resistance from the exoskeleton. Especially, when γ reaches 80° as in Figure 7, it means the orientation of the calculated velocity of the human–robot interaction point is almost perpendicular to the real velocity in operation space. It is dangerous for the wearer to move with the exoskeleton. So the DLS is not suitable for the lower extremity exoskeleton.
By analysing the inverse Jacobian matrix formula as shown in equation (13), we propose a new method to calculate the pseudo-inverse Jacobian matrix as follows.
To any n × n non-singular matrix J, its inverse matrix can be written as
where Jij(i,j = 1 … n) is the algebraic cofactor of J.
Combined with equation (10), we can get
When J reaches the singular state, det(J) will be very small and the calculated angular velocity
where δ is a small positive number.
Then, equation (13) can be written as
The calculated angular velocity won’t be too large because of the limited parameters, such as K, Jik and
Obviously, Figure 8(a) and (b) is in deep contrast with Figure 7(a) and (b). We can conclude that the proposed method can guarantee the orientation of the calculated velocity is the same as the original velocity in operation space.

Proposed method (a) Velocity in the operation space and (b) ratio and angle difference of the velocity.
As shown in Figure 9, the proposed method can decrease the angular velocity by selecting δ. From Figures 8 and 9, we can make the conclusion that the proposed method really can avoid too large joint angular velocity and can maintain the direction of the terminal velocity in operational space.

Angular velocity in joint space by the proposed method.
To design the controller in Figure 4, we need to deduce the dynamic model of the swing leg of the exoskeleton based on coordinate system in Figure 5. Lagrange dynamics is adopted and equation (16) is the dynamic model of the swing leg
where τ1 means the hip torque and τ2 means the knee torque.
Controller design
During designing, the controller based on the model in equation (16), the model error and uncertainties of the actual system are not negligible. The whole dynamics model can be written as
where ΔM, ΔC and ΔG mean the model error, d means the disturbances.
Intuitively, the model error and disturbance are thought of the disturbance and represented by f(t) which is non-linear and difficult to model. f(t) is with boundary as
Equation (17) can be written as
In traditional sliding mode control,28,29 the integral sliding surface is designed as follows
where
The third part in equation (20) will lead to the large error accumulation, and may deteriorate the system performance, such as wind-up. Obviously, arctan function atan(x) is a non-linear saturation function and a monotonically increasing function. So another class of quasi-potential function and its derivative is introduced in equation (21)
To avoid wind-up, the integral part of equation (20) is replaced by equation (21). The improved sliding surface is written as
Based on the sliding surface equation (22) and the dynamic model equation (19), we have
To achieve better performance and decrease the reaching time, we have chosen the general sliding model reaching law as
where sgn(·) means the sign function, η is a positive switching gain, 0 < α < 1, which can guarantee the system reaches the sliding mode in a greater speed when the system state is far away from the sliding mode, and decrease the chattering problem when the system state reaches the sliding mode.
Combining the equations (23) and (24), the control law can be designed as
where
Stability proof:
Considering a positive definite Lyapunov function as
Differentiating equation (26) with respect to time yields
Substituting equation (25) into equation (27), equation (27) can then be written as
Combining the equation (18), we can consider two situations to ensure the system is stable
when s ≥ 0, we can specify
when s < 0, we can specify
To express equations (29) to (30), we define
Hence, equation (25) can be rewritten as
Thus, we have designed a control law which satisfies a Lyapunov stability criteria. And the system state will reach the sliding mode surface in finite time.
Considering the signum function in equation (32), its discontinuity characteristic will cause the control input to chatter. To circumvent this situation, the boundary layer technique is employed to alleviate the chattering and smooth the control input. So we have introduced saturation switch function as follows:
where Δ > 0, and it means the threshold of the boundary layer. Outside the boundary layer, the control has the ideal relay characteristic, it will accelerate the state to reach the sliding mode; however, within the boundary layer, the controller is a feedback controller, it will decrease the chattering during the sliding mode switch.
Simulation and experiment
To verify the effectiveness of the proposed human interface model based on RBF NN and the method to calculate the pseudo-inverse Jacobian matrix and the non-linear novel controller, we perform experiment on the swing leg of the lower extremity exoskeleton as shown in Figure 2. The operator will wear the exoskeleton and move his swing leg which is attached to the swing leg of exoskeleton.
The dynamic model has been obtained as illustrated in section ‘Swing leg modelling’ and the parameters in equation (16) are as follows
The parameters are given in Figure 6. The swing leg is tracking with the reference trajectory as
where both the initial position of the two joints are zero.
The parameters of the uncertainties in equation (25) are set as
We compare the proposed INSM with the conventional sliding mode controller 28 (hereafter called CSM). The parameters of the controller in equation (32) are given as
The torques from the controller are shown in Figure 10. Obviously, the boundary layer in saturation function eliminates the chattering and the CSM has a large chattering using signum function directly. The large chattering makes the wearer uncomfortable. The INSM has a more smooth torque which is more suitable to be applied in human–machine system.

(a) Control torque of the hip joint in INSM controller; (b) control torque of the knee joint in INSM controller; (c) control torque of the hip joint in CSM controller; (d) control torque of the knee joint in CSM controller. INSM: non-linear sliding mode controller; CSM: conventional sliding mode controller.
Then, INSM is applied to control the swing leg of the lower extremity exoskeleton. The desired trajectory is produced by RBF NN controller based on the human–robot interaction force. So when the wearer moves his leg, the controller drives the swing leg to shadow the motion. The joint angles are measured by encoders attached to the exoskeleton as shown in Figure 2.
In addition, the human–robot interaction force is measured using the six-axis pressure sensors. This force vector is provided by the wearer’s motions to the exoskeleton, so the magnitude and direction of the force vector reflects information of the wearer’s motion. The controller proposed in this article aims to minimize the force vector and finally decreased the force vector to zero. Thus we can justify the controller’s performance by the amplitude of the interaction force vector. Figure 11 shows the results of the experiment.

(a) Interaction force along the X axis in INSM and CSM controller; (b) interaction force along the Y axis in INSM and CSM controller; (c) tracking error of the hip joint in INSM and CSM controller; (d) tracking error of the knee joint in INSM and CSM controller. INSM: non-linear sliding mode controller; CSM: conventional sliding mode controller.
To evaluate the performance of the controller, we have adopted two evaluating indicators: the first is the root mean square (RMS) residuals and the second is the maximum absolute value, which are defined as
The evaluation results of the controller performance are illustrated in Table 1. Obviously, the RMS value and the maximum value of the two joints gained by INSM controller are much smaller than the corresponding values gained by CSM controller. Because of the accumulation of the error, the CSM controller has a higher maximum absolute tracking error. Compared to other robot system, a more important evaluating indicator is the interaction force. By analysing the interaction force from the force sensor, the RMS value and maximum value are also listed in Table 1. While we adopt the INSM controller, we can get smaller interaction force and the wearer feels more comfortable. The swing leg can shadow the wearer easily. By contrast, the wearer feels bigger interaction force and needs more power to move the swing leg of the lower extremity exoskeleton using the CSM controller.
Performance evaluation.
INSM: non-linear sliding mode controller; CSM: conventional sliding mode controller; RMS: root mean square.
Conclusion
In this article, the RBF NN is introduced to model the human–robot interaction which is normally described by impedance model alternatively. The method can depict the non-linear relationship more precisely. Then a new method is proposed to solve the pseudo-inverse Jacobian matrix when the joints reach the kinematic regularity. Analysis and comparative simulation of the swing leg of the exoskeleton has proved that the velocity calculated using the new method can avoid too large amplitude and guarantee the same direction to the real velocity. Further, because of the uncertainties of the human–robot interaction system, an improved robust non-linear integral sliding mode controller has been proposed with a novel non-linear integral sliding surface. It can decrease the reaching time and avoid too large accumulation of the error. Finally, the proposed methods in this article are designed to control the swing leg of the lower extremity exoskeleton to shadow the wearer without given trajectory. Simulation and experiments prove the effectiveness and reliability of the proposed controller compared to traditional sliding mode controller. The wearer also feels more comfortable to move the swing leg using the controller in this article. These proposed methods can be applied in stance leg of the lower extremity exoskeleton and other human–robot interaction system.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship and/or publication of this article: The research work is supported by Science Fund for Creative Research Groups of National Natural Science Foundation of China (No. 51221004), Zhejiang Provincial Natural Science Foundation of China (No. LY13E050001) and Hangzhou Civic Significant Technological Innovation Project of China (No. 20132111A04).
