Abstract
The safe disposal of nuclear waste in radioactive environment urgently needs cost-effective approaches. Toward this goal, this article developed a method to external force estimation based on the identified model without force sensors. Firstly, the mathematical model including joint friction was obtained and transformed into the linear combination of unknown parameter to be estimated. Secondly, the unknown parameters were identified based on the improved particle swarm optimization algorithm, the identification procedure was implemented by optimizing the excitation trajectories to excite joint motion and sampling relevant data. Identified results were compared with the biogeography-based optimization algorithm and the cuckoo search algorithm. Then, the identified dynamic parameter was applied to external force estimation. Finally, the verification of external force estimation has been carried out using the Kinova Jaco2 robot manipulator, and the experimental results showed that the external forces by the proposed method could be estimated with an root mean square error of 0.7 N.
Introduction
The safe disposal of nuclear waste is a global problem of great social significance and the global nuclear industry increasingly seeks cost-effective approaches for remote handling techniques to reduce radiation hazard. Remote robot manipulators can take the place of workers to do too hazardous or difficult tasks in radioactive environment where the use of people is not always possible. Many tasks performed in disposal of nuclear waste require remote robot manipulators to interact with the environment, such as grasping, cutting, dismantling, sorting, and segregating nuclear waste. To ensure the accurate execution of these tasks, not only the position/velocity control but the force control is also required to obtain the desired performances. 1 Therefore, it is important to take the information of interaction forces into account for achieving safe and desired task performance. To obtain the external force information, a force sensor is used; the force sensor is often installed on the wrist of robot manipulator for measuring the external forces applied on the tip of the end effector. However, the force sensor with high accuracy and reliability is very expensive and undoubtedly increases the system cost of the robotic manipulator. Technically, the uncertain disturbances and harsh environment, such as high temperature and the high dose rates of nuclear sites, may affect the accuracy and reliability of the force sensor. Moreover, the use of force sensor not only increase the complexity of mechanical, electrical, and software design of the robot system but also have an influence on system modeling and control algorithm design. 2 Considering the abovementioned drawbacks of force sensor, employing the external force estimation method has been a feasible option in radioactive environment where the dose rates limit the use of force sensor.
The external force estimation methods developed to estimate the forces applied on robot end effector require parameter identification of robot for an accurate mathematical model. Different parameter identification methods for the robot model have been suggested. Swevers et al. 3 presented an approach to design the optimized excitation trajectory, this approach was based on a finite Fourier series and guarantees periodic excitation, which allows data averaging in time domain and rejects the negative effects of noise disturbance. Atkeson et al. 4 developed the least square algorithm to estimate load and link inertial parameters of a PUMA 600 industrial robot. Wang et al. 5 built the Adaline neural network model to estimate the dynamic parameter for the reconfigurable robot. Taking into account the measurement errors, Olsen and Petersen 6 presented the maximum likelihood estimation (MLE) for estimating inertial parameter. This scheme can reject the influence of measurement noise remarkably, but it is easy to get stuck at locally optimal result in the global. Jin and Gans 7 proposed an intuitive and efficient criterion using Hadamard’s inequality to design the excitation trajectory for dynamic parameter identification. The reliability of the identified parameters has been verified on a six-degree-of-freedom (6-DOF) Staubli TX-90 robot. Wang et al. 8 employed deep learning to eliminate the effect of uncertainty to aid parameter estimation. Gautier et al. 9 proposed a closed-loop output error approach called the Direct and Inverse Dynamic Identification Models (DIDIM) for offline identification of the dynamic parameters, which only need to collect the joint torque measurement information, instead of calculating the joint velocity and acceleration by the filtered value of position measurement. In recent years, there are several novel methods for identifying the robot dynamic parameter using intelligence algorithms. Xu and Ke 10 presented an biogeography-based optimization (BBO) method to estimate the dynamic parameters by searching for global optimal solution. Ding et al. 11 developed an artificial bee colony method to identify the unknown parameters of a 6-DOF industrial robot, which employed the measured joint position to derive the joint velocity, acceleration and combined it with the motor current to calculate the joint torque. Ding et al. 12 proposed an improved cuckoo search (CS) method to obtain the parameter of ER-16 robot manipulator, while it can be easily trapped into local optimum when solving complex multidimensional parameter identification problems. Jia et al. 13 developed optimization design method based on multicriteria embedded by optimized excitation trajectories, and the parameter identification is solved by MLE.
On the other hand, various methods for estimating the interaction between the robot and its environment have been proposed. A robust force estimation observer using semiparametric model and disturbance Kalman filter is proposed to estimate the contact force of multilink manipulator. 14 A high-order finite-time observer is proposed to estimate the time-varying and nonconstant interaction forces in a finite time horizon. 15 An external force observer-based admittance method with time-varying delay compensation is developed for hydraulic series elastic actuators. 16 Sensorless contact force estimation method based on the weighted moving average with variable span is developed for serial manipulator. 17 Disturbance observer-based method is proposed to estimate the unknown interaction force. 18,19 Interaction force estimation that utilizes extended state observer was presented to estimate the interaction time-varying forces exerted on a robotic manipulator. 20 However, the above method may suffer from decreased estimation accuracy due to model errors.
Motivated by the need to perform tasks in disposal of nuclear waste in radioactive environment, we proposed a method to estimate the external forces applied on robot end effector without force sensors. The main contributions of this article are listed as follows: (a) Compared with two different intelligence algorithms, the superiority of the particle swarm optimization (PSO) algorithm in the application of parameter identification is validated. (b) A new method to estimate the external forces without force sensor based on the identified model together with the built-in torque sensor. (c) Experimental results carried on the Kinova Jaco2 robot manipulator verify the effectiveness of the proposed method.
The remaining part of this article is organized as follows. The linear dynamical model of robot manipulator with friction is described in the second section. Parameters identification based on the PSO algorithm with excitation trajectory design and optimization is elaborated in the third section. In the fourth section, the identification procedure as well as experimental validation of external force estimation was implemented on the 6-DOF Kinova Jaco2 robot manipulator. Additionally, the performance of the PSO algorithm is compared with some other intelligence algorithms. Finally, a brief conclusion is given in the final section.
Dynamic modeling
Applying the recursive Newton–Euler 21 or the Lagrange formulation, 22 the dynamic model of a robot manipulator consisted of n rigid links connected by n rotational joints can be formulated as
where
To effectively identify the dynamic parameters, equation (1) can rearrange into the linear combination of identifiable parameters by the modified Newton–Euler method 23
where
where
Due to the friction comprising a large proportion of the joint output torque, the torques caused by joint friction should be also included in dynamic model of robots in equation (3). To simplify the friction model, the robot joint friction can be regarded as the linear form of viscous friction and Coulomb friction in robotic applications. 24 The friction torques are described as
where
where
where
where
Once the dynamic parameters vector
The estimated external force/torques on the robot end effector in Cartesian space can be calculated by
where
The estimated external force/torques on the robot end effector are obtained by multiplying the inverse of
Parameters identification procedure
PSO for parameters identification
PSO is a heuristic optimization algorithm, which was inspired from birds’ flocking for exploring global optimal solution. 27 PSO can be applied to estimate the dynamic parameters by initializing a set of particles randomly over the searching space to find the optimal solution with iteration. Particles update themselves by tracking two “extremum” in each iteration. The first one is individual extremes (p Best), and the another one is global extremes (g Best) found by the whole PSO. Figure 1 shows the illustration of the PSO algorithm to obtain the optimal solution, the particles are searching in the n-dimensional solution space, where each particle adjusts its velocity and new position in accordance with its own and companions’ experience.

Geometrical illustration for PSO algorithm. PSO: particle swarm optimization.
The velocity and position of the particles are updated in each iteration according to the following equations
where
The inertia weight coefficient ω in equation (14) can be expressed by ω(t + 1) = αω(t) (0 < α < 1) which decrease linearly with the increase of iteration. This coefficient enables the particle swarm to search in the whole solution space with high probability at the initial stage and quickly converge to the local optimal solution. Then, the optimal solution can be searched in the local detail with the decrease of inertia weight.
To avoid the PSO algorithm falling into the local optimum, the mutation operation is carried out on the particles by referring to the concept of mutation in the genetic algorithm
where
The fitness function determines whether the particle is the optimal condition in the PSO algorithm. In this work, the fitness function
where N is the length of the measured data,
Based on PSO for estimation of dynamical parameter, 12 parameters should be identified for each joint in the dynamic model of the manipulator, the detailed procedure for executing the PSO algorithm to estimate the dynamic parameters is described as follows:
Step 1: Randomly initializing the particle swarm. Initializing the swarm size according to the number of parameters needed to identify, randomly initializing the particle position and velocity in the range of kinetic parameters, initialize
Step 2: Updating the particle swarm according to equations (14) and (15).
Step 3: Doing the following for each particle:
Step 3.1: Obtaining the variant particle swarm
Step 3.2: Selecting the favorable variation and carrying out the variation on the particle swarm
Step 3.3: Carrying out fitness comparison between each individual in the current particle swarm and
Step 4: Comparing the fitness of
Step 5: Checking the stop criterion. If the stop criterion is not matched, go to Step 2, otherwise, go to Step 6.
Step 6: The particle corresponding to the global extreme value is the optimal solution of the population, that is, the identified parameters of the robot manipulator.
The detailed PSO algorithm procedure for parameter identification is depicted in Figure 2.

Flowchart of PSO for parameter identification. PSO: particle swarm optimization.
Excitation trajectory design
To decrease the influence of measurement noise in estimating
where
Convergence rate of the parameter estimation and the noise rejection depend on the condition number of identification matrix, and it should be ensured that the objective function of optimization is to minimize the number of conditions. Thus, the condition number of identification matrix is taken as the fitness function in PSO algorithm, and the initial population is designed according to motion constraints of robot joints. The excitation trajectory optimization with the motion constraint can be described as 11
where
Experimental results
The identification procedure was implemented on the 6-DOF Kinova Jaco2 robot manipulator as shown in Figure 3. This robot manipulator has six rotation joints, including two base joints, one elbow joint, and three wrist joints. The joints of the robot manipulator have speed limitations at 48° s−1. The position encoders and the built-in torque sensors are fixed on all joints, all of six joints can provide the joint torque as well as the measured information of joint position, velocity while working. The classic Denavit-Hartenberg (DH) parameters for the 6-DOF Kinova Jaco2 robot manipulator are given in Table 1.

6-DOF Kinova Jaco2 manipulator. DOF: degrees of freedom.
The classic DH parameters for Kinova Jaco2 manipulator.
Figure 4 shows the optimized excitation trajectories with the base frequency of 0.1 Hz. The excitation trajectories are the parameterized five-term Fourier series given in equation (19), containing 11 optimum parameters for each Fourier series. All the optimum parameters are presented in Appendix 1.

Optimized trajectory of the joints.
The optimal excitation trajectories

The end-effector path in Cartesian during the excitation trajectory.
To highlight the performance of the proposed method, comparison with the BBO method 10 and the CS algorithm 12 is performed for the same excitation trajectory. Parameter identification procedure using the above three algorithms is performed in MATLAB 2016b environment. The parameter settings for the three algorithms are given in Table 2.
Parameters for PSO, BBO, and CS algorithm.
PSO: particle swarm optimization; BBO: biogeography-based optimization; CS: cuckoo search.
The max iteration number is set to 100 for all the algorithms and the results of parameter identification are obtained based on 10 independent runs. Figure 6 shows the solving process of the three algorithms, the result of fitness function decreases with the increase of iteration. When iterations reach 55, the optimization process of the PSO algorithm tends to be stable and the optimal result of fitness function is 2.7273, whereas those of BBO and CS were 27.8158 and 40.0971, respectively. The final optimization results which are calculated by equation (17) are 0.9293, 1.7815, and 1.9622 corresponding to the PSO, BBO, and CS algorithm, respectively. The results turned out that the PSO algorithm has a faster convergence rate and a better result than the BBO and CS algorithm. The identified dynamic parameters obtained from the PSO algorithm using the optimal excitation trajectories are shown in Table 3.

Optimization process for the three algorithms.
The identified dynamic parameters of 6-DOF Kinova Jaco2 manipulator.
Figure 7 shows the comparison of the estimated joint torque based on the identified parameters for each joint with the actual torque (obtained with built-in torque sensors). All the estimated joint torque of the three algorithms can track the actual torque in all the joints, which implied that the estimated torques can be remodeled based on the identified parameters and the data of joint motion. It can be also observed that the estimated torques obtained with the PSO algorithm match better with the actual torque than the BBO and the CS algorithm, which highlights that the PSO algorithm has a good performance of global searching and obtained the optimal parameters for robot manipulator. It should be noted that the estimated torque not match well with the actual torque and the estimated torque errors increase during joint velocity reversal. It is mainly due to the bias of parameter estimation, the unmodeled dynamics, and the nonlinear friction which is not included in the model.

The comparison of the estimated torque by the three algorithms with the actual torque: (a) torque of the joint 1, (b) torque of the joint 2, (c) torque of the joint 3, (d) torque of the joint 4, (e) torque of the joint 5, (f) torque of the joint 6.
To quantitatively evaluate the performance of the identified model by using the PSO, BBO, and CS algorithm, the root mean square (RMS) error between the estimated joint torque and the actual torque from tracking the optimal excitation trajectories are compared. The RMS error is defined as 31
where
A comparison of RMS error between the estimated joint torque and the actual torque.
PSO: particle swarm optimization; BBO: biogeography-based optimization; CS: cuckoo search.
To validate the efficiency of the identified parameters applying to external force estimation by the proposed method, the elastic impact experiment was carried out. The experimental setup was composed by the Robotiq FT 300 Force Torque Sensor and the spring with elastic constant of 1.12 N/mm, the spring was attached to Robotiq Force Sensor, as shown in Figure 8. It should make sure to keep the posture of the end effector approximately perpendicular to the horizontal plane, so that the spring maintain perpendicular to force sensor as much as possible. The manipulator was commanded to accomplish an up–down movement with the period of 5 s.

Experimental setup for an elastic impact.
The comparison of the actual torques with the estimated torques based on the identified parameters by the three algorithms is shown in Figure 9. The known models can only track the movement induced by inner torque of robot manipulator during the spring compression, and yet the actual torque included the inner torque and external torque acting on the joints. Thus, the external torque can be derived from the difference of the actual torque and the estimated torque. It should be note that the main effort for the movement of end effector was realized by joints 2, 3, and 4 during compression. The external torques exerted on joints shown in Figure 9 were given by equation (10), which considered the external torque as the unknown disturbance to the robot manipulator.

The comparison of the actual torques with the estimated torques: (a) the joint 2, (b) the joint 3, and (c) the joint 4.
Based on the estimated external torques of joints (see Figure 9), the estimated external forces acting on the robot end effector can be calculated by equation (13). Figure 10 shows estimated external forces and the measured forces (obtained with Robotiq FT 300 Force Torque Sensor) in the Z direction. The difference between the measured force and the estimated force in the Z direction is shown in Figure 11. As can be seen, the external force estimated by the three algorithms has the same trend as the measured force in terms of magnitude and frequency, which revealed the estimated external force has high linearity to the spring response. However, the external force estimated by the PSO algorithm matches better with the measured force in magnitude. The RMS error of the estimated external forces acting on the robot end effector by the three algorithms is compared in Table 5.

The comparison of the measured force with the estimated force in the Z direction.

The difference between the measured force and the estimated force in the Z direction.
RMS error of the estimated external forces for the three algorithms.
From these results we can observe that the RMS error of the external force estimated by the PSO algorithm is smaller than those of other algorithms, which highlights the precision of the external force estimation by the proposed method.
Conclusion
In this article, we developed a new method to estimate the external forces without force sensor based on the identified model together with the built-in torque sensor. The optimal periodic excitation trajectories are designed for parameter identification, and all the unknown parameters for the model of a 6-DOF robot manipulator are identified by the proposed algorithm. The identified results showed that the proposed algorithm has fast convergence rate and higher identification accuracy compared with the BBO algorithm and the CS algorithm. Further, we conducted the elastic impact experiments to confirm the validity of the identified parameters applying to external force estimation, and the experimental results demonstrated that the proposed external force estimation method can successfully estimate the external force acting on the end effector of the robot manipulator with an RMS error of 0.7 N. This method can be not only a cost-effective alternative to the conventional force sensors but also a feasible solution for redundant force sensing in radioactive environment. In the future, we would focus on the controller design based on the estimated external force.
Footnotes
Appendix 1
The parameters of the excitation trajectory for Fourier series are listed as follows:
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed the receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Natural Sciences Foundation of China (62071213) and the Scientific Research Fund of Hunan Provincial Education Department (18C0478).
