Abstract
While the artificial potential field has been widely employed to design path planning algorithms, it is well-known that artificial potential field-based algorithms suffer a severe problem that a robot may sink into a local minimum point. To address such problems, a virtual obstacle method has been developed in the literature. However, a robot may be blocked by virtual obstacles generated during performing the virtual obstacle method if the environments are complex. In this article, an improved virtual obstacle method for local path planning is designed via proposing a new minimum criterion, a new switching condition, and a new exploration force. All the three new contributions allow to overcome the drawbacks of the artificial potential field-based algorithms and the virtual obstacle method. As a consequence, feasible collision-free paths can be found in complex environments, as illustrated by final numerical simulations.
Introduction
Performing missions for autonomous aerial and ground vehicles usually requires planning optimal collision-free paths in situ (or in real time) from its current position to a target point. It is well-known that the real-time path planning is challenging, especially when the environments are full of complex obstacles. To address this challenging issue, a large number of algorithms for path planning have been proposed or developed in the literature. 1 –5 In general, the algorithms for path planning can be classified into two categories, that is, calculus- and graph-based ones. Although the calculus-based path planning techniques can generate optimal paths, they usually suffer from high computational cost, which makes the calculus-based methods non-applicable for real-time missions. Although the graph-based path planning methods also have some disadvantages, such as suboptimality, sharp, and nonnegotiable corners due to the discretization of workspace, these disadvantages can be overcome by applying well-developed methods for flyable or movable trajectory generation.
According to available information of the environment, the graph-based path planning algorithms usually include two categories: (1) local path planning and (2) global path planning. The global path planning takes into account the overall environmental information, and the optimal path planning can be planned off-line. In fact, there are some well-developed global path planning algorithms, such as grid-based method (e.g. A* algorithm 6 ) and sampling-based method (e.g. the probabilistic roadmap method, 7 and the Rapidly-exploring Random Tree (RRT) method 8,9 ).
Contrasting with the global path planning, the local path planning is usually employed if the global information of environment is not available due to the limited range of detection sensors. As the computational cost of local path planning is lower in comparison with the global path planning, it is more suitable for real-time applications. For this reason, extensive studies have been done on designing local path planning algorithms. Liu and Arimoto 10 introduced a method for path planning by computing the tangent graph of obstacles. Based on Monte Carlo method, a reactive randomized algorithm was proposed by Savkin and Hoy. 11 Both the methods 10,11 are computationally expensive in some special environments so that they may not be able to generate feasible paths in real time. By assuming that the target lies outside the convex hull of obstacles, an online planner was developed by Shiller. 12 However, this online planner may not find a feasible path to the target if the detection range is smaller than the radii of obstacles. In addition to the three methods, there are two main kinds of algorithms for local path planning. The first kind is related to those based on the artificial potential field (APF) 13 –15 and the rest is of intelligent methods, like the genetic algorithm 16 and the swarm particle algorithm. 17
The core idea of the APF-based methods is to create some artificial potentials and to plan feasible paths from current location to the target according to the forces generated by the artificial potentials. 14 While the APF-based methods provide a good trade-off between the computational effort and the quality of the collision-free paths, it also has some inherent limitations. For instance, the APF may have many local minimum points where the overall force generated by the APF is zero so that the robot will be trapped at those points. Some improvements to the classical APF-based methods have been proposed in recent years. Chen et al. 15 and Sfeir et al. 18 redefined the potential function so that the distribution of the virtual force was improved to reduce the number of local minimum points. Instead of eliminating the local minimum points, virtual obstacles and virtual potentials 19,20 were proposed to help a vehicle to escape from local minimum points. More recently, Zhu et al. 21 used some intelligent techniques, for example, “follow way” strategy, to escape from local minimum points.
Among the aforementioned improvements on the classical APF-based methods, the virtual obstacle method (VOM) 19,20 is probably the most powerful algorithm to avoid local minimum points. However, it is found that when a robot moves to the corner of an L-shaped tunnel, the virtual obstacles of the VOM will block the way to the target. In addition, the criterion, defined in the VOM to estimate if or not a robot is trapped into a local minimum point, is not applicable in some special environments, as analyzed in the section of review on APF-based methods.
To guarantee an autonomous robot to find a collision-free path in complex environments, an improved VOM is developed in the article by proposing a new reliable criterion, a new switching condition, and a new potential force. This improved VOM allows to find collision-free paths in complex environments, as illustrated by the two final numerical simulations.
The remainder of this article is organized as follows: In the section of preliminaries, the general mathematical model for graph-based path planning problem is formulated, and the potential functions of APF-based methods are recalled. Then, after reviewing the drawbacks of the conventional APF method and the VOM, an improved VOM is developed. Finally, some numerical examples are simulated, illustrating the viability of the improved VOM in comparison with the conventional APF method and the VOM.
Preliminaries
In this section, the mathematical model for general graph-based path planning problems is established, and the potential functions, which will be used by the APF method and the VOM, are presented.
Mathematical model
Let X be the state space of the two-dimensional plane. Denote by
Problem 1
The path planning problem consists of finding a collision-free path
The APF-based methods, such as the conventional APF method 13,14 and the VOM, 19,20 are probably the most popular methods for addressing such path planning problems. As stated in the “Introduction” section, the conventional APF method and VOM may not find collision-free paths in complex environments. In this article, we will present an improved VOM in the framework of the APF method. Before proceeding to the improved VOM, we first present the potential functions in the next subsection, which are fundamental and necessary for the subsequent analyses.
Potential functions
The core idea of the APF-based methods is that some virtual repulsive and attractive potentials are defined in the field X so that a collision-free path from the initial point to the target can be found by following the forces generated by those virtual potentials. Note that the destination of the path planning problem is to reach the target. Hence, an attractive potential should be defined around the target. The attractive potential function at the target is commonly given by
where
Meanwhile, a repulsive potential given by Kim and Khosla 22 to repel the robot from each obstacle is expressed as
where
where
The total repulsive force then can be expressed as
In addition to the attractive force in equation (2) and the repulsive force in equation (5), another kind of force, namely, rotational force, is usually employed by APF-based methods. 23 The main role of the rotational force is to make sure the path around each obstacle to be parallel with its surface so that the trajectory around each obstacle is smoother. In general, the rotational force is generated by a rotational vector field. Around the ith obstacle, the rotational force is commonly given by
where
where
To this end, by summing up all the potential forces in equations (2), (5), and (7), the overall potential field force in the state space X are expressed as
where
Review on typical APF-based methods
Given the overall potential force in equation (8), two typical APF-based methods, including the conventional APF method 8 and the VOM, 20 will be reviewed in this section.
The conventional APF method
As a matter of fact, the conventional APF method is a straightforward application of the overall potential force, 8 as shown in Algorithm 1.
Conventional APF method.
Once each obstacle has a convex-like shape and far away from others, the conventional APF method performs well in finding collision-free paths. However, the conventional APF method may not find a feasible path to the target if there are some concave-shaped obstacles, as illustrated in Figure 1. Note that at point A in Figure 1, the overall potential force in equation (8) generated by the concave-shaped obstacle and the target can be zero. In such a case, the conventional APF method in Algorithm 1 will be trapped at point A instead of making a step forward (see line 5 in Algorithm 1). Therefore, the conventional APF method may fail to find collision-free paths once there are local minimum points where the overall potential force is zero.

The existence of a local minimum point (where the overall potential force is zero) in an environment with a concave-shaped obstacle.
Virtual obstacle method
To address the local minimum point issue encountered by the conventional APF method, a virtual obstacle concept has been proposed. 20 The core idea of the virtual obstacle concept is first to introduce a criterion to determine if or not a robot is trapped into a local minimum point. The criterion is given by
where
VOM.
Although the VOM performs better than the conventional APF method, as it is seen by comparing Figures 1 and 2, it should be noticed that the criterion in equation (9) may lead a robot to make a wrong decision. Taking the scenario in Figure 3 as an example, the robot will be trapped if P 1 and P 2 are too close so that equation (9) is met. In addition, for some specific obstacles, such as the one presented in Figure 4, the virtual obstacle will block the only way to the target. All in all, the VOM may still fail to find a feasible collision-free path even though it has been improved in comparison with the conventional APF method.

A collision-free path generated by the VOM. VOM: virtual obstacle method.

The robot is blocked at P 1 if P 1 and P 2 are close enough.

The way to the target is blocked by a virtual obstacle.
Improved VOM
To address the aforementioned issues of the VOM, an improved VOM will be established in this section, by defining a new local minima criterion, a new exploration force, and a new switching condition.
Local minima criterion
Since the local minima criterion in equation (9) may make a wrong decision, we design a new local minima criterion
where
Exploration force
To solve the blocking issue of the VOM, some attractive potentials should be added around those states that have never been reached within the range of measurement, defined as

The range of the sensor and
where
Then, the improved global potential force, denoted by
This new overall potential force will be used to generate feasible collision-free path later.
Switching condition
Based on the development in the previous subsection, an improved VOM consists of two modes: the conventional mode and the exploration mode. While only the VOM is used to generate path in the conventional mode, both the exploration force and the VOM will be combined in the exploration mode. The switching condition between the two modes will be designed in this subsection.
In principle, the switching condition consists of three criteria. The first criterion is the one defined in equation (10), which determines whether or not the robot is sank into a local minimum point. The second criterion is defined by
where
According to the above developments, the improved VOM is described in Algorithm 3. It is worth mentioning here that the efficiency of the improved VOM is comparable to the conventional VOM because computing the new defined conditions is not time-consuming. In the next section, the new algorithm will be tested by two complex environments.
Improved VOM.
Numerical simulations
In this section, we consider two maze-like environments, as shown in Figures 6 and 7, to illustrate the improved VOM by comparing with the conventional APF method, the VOM, A* algorithm, and RRT* algorithm. The parameters of the example are given as follows:
the range of sensor is 1.2 m, indicating that the robot can detect obstacles up to only 1.2 m from itself;
the obstacles in the environment have three types of shape: (1) concave-shaped obstacle, (2) bar-shaped obstacle, and (3) cylindrical-shaped obstacle;
the reachable range is 1.0 m which means that only the state within 1.0 m around the robot will be marked as reachable state.

Case A.

Case B.
Case A
As for the environment of Figure 6, the path generated by the conventional APF method in Algorithm 1 is shown in Figure 8. It is clear from Figure 8 that the conventional APF method cannot find a feasible path from the initial point to the target. The reason is that the overall potential force at the end of the generated path is zero.

Case A: the path generated by the conventional APF with a local minimum point. APF: artificial potential field.
The conventional VOM in Algorithm 2 is also used to generate path, which is presented in Figure 9. Although the VOM tries to escape from local minimum points by employing virtual obstacles, the virtual obstacles blocked the way to the target, as shown by the solid circles in Figure 9. Finally, the improved VOM (Algorithm 3) developed in the article is used, and a feasible collision-free path is found, which is depicted in Figure 10.

Case A: the path generated by the conventional VOM with blocking Issue. VOM: virtual obstacle method.

Case A: the path generated by the improved VOM. VOM: virtual obstacle method.
Case B
Analogously, the conventional APF method, the VOM, and the improved VOM are all employed to generate collision-free paths in the environment of Figure 7. The path generated by the conventional APF method is shown in Figure 11, illustrating that the robot is trapped in a local minimum point. Figure 12 shows the path generated by the conventional VOM, indicating that the robot cannot find the way to the target because the virtual obstacles blocked the way to the target. Finally, the path generated by the improved VOM is shown in Figure 13.

Case B: the path generated by the conventional APF. APF: artificial potential field.

Case B: the path generated by the conventional VOM. VOM: virtual obstacle method.

Case B: the path generated by the improved VOM. VOM: virtual obstacle method
To show the efficiency of the improved VOM, it is also compared with two typical path planning algorithms: A* algorithm and RRT* algorithm. The average time to find the paths for case A and case B by each algorithm is listed in Table 1. It is clearly seen from Table 1 that the improved VOM consumes just around 16% computational time of A* algorithm. However, both the conventional VOM and RRT* algorithm cannot find feasible paths for case A and case B due to the blocking issue and the local minimum points.
Average time to find the path.
VOM: virtual obstacle method; IVOM: Improved virtual obstacle method.
All in all, it is concluded from the above simulations that the improved VOM, by addressing the blocking issues that are encountered by the VOM, can find feasible collision-free paths in complex environments and it is more efficient than A* algorithm.
Conclusions
As the APF-based methods, including the conventional APF method and VOM, may not generate feasible collision-free paths in complex environments, an improved VOM is proposed in the article. Once the robot is trapped in a local minimum point, a new potential force is added to the APF to help the robot bypass the local minimum point, addressing the blocking issue. As the conventional local minima criterion may lead to a wrong decision, a new local minima criterion is designed. Since an exploration force is added to address the issue that the path may be blocked by virtual obstacles, the improved VOM has two modes: the exploration mode and the conventional mode. In the article, a switching condition for the switching between the two modes is devised. All these contributions allow the improved VOM to generate feasible collision-free path in complex environments, as shown by the final numerical simulations. Future work will consider to extend the improved VOM so that it can tackle more practical scenarios, such as large-scale and dynamic environments.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Natural Science Foundation of China [Grant No. 61903331].
