Abstract
Ant colony algorithm or artificial potential field is commonly used for path planning of autonomous vehicle. However, vehicle dynamics and road adhesion coefficient are not taken into consideration. In addition, ant colony algorithm has blindness/randomness due to low pheromone concentration at initial stage of obstacle avoidance path searching progress. In this article, a new fusion algorithm combining ant colony algorithm and improved potential field is introduced making autonomous vehicle avoid obstacle and drive more safely. Controller of path planning is modeled and analyzed based on simulation of CarSim and Simulink. Simulation results show that fusion algorithm reduces blindness at initial stage of obstacle avoidance path searching progress and verifies validity and efficiency of path planning. Moreover, all parameters of vehicle are changed within a reasonable range to meet requirements of steering stability and driving safely during path planning progress.
Keywords
Introduction
Statistics show that traffic accidents account for 90% of safety accidents around the world, among which more than 80% casualties were confirmed in traffic accidents. 1 For autonomous vehicle, an effective and stable obstacle avoidance path planning algorithm plays an important role in reducing such accidents significantly.
To some extent, obstacle avoidance path planning of autonomous vehicle is similar to obstacle avoidance robots. Vehicle dynamics, traffic regulations, and road adhesion coefficient should also be considered when it comes to obstacle avoidance path planning for autonomous vehicle. Main advanced path planning methods applied for autonomous vehicle are artificial potential field model, 2 –5 Dijkstra algorithm, ant colony algorithm and particle swarm optimization, and so on. 6 Fast algorithms are presented by Nash et al. for discrete state spaces, but those algorithms tend to produce paths of which nonlinear constraint of autonomous vehicle is taken into account. 4 Jia et al. 7 introduce a model predictive path tracking controller to consider effects of vehicle dynamics and actuators’ limitations in path tracking, which can be used to solve problems that the planned path is not feasible to be traced by autonomous vehicle.
A new fusion method combining ant colony algorithm and improved potential field that is used for path planning is proposed in this article. 8 An appropriate path which considering the constraint of vehicle dynamics, traffic regulations, and road adhesion coefficient can be planned by using this fusion method. In the initial stage of path planning, pheromone concentration used for path searching is insufficient, transfer probability function of ant colony algorithm is adjusted by introducing improved potential field as heuristic information, and weight is introduced to consider influence of road adhesion coefficient and vehicle speed on choice of path. Role of improved potential field reduces gradually, pheromone concentration and function of heuristic information start to work with deepening of path planning process. Research results show that the new fusion method can reduce the number of iterations used in path searching progress, avoid stagnation and blindness in initial stage, and improve the efficiency of path planning for autonomous vehicle.
Typical structure of autonomous vehicle is shown in Figure 1. It consists of three parts, including external sensors, control system, and actuators. Risk of traffic accidents will be found reasonably by using external sensors like camera, millimeter wave radar, high-definition map, and Global Positioning System. Control system of autonomous vehicle can be divided into planning layer and control layer. Reasonable decisions will be made by planning layer according to the data of external sensors, and then instructions will be transmitted to actuators by control system.

Typical structure of autonomous vehicle.
In the second section, methods that extract image information in process of environmental perception are presented. In the third section, path planning considering vehicle dynamic, traffic regulation, and road adhesion coefficient is planned by fusion method. In the fourth section, obstacle avoidance path planning system is evaluated with a high-fidelity CarSim simulation and the results are presented and discussed. The fifth section concludes the article.
Environment perception
Detecting environmental information around autonomous vehicle is of great importance to path planning in complex and dynamic environment. 9 Current research shows that environmental perception based on single external sensor is restricted by less information and more complex algorithm, which is difficult to satisfy the requirements of real-time detection and high robustness during driving process. Therefore, multi-sensor (camera and radar) fusion technology 10 is used to make up the limitation of single sensor, especially in complex and dynamic environment. Meanwhile, robustness of path planning algorithm would be improved. Figure 2 shows the outline of fusion system between radar and vision.

Outline of radar and vision fusion system.
Methods will be used to unify data obtained by different sensors into same coordinate system for increasing the accuracy of information fusion. Detected environmental information was extracted into global coordinate system through coordinate transformation, so as to confirm the position of obstacles (pedestrians, vehicles, etc.) in real time. Coordinate system of radar, camera and their projection coordinate system are established respectively. radar detection plane is perpendicular to the longitudinal axis of the vehicle,optical axis of the camera is parallel to longitudinal axis of the vehicle after calibration. Figure 3 shows the schematic diagram of coordinate conversion. Location of obstacles confirmed by sensors will be converted to image coordinate system by the following formula 11

Coordinates conversion of radar and camera.
In equation (1), cx and cy denote offset of axis, f is focus distance of camera, lx is distance between radar projection coordinate system and x-axis in world coordinate system, ly is distance between radar projection coordinate system and y-axis in world coordinate system, h is height of camera installation, and θ is pitching angle of camera.
It is known to us that region of interest refers to areas which represent image content mostly, and plays an important role in image processing. Features of image detected by sensor during environmental perception progress are vividly shown in Figure 4.

Features extraction.
In Figure 4, different color boxes are used to mark vehicles, pedestrians, bicycles, and so on. All above-marked image information make preparation for confirming the distance between obstacle and autonomous vehicle.
Path planning
A new path considering vehicle dynamic, road structure, traffic regulation, and road adhesion coefficient is planned by fusion method.
Vehicle dynamic model
The main purpose of this part is to make autonomous vehicle manipulate accurately and steadily, so calculation time of control algorithm is reduced by neglecting influence of suspension factors and simplifying dynamic model. Vehicle dynamic model 12 with two degrees of freedom (DOF) contains most of motion characteristics of vehicle in actual driving process. Notation used in vehicle dynamic model is shown in Figure 5.

Vehicle dynamic model with two DOF. DOF: degrees of freedom.
It is assumed that autonomous vehicle relies on front wheels for steering, and motion equations of vehicle dynamic model with two DOF are
In equation (2), v, u, and γ denote lateral velocity, longitudinal velocity, and yaw rate of vehicle;
In equation (3),
Differential equation of vehicle motion with two DOF is obtained as follows
Vehicle linear dynamics can then be obtained by linearizing equations (2) to (5)
In equation (6), δ is input parameter, x is state vector, A is state matrix, and B is input matrix.
The above vehicle dynamic model with two DOF is discretized by zero-order hold method and utilized for model predictive path planning controller.
Estimation algorithm for adhesion coefficient
According to typical road μ-s curves shown in Figure 6, road adhesion coefficient reaches peak when slip rate is about 0.16, which is called peak adhesion coefficient of pavement. In addition, there are some differences between different types of pavement. For snow- and ice-covered road, the relationship between adhesion coefficient and slip rate is relatively smooth, besides the available adhesion condition of road surface is also small. 14

Schematic diagram of pavement adhesion coefficient estimation.
Chang-gang et al. fitted a semi-empirical road and tire mathematical model by computer simulation. 15 Expression of this model is shown as follows
In equation (7), μ denotes road adhesion coefficient; s is slip rate; and c 1, c 2, and c 3 denote constant value obtained by fitting. Table 1 shows Burckhardt tire model parameters.
Parameters of Burckhardt tire model.
It is necessary to know the potential peak adhesion coefficient of current road in order to obtain the maximum road adhesion. On the basis of Burckhardt model, variation range of peak adhesion and optimal slip rate for six typical pavements are obtained by computer simulation, as shown in Table 2.
Peak adhesion coefficient of six typical pavements.
In this way, adhesion coefficient can be estimated based on typical road surface which is more similar to tested road surface. Based on the idea of analogy, the relationship between peak adhesion coefficients is presented as follows
In equation (8),
Improved potential field
Artificial potential field method was first proposed by Khatib and applied to robot local path planning 16 in the 1990s. It is a field generated by road structure, traffic regulations, and target goal to lead autonomous vehicle toward destination.
Figure 7 gives schematic diagram of partial path planning under multiple restrained conditions. Path planning is affected by gravitation model of multi-category objects while satisfying traffic regulations and vehicle characteristics. The functions presented below are explicit introduction of two types of virtual gravitation model and one kind of virtual repulsion model.

Path planning under multiple restrained conditions.
Gravity model of safety lane change:
Vehicle needs to change lanes when there are traffic participants ahead or other conditions that hinder normal driving in process of traveling
In equation (9),
This article sets up different driving modes and observes change of vehicle parameters to verify the validity of lane changing model, with simulation of CarSim and Simulink. Simulation parameters are set as follows: frontal area (A) of vehicle is 1.6 m2, drag coefficient (fw
) is 0.3, the rolling resistance coefficient (fr
) of vehicle is 0.014, and road adhesion coefficient (
Vehicle travels at speed of 30 km h−1, 50 km h−1, and 100 km h−1, respectively. Lane changing operation is carried out under the effect of lane changing gravity. Figure 8 shows changes of vehicle characteristic.

(a) Curve of vehicle trajectory, (b) curve of steering, and (c) curve of lateral acceleration.
As shown in Figure 8, the trajectory of vehicle is smooth, which makes vehicle stability. Lateral acceleration changes from −0.15 g to 0.15 g and the steering wheel angle decreases with increase of vehicle speed, which ensures vehicle travels more safety and provides better driving experience. 2. Virtual gravity model of global route
In equation (10),
Vehicle travels in descent direction of potential gradient with 40 km h−1 speed. Speed limits of front section are 80 km h−1 and 40 km h−1, respectively. Changes of longitudinal speed and acceleration are shown in Figure 9 under the influence of global gravitation.

(a) Curve of longitudinal speed and (b) curve of longitudinal acceleration.
As shown in Figure 9, under influence of global gravitation, vehicle accelerates to reach speed of 80 km h−1 gradually, alters to deceleration after speed limit changes to 40 km h−1. Virtual gravitation of global planning can guide vehicle travels with the speed approaching to current limit. 3. Virtual repulsion model of lateral direction
In equation (11),
Road structure Potential field (PF) is typical case of virtual repulsion model in lateral direction; it is defined with quadratic functions, and their gradients increase linearly with reduction of safe distance. The further the vehicle deviates from road center line, the greater the virtual potential field repulsion force of road boundary. Figure 10 shows road boundary repulsion model of lateral direction.

Road boundary repulsion model of lateral direction.
Consequently, it is important to verify the validity of established model under the influence of road boundary repulsion, with simulation of CarSim and Simulink. 17 Figure 11 shows some results partial.

(a) Curve of longitudinal speed, (b) curve of acceleration change, and (c) curve of steering wheel angle.
We can conclude from Figure 11 that vehicle position is corrected by road boundary repulsion constantly, making vehicle travel along the path, avoiding occurrence of deviating from the lane. 4. Virtual repulsion model of traffic lamp
In equation (12),
In order to verify the validity of established model, some parameters in simulation are set as follows: distance between vehicle and traffic light is 100 m, the influence range of signal lamp is 40 m, and vehicle moves at constant speed of 50 km h−1.
As shown in Figure 12, the vehicle will glide and decelerate under the influence of rolling resistance. Braking system of the vehicle starts to work after entering the range which is affected by virtual repulsion of traffic lights. Evidently, vehicle speed drops rapidly, completes braking before reaching the station of signal lamp.

(a) Curve of distance between vehicle and traffic lamp, (b) curve of longitudinal speed, and (c) curve of longitudinal acceleration.
5. Virtual repulsion model of front participants
In equation (13),
In order to verify the validity of established model, some parameters in simulation are set as follows: speed of front traffic participants is 20 km h−1, distance between ego vehicle and front traffic participants is 60 m, and vehicle travels along the path with speed of 80 km h−1. Changes of vehicle characteristic are shown in Figure 13.

(a) Curve of distance between ego vehicle and front vehicle and (b) curve of longitudinal speed.
As shown in Figure 13, virtual repulsion force of front participants is greater than gravity force of global route when distance between ego vehicle and front vehicle is less than the threshold value specified by safe distance model. Consequently, vehicle decelerates the speed to keep a safety distance from front participants so as to avoid collision, vice versa.
Path planning
Improvement of transfer probability function
Transfer probability function of basic ant colony algorithm that is applied to path problem is
In equations (14)
to (16),
In initial stage of path planning, pheromone concentration used for path search is insufficient. Drivable path waiting for selection is obtained by using improved potential field algorithm, vehicle travels along the path with the fastest descent of potential field force gradient due to resultant force of improved potential field. With deepening of path planning, pheromone concentration on searching path reaches the threshold value, the role of improved potential field is reduced. In order to reduce blindness/randomness and avoid stagnation at initial stage of path planning, Path searched by ant colony algorithm according to the path enlightened by artificial potential field algorithm. The entire process can be described with the following flowchart (Figure 14). 18

Flowchart of fusion algorithm.
Resultant force of improved potential field which is established under multiple constraints is formulated as follows
Transfer probability function of ant colony algorithm is adjusted by introducing resultant force of improved potential field as heuristic information, weight is introduced to consider the influence of road adhesion coefficient and vehicle speed on choice of path. Information function enlightened by resultant force of improved potential field is formulated as follows
In equation (18), γ is factor of heuristic information;
Transfer probability function of ant colony algorithm is improved as follows
Adjustment of pheromone update strategy
Ants will release pheromone on entire trajectory after completing one path searching loop. Not only global path but also local path needs are to be considered when it comes to pheromone update. It is necessary to adjust or replan local path due to real-time changes of driving information currently, such as traffic accidents, congestions, and other situations. This article improves pheromone update rule of basic ant colony algorithm, 19 introduces pheromone update strategy of local path. Adjust pheromone update strategy dynamically based on convergence results of path search.
Updating rules of pheromone globally from point S to point E are as follows
In equation (22), denotes volatilization coefficient of pheromone in global path. Q is pheromone concentration that determines the convergence rate of algorithm; Tk is the time which vehicle travels current path; represents extra pheromones added after elite vehicles travel from point S to point E; σ is number of elite vehicles.
Updating rules of local pheromone are as follows
In equation (24),
Results
Test scenarios
As is known to all, roads are complex and dynamic environments with obstacles moving at different speeds in different lanes and positions. Road itself might be curved, and lane might end or begin. Moreover, autonomous vehicle might be required to change its lane to take an exit or turn.
19
Some normal scenarios for an autonomous driving assistance system are: lane keeping on structured road; lane changing with no obstacle in vicinity; keeping a desired distance between front and rear vehicle.
In this article, two test scenarios are constructed to evaluate the performance of path planning based on fusion algorithm, including no traffic accident risk scenario and existence of traffic accident risk on planned path, respectively. Autonomous vehicle should be able to predict movement trend of obstacles and avoid accidents while keeping its lane, which is performed by keeping an appropriate distance from obstacles via accelerating/decelerating or steering. In general, the above conditions are appropriate for evaluating the performance of path planning system on basis of observing road structures, safety-traffic regulations, obstacle avoidance, and lateral maneuverability. The following two test scenarios are defined based on the above conditions. 20,21 Figure 9 shows schematic diagram of two typical test scenarios.
In scenario 1, autonomous vehicle will drive in a structured road environment and its lane ends in 650 m. Vehicle coordinate system is established based on center of gravity (COG). Shield non-approach repulsive force in lateral direction according to the shield theory. Lane keeping capacity and force acting on autonomous vehicle under virtual artificial potential field are analyzed. As is shown in Figure 15(a), virtual gravity acts on the point of P at the extension line of vehicle longitudinal axis.

(a) Without traffic accident risk and (b) existence of traffic accident risk.
According to the formula of virtual repulsion and gravitation, the force and moment models shown in the following expressions are established
In equation (25), α is angle (point p) between virtual gravity and longitudinal axis of autonomous vehicle,
Lateral virtual repulsion force plays an important role in keeping autonomous vehicle in its lane. During driving process, yaw rate of vehicle should be controlled within a reasonable range. In order to prevent overlap of lateral repulsive forces produced by different types of objects from causing unreasonable lateral movement of autonomous vehicle, shielding idea is used to shield lateral virtual repulsion produced by non-approach objects, and only virtual repulsion which is produced by objects in vehicle vicinity will be retained. By analyzing the relationship between yaw rates and steering angle, lane keeping and planning function of steering system under lateral virtual repulsion is established as follows
Gao et al. 20 evaluate yaw rate based on multiple signals of wheel speed
In equation (27),
In equation (28),
In scenario 2, due to lack of observation, pedestrians or cyclist appeared in front of autonomous vehicle suddenly. Typical braking process is that drivers will perceive surrounding environment through vision, hearing, and other feeling, realizing that braking should be carried out under emergency situation, and then put down brake pedal for emergency braking until the autonomous vehicle stops. Safe distance model of this process is
In equation (29),
It is known to us that collision cannot be avoided if distance between pedestrians, bicycles, and ego vehicle is less than minimum safety distance. At this point, a signal of steering control must be applied, and autonomous vehicle should choose an obstacle-free path to avoid collision by controlling steering operation of steering wheel. What’s more, it should not be ignored that position information of pedestrians, bicycles, and others which appeared suddenly needed to be studied before choosing a new path. 21 Motion coordinate system is established with vehicle’s front position as the origin of coordinate system, lateral direction as X-axis, and longitudinal direction as Y-axis. Suppose that under ideal circumstances, pedestrians and bicycles move to left from right side of vehicle at a speed of 1 m s−1 and 5m s−1, respectively. In this process, not only the speed of autonomous vehicle has changed, but also the speed of pedestrians and bicycles will change when they observe autonomous vehicle coming not far from their later direction. Their speed changes are expressed in Figure 16.

Motion information of pedestrian or bicycle.
It can be seen from Figure 16 that distance of pedestrians’ or cyclist’ movement from right to left (X-axial direction) is function of velocity with time. Therefore, minimum lateral distance between changed path and pedestrians (cyclist) is
In equation (30), d is vehicle’s width, VP is initial walking speed of pedestrian, Vc is initial walking speed of cyclist, aP is pedestrian’s braking deceleration, and ac is bicycle’s braking deceleration. Lateral distance is expressed as a function of distance with time.
Simulation
In order to verify the validity and effectiveness of path planning, CarSim and Simulink are simulated to evaluate the performance between basic ant colony algorithm and fusion algorithm method. CPU of simulation platform is Intel core i7-5500U, the RAM is 8.00 GB, the MATLAB version is R2014a, and the CarSim version is 8.1. Figure 17 shows comparisons between basic ant colony algorithm and fusion algorithm method on individual fitness and iteration times of path searching progress.

(a) Curve of pheromone concentration increment, (b) curve of iteration times under the influence of pheromone concentration, and (c) curve of convergence.
As vividly shown in Figure 17, pheromone concentration increment affected by improved fusion algorithm increases faster than that affected by ant colony algorithm. It reaches to the set threshold (
Benefit from the dynamic adjustment of pheromone update strategy, efficiency of path searching can be adjusted according to pheromone coefficient volatilization. In a certain range (0.3–0.7), increase of pheromone volatilization coefficient will improve path searching efficiency. Basic ant colony algorithm needs 32 iterations to converge to the optimal path, while improved fusion algorithm needs 14 iterations to achieve optimal path. Table 3 shows comparison of simulation results.
Comparison of simulation results.
The vehicle system used for simulation in CarSim software is a model of advantage driving assistance system. Variation of vehicle dynamic parameters during typical path planning progress is shown in Figure 18.

Variation of all vehicle dynamic parameters during typical path planning progress.
As vividly shown in Figure 18, autonomous vehicle perceives the location of front obstacle firstly, slows down the speed from 60 km h−1 to 27.8 km h−1 gradually, steering the wheel if collision cannot be avoided by braking alone. Wheel steering angle changes from 0° to 12.6° yaw rate, vehicle changes from 0° s−1 to 7.2° s−1. All parameters of autonomous vehicle during obstacle avoidance path planning are changed within reasonable range.
Method of comparison will be used to verify the performance of vehicle dynamic under the situation with or without traffic accident risk. Results are shown in Figure 19.

(a) Performance of vehicle dynamic without traffic accident risk and (b) performance of vehicle dynamic with traffic accident risk.
Figure 19 shows that, under no traffic accident risk scenario, autonomous vehicle accelerates along preplanned path at beginning, slows down gradually due to the effect of repulsion potential field which is formed by front vehicle, and drives at same speed as front vehicle. What’s more, lateral stability of this vehicle is very significant. All parameters of vehicle dynamic fluctuate in a very small range which can be seen in Figure 19(a).
Figure 19(b) shows the performance of vehicle dynamic under existence of traffic accident risk condition. Pedestrains, bicycles which appeared suddenly in front of ego vehicle leads to the change of lateral position when autonomous vehicle driving to target. With start of steering process, lateral acceleration of vehicle changes from −0.423 g to 0.72 g, yaw rate changes from −8.43° s−1 to 10.07° s−1. Sideslip angle of tire changes from −1.16° to 1.02°. Consequently, autonomous vehicle will slightly deviate from the original path; as soon as it passes the pedestrian or bicycle, road potential field leads autonomous vehicle back to planned path. Moreover, speed of autonomous vehicle does not change noticeably in this scenario, as expected. All parameters are changed within reasonable range to meet requirements of steering stability and driving safety during steering process.
Conclusion
In this article, a new fusion algorithm combining ant colony algorithm and improved potential field is introduced. This algorithm generates path based on vehicle dynamics, road structure, traffic regulations, and adhesion coefficient of driving road. Estimation algorithm for road adhesion coefficient is added to path planning, expect for road structure, vehicle dynamic, and traffic regulations. It’s significant for autonomous vehicle to improve accuracy of road recognition. After simulation and comparative analysis, validity of path planning under low road adhesion coefficient condition was verified. Virtual potential field which considers different PFs for different obstacles, road structure, and traffic regulations under multi-category objects was establishment. In addition, a reasonable trajectory with less iteration can be planned when joint potential force is added as heuristic information function to fusion algorithm used for path searching process. In other word, blindness, randomness, and stagnation of path searching due to low pheromone concentration at initial stage of path searching progress will be avoided, and efficiency of path search will be improved. Whether there is no traffic accident risk or existence of traffic accident risk, all parameters of autonomous vehicle in the above two simulations are changed within reasonable range to meet the requirements of driving stability and safety.
Results showed the capability of fusion algorithm in preforming appropriate maneuvers in path planning process. Besides, since vehicle dynamic, traffic regulation, and adhesion coefficient were considered, fusion algorithm used in path planning performs better.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project is supported by the National Natural Science Foundation of China (Grant No. 51775247, 51305167) and Postgraduate Research & Practice Innovation Program of Jiangsu Province (Grant No. KYCX18_2230).
