Abstract
Route optimization for autonomous container truck is one of the key problems to realize the automatic container port. An environment model for container truck is built by grid method. Considering the complex and unknown construction environment of the container port, an improved ant colony optimization (IACO) algorithm based on rolling window is proposed to achieve path planning for container truck. In the simulations, it is obvious that the IACO will not only achieve a safe collision avoidance path, the length of which is shorter than the truck's traditional route no matter how complex the environment is, but also show good analytical and disposing ability of dead ends in the path planning process. Compared with conventional ant colony optimization (ACO), the running time of IACO is shorter. The results of the simulation experiments demonstrate that the IACO is a good method which is applicable to route optimization for autonomous container truck.
1. Introduction
Container transportation is the most important logistics process of the container terminal. The container terminal is mainly composed of berth, container crane, container truck, gantry crane, and container yard. The container truck plays an important role in the whole process of container horizontal transportation. It is the connection between the container crane and the gantry crane. It is also a large-scale port equipment for container loading, unloading, and transportation. According to the Statistical Bulletin of Development of Transport Industry in 2014, China's port container throughput has reached 202 million TEU (twenty-foot equivalent unit) with an increase of 6.4% over the previous year, which has ranked first in the world for several years. With the improvement of container ship loading capacity and the requirement of ship's port time minimization, it is important to improve the efficiency of the container port loading and unloading.
There are many factors that may influence the efficiency of the container port loading and unloading, such as the allocation of the resources of the equipment, the plan of yard, the assignment and allotment of berth, quayside container cranes, and container truck as well as the route of port equipment movement. Route optimization for container truck is a key joint to realize the high-efficiency automatic container port.
Route optimization is an important branch of intelligent robot in the field of navigation. Path planning of intelligent robot has been studied in many papers in recent years. For such a kind of problem, various approaches have been employed to solve it. Dijkstra algorithm is employed in ref. [1] for the maze robot path planning. Although the Dijkstra algorithm can calculate the optimal path, it needs to iterate through all the nodes and its searching efficiency is much lower. Hierarchical A-Star algorithm is used in ref. [2] to solve the problem of optimal parking path planning of the large parking lot. A-Star algorithm is a heuristic search algorithm and its evaluation function determines the searching direction and affects the searching efficiency, but its computation time will be so much long when the workspace is large or the construction environment is complex. The generalized Voronoi diagram is used in ref. [3] for planning a collision-free path for a rectangle in a planar workspace populated with polygonal obstacles. The path planning method based on Voronoi diagram ensures the safe and reliable path, but it greatly increases the path length. When the number of obstacles in the construction environment becomes large, the algorithm will be very complex. Because path planning is NP-completed problem in nature [4], that is, the computational time that is required to solve such a problem increases dramatically (usually in an exponential rate) when the size (or dimension) of the problem increases, all the above algorithms will cause huge computational cost, especially in a complex environment or in a large searching space. Therefore, these algorithms cannot meet certain mission constraints. Furthermore, all the above methods are only applicable to the known environment. However, the obstacles of construction environment for container truck are complex and unknown. Therefore, all the above methods will not apply to the path planning for container truck in container yard.
To solve the problem of path planning, some modern intelligent path planning algorithms, such as genetic algorithm (GA) [5–7], simulated annealing (SA) [8, 9], neural network (NN) [10–12], particle swarm optimization (PSO) [13, 14], and ant colony optimization (ACO) [15–18], are adopted. Among those approaches, the ACO is the only meta-heuristic approach inspired by the behaviour of the biological ants in real world. It is one of the most successful examples of swarm intelligent systems and has been applied to solve many different types of problems, such as optimizing nonlinear objective functions and network routing in telecommunication networks [19]. A new ACO algorithm with fuzzy self-adapting of parameters is proposed in ref. [17], and it introduces the concept of activity degree of city to obtain effective updating of pheromone. But the algorithm can only apply to path planning in 3-D static obstacle environment. All the obstacles’ places are known beforehand. However, the obstacles in container terminal are unknown beforehand, and the container truck is used for horizontal transportation. So the proposed algorithm in ref. [17] is not suitable for the path planning of the container truck. As conventional ACO algorithm has shortcomings such as low efficiency in the initial stage for the lack of pheromone, it needs to be modified so that its convergence rate is speeded up when the optimal route is obtained.
The main purpose of this paper is to break through the shackles of the fixed route for container truck in the traditional operation process and to achieve the route optimization for autonomous container truck in unknown environment by the improved ant colony optimization (IACO) algorithm based on rolling window. The main contributions of this paper are as follows: (1) The workspace environment model of container truck is built by grid method. (2) The IACO algorithm based on rolling window is proposed and it is used to plan the path of the container truck. (3) The path planning of the container truck in the whole process of transportation is simulated successfully which meets the needs of quickness.
The structure of this paper is as follows: the background of container truck is described in Section 1 and the grid environment model is given in Section 2. Section 3 presents the process of path planning for container truck by IACO based on rolling window. Simulation experiments and results of the path planning for container truck are shown in Section 4. Finally, conclusions are drawn in Section 5.
2. Problem Formulation
Path planning consists of two subproblems: environment modelling and path search strategy. Environment modelling is the first step to solve the problem of path planning. Container trucks are used in a harbour environment to move containers between the pier and the container yard. The work environment of container terminal, as shown in Figure 1, is mainly made up of wharf, frontier, and container yard. The wharf generally refers to the quay line and mooring fittings which are prepared for docking the ship. The frontier is equipped with the quayside container crane and its orbit. The container yard is the stocking area of containers which are prepared for loading and unloading. From Figure 1, the traditional operation procedure of container-handling system is easy to be understood. In the loading process, the gantry crane transfers containers from the container yard to the container truck, then the full load truck transports containers to the frontier along the fixed route, and finally the container crane transfers containers from the truck to the ship. In the unloading process, the container crane transfers containers from the container ship to the no load truck, then the truck walks to the gantry crane's place along the fixed route, and lastly, the gantry crane transfers containers from the truck to the container yard. However, as the route of the container truck is relatively fixed, every truck usually walks for a long time along the fixed route and the truck's utilization rate is extremely low. Furthermore, it may lead to traffic jams when the number of trucks increases and the truck will slow down. It will extend the waiting time of the container crane or the gantry crane and affect the wharf working efficiency which may result in overstocking a harbour and affect the port container throughput.

Workflow of container port
Because of the irrationality of the truck's traditional route, a new and shorter path needs to be planned for the container truck. Due to the dynamic properties of the container terminal environment, unexpected changes in site layout may create new obstacles for the truck that may result in collisions and accidents. In this research, the improved ant colony optimization (IACO) algorithm is proposed to realize safe and short path planning of the container truck, which considers unknown environment or unpredictable obstacles.
For the horizontal transportation process of the container truck, a corresponding environment model needs to be established. The environment model could be depicted as shown in Figure 2. The truck's movement direction that's perpendicular to the coastline is set as the

Environment model based on grid method
There are many methods of environment modelling, including visibility graph method, free-space method, and grid method. In this research, the grid method is used for environment modelling. It is important to select an appropriate grid cell size. The smaller the grid size, the higher the resolution of the environmental model. But if the resolution is too high, it will take up a lot of storage space and even may cause the overflow of data. In fact, the grid size is measured by the size of the container truck. Assume that the grid size is measured by
The whole environment model is composed of two kinds of grid. Blank background grid is named free grid and grey grid is named obstacle grid. Free grid represents the area that can walk free, while obstacle grid represents the working space occupied by obstacles which cannot be reached by the truck. The main purpose of this research is to seek a safe and short path that can bypass obstacle grids and avoid collision.
There are two methods for recording the grid when creating an environmental map. One is the method of rectangular coordinate, the other method is the serial number notation. For the method of direct coordinate, each grid can be denoted by absolute coordinate (x, y) in the environment domain. For the serial number notation, each grid that records the environment information will be sorted globally and the global serial number is the label of corresponding grid. The serial number starts at 1 and increases by 1 from left to right, top to bottom. The mathematical relationship between the arbitrary grid and the corresponding grid coordinate is as follows:
In Eq. (1)–(3),
Some approximate treatment methods will be adopted when creating the environmental map. If one grid in the map is not filled up with the barrier in practice, it can be regarded as an obstacle grid. If
where
The number of the grid occupied by expanded obstacles is as follows:
where
In practice, it may lead to collision of the container truck with the edge of the environment map when the truck goes through the edge grid and the grid size is smaller than the truck. Therefore, the edge grid needs to be expanded in a similar way.
The set of all grids’ serial numbers
In the environment model, the set of obstacle grids
The obstacle information in the unknown environment is collected by the ultrasonic sensor installed on the container truck. During the transportation process, the sensors will run together with the truck. Suppose that the effective detection range of ultrasonic sensor is the rolling window
3. Solutions
3.1. Conventional ant colony optimization (ACO) algorithm
ACO algorithm, which is proposed by Marco Dorigo in his doctoral dissertation in 1992, is an intelligence-optimized algorithm derived from the illumination of food-seeking behaviour by ants based on the shortest route of pheromone [20]. It is a probability-based algorithm which is used to find the optimal path in the map [21]. ACO algorithm is a simulated evolutionary algorithm which shows many good properties.
The principle of ACO can be described as follows: All the ants start looking for food on the premise that they do not know where the food is beforehand. When one ant finds the food, it releases a volatile secretion called pheromone into the environment which can attract other ants to come over. Then, more and more ants will also find the food. As time goes on, the pheromone will gradually evaporate. Some ants do not repeat the same path as other ants, and they will find other new paths. If the new path is shorter than the original path, more ants are attracted to the shorter path gradually. Finally, there may be a shortest path which is repeated by most of the ants after a period of time.
The mathematical modelling of ACO algorithm is as follows: Assume that
In Eq. (5),
3.2. Path planning based on rolling window by IACO
Assume that the initial point of path is
3.2.1. The selection of local target in the rolling window
As the global target
The grid set in the range of
where
The coordinate values of all grids in the
where
Assume that the coordinate of the global target
It is obvious that there are eight adjacent grids for the grid

Diagram of choosing path direction
From Figure 3, as the adjacent grid
Then the objective function is as follows:
where
When more than one
3.2.2. Ant's state transformation rule
In the rolling window
From the objective attraction function (5), it can be seen that the ant transfer probability is a trade-off between the heuristic and pheromone factor. Roulette wheel is used for the selection of the ant's next step. According to equation (5), each individual transfer probability
The initial pheromone intensity for every arc in the environment map is constant
With every step in the rolling window
3.2.3. Pheromone update rule
After an ant has finished all grids’ traversal, if the pheromone on a path that it passed by is simply increased, the excessive amount of pheromone will inundate the heuristic information. So it requires updating the intensity of the pheromone on a path according to a certain rule. As the work environment of the container truck is very complex and conventional ACO algorithm has shortcomings such as low efficiency in the initial stage for the lack of pheromone, the convergence speed of algorithm is relatively slow. In this paper, the conventional pheromone update rule is modified. The information positive feedback performance is enhanced and the convergence speed is improved.
With time, the amount of pheromone on a path evaporates step by step. The evaporation factor
where
The expression of
where
To avoid the local optimization and the slow search speed, the conventional pheromone update rule is modified by introducing the concept of “elitist ant”. Elitist ant refers to the ant path length which is the shortest in the current iteration cycle. In other words, elitist ant is the global optimal solution in the current iteration. Therefore, the intensity of pheromone laid down by elitist ant should be increased so that the convergence speed is improved.
where
Put all ants on the start grid and start the next iteration after updating the pheromone table and recording the result of this iteration. The exploration is repeated until stop criteria are met. The stop criteria could be a preset maximum iteration times
3.2.4. Principle of setting parameters
The initial value of pheromone
The number of ants
Pheromone factor α: It represents the relative importance degree of the accumulated pheromone in guiding the search for ant colony. The bigger its values, the more inclined the ant colony will be to the path that is passed by other ants. It will lead that the search randomness is weakened. However, if its value is too large, the search for the ant colony will be immersed in local optimization. On the contrary, if its value is too small, the search will get a premature determinacy.
Heuristic factor
Evaporation rate
Pheromone accumulation parameter
The above coefficients have high coupling in the ant colony algorithm; thus in practical application, it requires following the above principles to determine the optimal coefficient combination.
3.3. Whole procedure of path planning for the container truck
The above part has shown the IACO algorithm for path planning based on the rolling window. The flowchart of path planning for container truck is given in Figure 4. The whole procedure of path planning by IACO algorithm is shown as follows:
Step 1: Environmental modelling by grid method.
Step 2: Initialize the relevant parameters, such as
Step 3: Put all the ants on the
Step 4: Generate rolling window
Step 5: Each ant chooses the next grid in the
Step 6: If an ant brings about an invalid path, it will be deleted; otherwise repeat Step 5 until each ant reaches
Step 7: If the
Step 8: Repeat Steps 3, 4, 5, 6, and 7 until this algorithm reaches the supposed iterative times or exceeds the maximum execution time.
Step 9: Output the optimal solution at present.

Flowchart of path planning for the container truck by IACO
4. Simulation Experiments and Results
Based on the above analysis, simulations of the proposed algorithm for the path planning of container truck are performed in MATLAB. The workspace is modelled in a grid map with 32×32 grids. Initial parameters used in simulations are given in Table 1. Assume that
Parameters used in simulations

Traditional route of container truck

Optimal path by IACO algorithm

Convergence curves of optimal paths by IACO algorithm

Convergence curves of optimal paths by ACO algorithm

Optimal path by IACO algorithm (dead end)

Convergence curves by IACO algorithm (dead end)
The optimal route which is planned by IACO algorithm is shown in Figure 6, the length of which is 45.108 cm. The comparison of the optimal route with the traditional route in Figures 6 and 5 shows that the length of the former is 12.892 cm shorter than the latter. Thus, the efficiency of the container truck walking along the planned path is higher. In Figures 7 and 8, they are respectively the convergence curves of optimal paths by IACO algorithm and ACO algorithm. The horizontal axis is the iteration times
Sometimes, the container truck walks into a dead end because the work environment is very complex. The IACO algorithm has the ability to deal with the dead end which is shown in Figure 9. Its convergence curves are shown in Figure 10. When the truck falls into a corner, it will automatically and rapidly jump out of the corner in order to ensure the safe operation of the system. It shows good analytical and disposing ability of dead ends in the path planning process.
5. Conclusions
In this paper, an algorithm for route optimization in the unknown workspace, named IACO algorithm, has been proposed for autonomous container truck. Due to the complex construction environment of container port, the grid method is used for environment modelling. The information of the unknown environment is collected by ultrasonic sensor which is installed on the container truck. The rolling window which is the effective detection range of the sensor is introduced to realize path planning. To avoid low search efficiency and slow convergence speed, the conventional ACO algorithm is modified by introducing “elitist ant” to solve the problem, which is the proposed IACO algorithm based on rolling window. The simulation experiment results show that this approach is valid. The IACO algorithm can find optimal paths at a higher convergence speed compared with ACO algorithm. Furthermore, it shows good analytical and disposing ability of dead ends in the path planning process in the simulation.
Footnotes
6. Acknowledgements
This work was supported by the National Natural Science Foundation of China under Grant No. 61272114 and Marine Renewable Energy Special Fund Project of the State Oceanic Administration of China under Grant No. GHME2013JS01.
