Abstract
The article proposes a new path planning method for a multi-robot system for transportation with various loading conditions. For a given system, one needs to distribute given pickup and delivery jobs to the robots and find a path for each robot while minimizing the sum of travel costs. The system has multiple robots with different payloads. Each job has a different required minimum payload, and as a result, job distribution in this situation must take into account the difference in payload capacities of robots. By reflecting job handling restrictions and job accomplishment costs in travel costs, the problem is formulated as a multiple heterogeneous asymmetric Hamiltonian path problem and a primal-dual based heuristic is developed to solve the problem. The heuristic produces a feasible solution in relatively short amount of time and verified by the implementation results.
Keywords
Introduction
For automation of transportation, the choice of the right automated material handling system is critical for its efficiency. Since the modern production design departed from conveyor systems to avoid its limitation in mobility, mobile robots, including automated guided vehicles, are one of the popular material delivery systems that have been utilized by the factories. Compare to other systems, mobile robots are preferred for the environments that require frequent changes in equipment layout or transfer of heavyweight components, because it is highly mobile and its payload is bounded solely by its actuator’s power specifications. As a result, using heterogeneous robots—for instance, mixing low-cost low-payload robots and high-cost high-payload robots—can reduce setup costs for manufacturing processes. However, there is a research gap in developing path planning algorithms that produce a good quality of suboptimal solutions for operation of heterogeneous robots in a time-sensitive manner. For efficient path planning, one needs to consider: (1) dispatching, which assigns the jobs to robots and find an optimal sequence; (2) routing, which finds an optimal path for each robot with a given sequence; and (3) scheduling, which determines arrival and departure time of robots at each node in the workspace. In this article, we focus on dispatching and routing of robots having different payloads, because differences in payload increase the complexity of the arrangements. We assumed that scheduling could be considered after dispatching and routing is completed, because these are the two factors that most significantly affect optimality.
In this study, we expand on the solutions suggested in the current literature 1 and address the problem of dispatching and routing involving multiple transportation robots with different loading conditions, which is a common issue that arises in manufacturing and warehouse applications. Our approach has a strong advantage in computation time while producing good solutions, because it is a greedy algorithm based on the primal-dual technique. To focus on the issue of addressing difference in payloads, we assume that there is no structural heterogeneity between the robots. We also assume that each job cannot be interrupted, once it is started. Given a set of robots located in distinct initial locations with distinctive payloads, a set of jobs (pickup and delivery locations and required payloads) and a defined cost of travel between any two locations for each robot, we aim to find a path for each robot so that: (1) each job is completed by one of the robots, (2) all robots finish their routes at the last job delivery location, and (3) the sum of travel costs of all the robots is minimized.
If we reflect the pickup and delivery costs in the travel costs and only consider the operation of one robot, which is the simplest case, the problem becomes asymmetric Hamiltonian path problem (HPP). Thus, the problem addressed in this article is a generalization of traveling salesman problem (TSP) and NP-Hard.
2
Because we are dealing with a system with multiple robots having different payloads that originate from distinctive depots, the problem can be considered as a multiple depot heterogeneous asymmetric HPP. There is lack of literature that addresses multiple HPP that considers functional heterogeneity of vehicles (which is different payloads in this article) and asymmetric travel costs at the same time. Only few articles considered functional heterogeneity for vehicle routing problems. Sundar and Rathinam
3
and Yadlapalli et al.
4
addressed functional heterogeneity for multiple HPPs. Both articles attempted to resolve the issue of functional heterogeneity by assigning specified targets to each vehicle and forbidding other vehicles from visiting these preassigned targets. However, we are more interested in the case that each job has a distinctive set of available vehicles, which happens more often in real applications. Ma et al. dealt a specific routing problem of transportation robots, the package-exchange robot routing (PERR) problem, where each robot carries one package, any two robots in adjacent locations can exchange their packages, and each package needs to be delivered to a given destination.
5
Auction-based method is one of the popular ways of solving multiple robot routing and studied in various forms.
6
–8
When the vehicles are homogeneous and costs are symmetric, there are 2-approximation algorithms for variants of the multiple vehicle routing problem available in the literature.
9,10
Specifically, Rathinam and Sengupta presented a 2-approximation algorithm for the multiple depot multiple terminal HPP.
10
There are also some heuristics for variants of the multiple heterogeneous asymmetric TSP.
11,12
Using-approximation algorithm,
13
Bae and Rathinam developed-approximation algorithm for a multiple heterogeneous asymmetric TSP.
14
A generalized multiple depot TSP, in which only a limited number (k) can be selected to service customers, was examined by Xu and Rodrigues and they presented a
In this article, we propose a heuristic for dispatching based on the primal-dual technique and combined with a heuristic for routing. This allows us to focus on efficient job assignment, which decides how many and which robots should be used in what sequence to minimize the sum of travel costs. In the next section, we describe the problem and formulate the mathematical model in the subsequent section. We then present the main algorithm for the problem. The computational results are discussed in the section on implementation and we conclude in the last section.
Problem statement
Consider a warehouse with m transportation robots performing n pickup and delivery jobs. The parameters used to present the problem can be stated as follows:
Parameters
To transform the problem into a multiple depot asymmetric HPP, each job and depot is treated as a vertex and job accomplishment costs (e.g. pick-up and delivery costs) and payload restrictions are reflected in the travel costs between the vertices. To set up the problem closer to real-world applications, we have considered the motion constraints of the robots when we estimate the travel costs. We assume that robots have forward motion and when rotation is needed, they stop and rotate at their current node and then move forward again. We also assume that workspace can be represented by nodes and edges. An workspace example is presented in Figure 1. The travel cost between the vertex u and v in each

An example of workspace for transportation. This workspace was used for our simulation.
To deal with the heterogeneity, we assigned an index to each robot by arranging their payloads in descending order:
Problem formulation
Here, we formulate the problem in such a way that we can apply the primal-dual technique. The decision variables used in the formulation are defined as follows:
Decision variables
First, let us consider the first robot,
subject to
By introducing the dual variables
subject to
We use this dual problem to find a heterogeneous directed spanning forest (HDSF), which is a collection of m trees with each tree spanning a subset of targets from each depot. We then use the result for dispatching. In the algorithm, each dual variable
A primal-dual heuristic for finding a HDSF
In this section, we propose a primal-dual heuristic to find an HDSF. The main concept of the algorithm is very simple. In the algorithm, each dual variable implies the cost each set needs to pay to be visited by one of the robots. Initially, all dual variables are set to zero. In every iteration, the algorithm look for the dual variable(s) that can be increased, without violating any of the dual constraints in equations (8) to (10), with the minimum value. The edge(s) that made one of (8) tight is(are) added to the corresponding tree(s). By repeating iterations, we can find a forest that makes every vertex reachable from at least one of the depots and thus complete the HDSF by removing unnecessary edges. Since we set the travel cost for the jobs that cannot be taken to the very large constant M, the algorithm will avoid choosing those edges and instead choose the edges with low costs.
The pseudocode of the algorithm based on the primal-dual technique is presented with three steps in Algorithm 1
to 3. In Figures 2 to 5, every step of the algorithm for an instance with two robots and five jobs is presented. In the algorithm, a component is active if it does not have any entering edges or is not reachable from any of the depots. A component is inactive if it has at least one entering edge or is reachable from one of the depots. A component is called
Initialization step of the primal-dual heuristic.
Main loop of the primal-dual heuristic.
Pruning step of the primal-dual heuristic.

Initial status of an instance with two robots and five jobs. The blue filled circles represent an active status, and the grey filled circles represent an inactive status. At initialization, each vertex is in its distinct connected component (line 2 in Algorithm 1), and all jobs are active while all depots are inactive (line 5–6 in Algorithm 1). In this instance, the payloads of robots are given as

The iteration 1 to 4 of the main loop of an instance with two robots and five jobs. The red edges represent those added at the corresponding iteration. The line number in parenthesis indicates the line in Algorithm 2 that is related to the action in each iteration. (a) Iteration#1. The edge of i 2 to j 3 is added to T2. Because {j 3} ϵ C 2 became reachable from i 2 (line 9), {i 2; j 3} has become an inactive component. (line 10) The superset {j 3} ϵ C 1 has been marked and deactivated (line 15). (b) Iteration#2. The edges of j 5 to j 1 have been added to both trees. {j 1} ϵ C 1 and {j 1} ϵ C 2 are deactivated (line 18). (c) Iteration#3. The edge of j 3 to j 4 is added to T 1. {j 4} ϵ C 1 is deactivated (line 18). (d) Iteration#4. The edges of j 1 to j 5 are added to both trees. By adding the edges, new strongly connected components are formed (line 7) and {j 1; j 5} in both C 1; C 2 became new active components at the end of the iteration (line 8).

The iteration 5 to 7 of the main loop of an instance with two robots and five jobs, continued from Figure 3. (a) Iteration#5. The edge of i 1 to j 5 is added to T 1. Because {j 1; j 5} ϵ C 1 has become reachable from i 1 (line 9), {i 1; j 1; j 5} has become a new inactive component in C 1 (line 10). The subset {j 1; j 5} ϵ C 2 is deactivated (line 12). (b) Iteration#6. The edges of j 3 to j 2 are added to both trees. Now, {j 2} ϵ C 2 has become reachable from i 2 (line 9) and {i 2; j 2; j 3} ϵ C 2 has become a new inactive component (line 10). The supersets {j 2}, {j3} ϵ C 1 are marked and deactivated (line 15). (c) Iteration#6-1. Since there is no active component without any entering edge in C 1 (line 21), the set {j 3} has been picked and combined with the sets {j 2} and {j 4} that are connected with outgoing edges from {j 3}. Since {j 2; j 3; j 4} does not have any entering edges, it becomes a new active component in C 1 (line 22). (d) Iteration#7. The edge of j 1 to j 4 is added to T 1. {j 4} has become reachable from i 1 (line 9) and {i 1; j 1; j 4; j 5} has become a new inactive component in C 1 (line 10). The subset {j 4} ϵ C 2 is deactivated (line 12). Since all components are inactive, the main loop is terminated at this iteration (line 1).

The generated HDSF after pruning step of an instance with two robots and five jobs. During pruning step, all the unnecessary edges
The initialization step is presented in Algorithm 1. At initialization, for all
The main loop of the heuristic is presented in Algorithm 2. During each iteration of the main loop, we find an active violated component in all
If there is no active component without any entering edge in
As the final step of the algorithm, we perform reverse deleting in pruning step to obtain the final forest as shown in Algorithm 3. Let
Lemma 1
The proposed primal-dual heuristic (in Algorithms 1 to 3) produces a feasible HDSF. Each of the vertices is reachable from one of the depots and every vertex appears only once in the forest.
Proof
During the main loop, a component can be deactivated only if one of the following conditions is satisfied. (1) The edge added to the forest does not form any new strongly connected component, and none of the vertices in the component is reachable from one of the depots (this corresponds to line 18 in Algorithm 2). (2) The component has become reachable from its depot (this corresponds to line 10 in Algorithm 2). (3) One of its subsets or supersets becomes reachable from its depot (this corresponds to line 12 and 15 in Algorithm 2). The vertices would become reachable from one of the depots if (2) or (3) happens at least once at the time of termination.
Assume that only one active component is left for all
Lemma 2
The proposed primal-dual heuristic runs in polynomial time.
Proof
In Algorithm 2, each time through the loop, we find the minimum edge(s) by extracting the minimum element from active components. Since there are at most n components for each robot at any point in time, each iteration will have
The resulted HDSF would be utilized as the partition of the vertices. The connected vertices in each tree become a job assignment for each robot. The routing process could be done by solving HPP within the assignment using existing algorithm. We applied Lin–Kernighan heuristic (LKH) 17 to solve HPP in the implementation, which is discussed in the following section.
Computational results
The proposed algorithm is implemented and run for different sizes and instances. The simulation is performed in a virtual manufacturing system environment as shown in Figure 1. The number of robots varied from four to six, and the number of jobs varied from 20 to 40. We generated and tested 50 instances for each problem size. The locations (nodes) of depots, pickup, and delivery were generated with a uniform distribution from node#1 to node#60. The payloads of robots and the required payloads of jobs were generated from 1 to 5, also with a uniform distribution. All computational experiments were run on Intel Core i5-7600 CPU @3.5 GHz with 8 GB RAM. For each instance, the cost matrices of the robots were generated using improved A* algorithm. The cost function of traveling from node a to node b was set to travel time as

The final routes for each robot of an instance of 4 robots and 10 jobs solved by the proposed heuristic. The payloads of each robot were
To verify the performance and computation time of the proposed algorithm, we have also applied LP rounding method
1
on the multiple Asymmetric HPP and applied LKH for routing for the same instances. The LP rounding of the problem was solved by CPLEX.
19
We compared the results produced by the algorithms. To compare solution qualities, a posteriori bound is calculated by

The average (the left column) and the maximum (the right column) a posteriori bounds.
The average and maximum computation times of the instances are shown in Tables 1 and 2, respectively. As we can see from the results, the proposed heuristic solves the problem in a relatively short period even for the largest problem size. Because the LP rounding method is based on LP relaxation, which is very time-sensitive method, the computation time increased significantly as the problem size increased. Even for the largest problem sizes, the maximum computation time of the primal-dual heuristic was only about 8 s, while that of the LP rounding was over 23,830 s (more than 6 h). These results indicate that the proposed heuristic is promising, considering the complexity of the problem, especially when the problem sizes are huge.
The average computation times in seconds.
LKH: Lin–Kernighan heuristic; LP: linear program.
The maximum computation times in seconds.
LKH: Lin–Kernighan heuristic; LP: linear program.
Conclusion
The study addressed the path planning problem for a system with multiple transportation robots having different loading conditions. By reflecting payload restrictions and job handling costs in the travel costs, the problem could be represented as a multiple depot heterogeneous asymmetric HPP. A heuristic based on the primal-dual technique is proposed to solve the problem. From the implementation results, the effectiveness of the proposed algorithm has been demonstrated. We hope to improve the algorithm further to include an approximation ratio. We also believe this to be a good first step toward developing an algorithm that would minimize the last job finishing time, as the objective becomes a min-max problem, while considering both structural and functional heterogeneity simultaneously.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of following financial support for the research, authorship, and/or publication of this article: This research was supported by the NRF, MSIP (Grant No. NRF-2017R1A2A1 A17069329) and by the Agriculture, Food and Rural Affairs Research Center Support Program (Grant No. 714002-07), MAFRA, Korea.
