A hormone regulation–based approach for distributed and on-line scheduling of machines and automated guided vehicles

Abstract

With the continuous innovation of technology, automated guided vehicles are playing an increasingly important role on manufacturing systems. Both the scheduling of operations on machines as well as the scheduling of automated guided vehicles are essential factors contributing to the efficiency of the overall manufacturing systems. In this article, a hormone regulation–based approach for on-line scheduling of machines and automated guided vehicles within a distributed system is proposed. In a real-time environment, the proposed approach assigns emergent tasks and generates feasible schedules implementing a task allocation approach based on hormonal regulation mechanism. This approach is tested on two scheduling problems in literatures. The results from the evaluation show that the proposed approach improves the scheduling quality compared with state-of-the-art on-line and off-line approaches.

Keywords

Manufacturing system automated guided vehicle hormone-regulation mechanism on-line scheduling allocation mechanism

Introduction

With the globalization of markets, the continuous innovation of technology, and the short life of products, the traditional manufacturing industry is facing tremendous challenges. This situation has promoted the development of manufacturing systems toward the direction of discretization, intelligentization, and autonomy. A manufacturing system typically consists of several production operation units, an automated storage/retrieval system (AS/RS) for raw material and finished products, and an automated material handling system for material transfer between units. In order to assure the high agility and flexibility, manufacturing systems require an intelligent and automated material handling system.¹ An automated guided vehicle system (AGVS) is one of the most efficient material handling systems due to high flexibility, safety, and small space utilization of automated guided vehicles (AGVs). In recent years, the research on AGV technology has strengthened their flexibility, intelligence, and autonomy.^2–5

An AGVS should ensure normal and efficient material transfer, meanwhile, reducing the transportation cost, work-in-process (WIP) inventories, and total operation cost.^5,6 To achieve these goals, many approaches and solutions are used in manufacturing systems. In these systems, scheduling problems are optimization processes of resource and task allocation. Both the scheduling of operations on machines as well as the scheduling of AGVs are essential factors contributing to the efficiency of the manufacturing systems.⁷ AGV scheduling problems depend on the machine scheduling for task execution, specifically on the starting and ending time assigned by the operations’ scheduling. The objective of AGV scheduling is to optimize the material handling, executed by AGVs, among the machines and the AS/RS. AGV scheduling can be achieved by both off-line and on-line approaches. Off-line scheduling is aimed to manage all activities for the entire scheduling period, while on-line scheduling carries out the allocation and dispatching in real-time, during the execution of the plan.

Off-line AGV scheduling is a non-deterministic polynomial-time (NP)-hard problem that must take into account machine scheduling and AGV scheduling simultaneously. Numerous research results show that NP-hard scheduling problems can be solved by heuristic approaches (HAs)^8–10 as well as off-line AGV scheduling problem.¹¹ In order to optimize AGV scheduling, Confessore et al.¹² propose a network-based HA for the vehicle dispatching. Bilge and Ulusoy¹³ exploit the interactions between machine scheduling and AGV scheduling in a flexible manufacturing system (FMS) by addressing them at the same time. They define a nonlinear mixed integer-programming model to formulate the problem. They apply a heuristic-based iterative approach to generate machine schedules that are used to define time windows for AGVs; afterward a feasible solution for AGV schedules is searched. Besides, several more researches^14–17 solve scheduling problems in the literature¹³ using meta-heuristic techniques.

The goal of off-line scheduling is to generate an optimized schedule over a period of time, during which the schedule is not expected to require any change. Nevertheless, during production, disturbances are likely to cause the unavailability of the original schedule. Therefore, on-line scheduling or dispatching approaches can substantially improve the performance of AGVSs.^18–20 There are two on-line approaches for AGVSs: centralized and decentralized (or distributed). A centralized approach has one controller for all AGVs in the system.^21–23 Whereas, in a distributed approach there are several subsystems controlled by different independent controllers based on their local knowledge. Multi-agent systems (MASs) and holonic manufacturing system (HMS), with distributed characteristic, can be used to implement on-line AGV routing and dispatching. Lau and Woo²⁴ describe an agent-based dynamic routing strategy for generic automated material handling systems. Morten and Olivier²⁵ present a holonic-based approach for AGVS developed for the automated paint-shop. Babiceanu et al.²⁶ introduce a holonic control approach for scheduling material handling devices in the cellular manufacturing environment. There are also some researchers applying distributed approaches to deal with classic objectives existing for AGV routing and dispatching, such as deadlock and conflict. Singh and Tiwari²⁷ propose a MAS approach for the operational control on AGV conflict-free routing. Breton et al.²⁸ introduce a routing approach based on MAS for deadlock avoidance and conflict free. Wallace²⁹ presents an agent-based AGV controller to maintain deadlock-free flow of AGVs within a free space world model.

Although there have been many researches on on-line AGV routing and dispatching by applying distributed approaches, very few carry out the study on on-line scheduling for machines and AGVs simultaneously. To the best of the authors’ knowledge, only one work³⁰ proposes a MAS approach for simultaneous scheduling of machines and AGVs. The approach works in an on-line environment and generates feasible schedules using negotiation and bidding mechanisms between distributed agents. MAS negotiation and bidding mechanisms have the advantage of simplicity. Nevertheless, since they are a type of explicit coordination mechanism, when the complexity of the manufacturing environment increases (the number of machines and AGVs is large, together with a high number of new tasks appearing at run time), the number of messages passing is also large, and time consumption in some situations is not appropriate for given feasible solutions in due date.

Intelligent models inspired by human body information processing mechanism have become a new research focus in the Artificial Intelligence research field. For example, endocrine system is a core part of human body information processing mechanism. Its unique processing method, based on the principle of hormone diffusion and reaction, has given researchers a lot of inspiration.^31,32 The hormone-regulation mechanism is one kind of implicit coordination approach that leads to quick coordination between the different components of the entire system. Compared with MAS negotiation and bidding mechanisms, this mechanism implements simpler coordination and requires less message passing among the system components. In this work, an approach for distributed and on-line scheduling of AGVs and machines that uses the hormone-regulation mechanism is proposed.

The remainder of the article is organized as follows. Section “On-line scheduling model” presents an on-line scheduling model inspired by the principle of hormone diffusion and reaction to agilely deal with emergent tasks. Section “Allocation mechanism based on hormone-regulation mechanism” introduces a transportation task allocation mechanism based on hormone-regulation mechanism. Section “Distributed cooperation mechanism for on-line scheduling” illustrates a hormone regulation–based cooperation mechanism between machines and AGVs for on-line scheduling. Section “Experimental study” presents an evaluation study in which the proposed approach is compared against other state-of-the-art approaches. Section “Conclusion” describes the conclusions and future works.

On-line scheduling model

On-line scheduling approach

An on-line problem for simultaneous scheduling of machines and AGVs can be modeled as an on-line job shop scheduling problem in which the materials are transported by AGVs. The process route plan generated from an on-line job shop scheduling determines the key time nodes of an on-line AGV scheduling. In recent years, on-line job shop scheduling problems for manufacturing systems have been studied by many researchers.^33–35 In our previous work,³⁶ a shop floor re-scheduling approach was presented. This technique can deal with on-line scheduling for machines and operations proposed in this article. Thus, the focus of this article is the scheduling of transportation tasks between AGVs and machines, shown in Figure 1.

Figure 1.

Scheduling of transportation tasks between AGVs and machines.

This scheduling approach is collaborative and distributed and can be described in an abstract way as follows. The collaborative scheduling process is divided into three stages. In stage I, the scheduling process is triggered when an operation is started on a machine; the machine must deal with the subsequent transportation throughout the shop floor before the operation is finished. The machine needs to find a suitable AGV that can execute the transportation. To this end, it sends the demand requirement to the AGVs in the system. In stage II, when a given AGV realizes the demands from machines (sensing the environment or receiving a message), it calculates its transportation efficiency for every demand and selects the demand with the highest transportation efficiency according to its own criteria, and then communicates its choice back to the relevant machine. In stage III, the machine receives/senses the feedback information, then evaluates the different alternatives and selects the most efficient one. Finally, the machine allocates the transportation task to the selected AGV. In the next subsections, an on-line scheduling model inspired by the principle of hormone diffusion and reaction is detailed.

Information processing mechanism in endocrine system

The endocrine system of the human body is a complex physiology network formed by a variety of endocrine glands. These endocrine glands can influence each other by secreting, transmitting, and responding to different hormones.³⁷ Endocrine glands with different functions have their own proprietary hormone receptors, which react to hormones in the humoral environment. However, endocrine glands diffuse hormones into the humoral environment with no constraints; the hormone receptors only respond to the specific hormones. The principle of hormone diffusion and reaction in the endocrine system is illustrated in Figure 2. The solid lines with an arrow represent the hormone secretion between endocrine glands or hormone autocrine in independent endocrine glands, whereas the dotted line with an arrow indicates the hormone feedback of endocrine glands from the participant to the initiator. For example, affected by a stimulus, endocrine gland “A” secretes hormone “A” and releases it into the humoral environment. Sensing the stimulus from hormone “A,” endocrine gland “B” secretes hormone “AB” and autocrine hormone “B” simultaneously. Then, endocrine gland “B” feeds back hormones “AB” and “B” to endocrine gland “A.”

Figure 2.

Principle of hormone diffusion and reaction in endocrine system.

The principle of hormone diffusion and reaction in endocrine system is provided with the following characteristics:

Information transmission functions. There is no centralized control part but only one humoral environment for hormone transmission. Moreover, the behaviors of hormone secretion in endocrine glands are only related to the hormone information in the humoral environment. Thus, it is not required a point-to-point communication.

Specificity. A hormone is a kind of chemical component released by endocrine glands. The combination of the chemical component and hormone receptors is specific, that is, a hormone receptor only reacts to a specific chemical component (hormone). The specificity of hormone is determined by the genetic information.

Synergy and antagonism between hormones. In the endocrine system, endocrine glands release hormones through stimulus in the humoral environment, where synergy and antagonism between hormones emerge from the different effects of hormones on the same gland. These kinds of interactions have the effect to stabilize the system environment.

By employing the features of hormone transmission and interaction, the endocrine system of the human body can achieve rapid adjustment and maintain high adaptability.

On-line scheduling model inspired by the principle of hormone diffusion and reaction

To solve the on-line scheduling problem, an on-line scheduling model inspired by the principle of hormone diffusion and reaction is proposed (Figure 3). Acting as endocrine glands, the machines play the role of initiators providing optimization and coordination services to AGVs and AGVs play the role of participants providing response and optimization services. In our model, it is assumed that machines and AGVs have the capacity to handle calculation, comparison, and decision-making operations, since the computation power and the optimization capability are embedded in them. In the proposed model, the tasks act as the stimulus in the system; the shop floor environment acts as the humoral environment. In this way, the diffusion and reaction information are similar to the secretion and feedback of hormones.

Figure 3.

On-line scheduling model inspired by the principle of hormone diffusion and reaction.

As illustrated in Figure 3, when operation task “a” is executed on machine “A,” the subsequent need for transportation task “a” emerges. Stimulated by that need, machine “A” evaluates the degree of demand for AGVs, then it packages the demand and transportation task information into a hormone, and finally diffuses the hormone into the shop floor environment. When the AGVs sense the hormone information, they are stimulated by the demand and the transportation task simultaneously. In response to the stimulus, each AGV evaluates how the demand influences itself and its performance to complete the transportation task; then it packages the evaluated value into relevant hormone information and releases this information to machine “A.” According to the feedback hormone information, machine “A” allocates the transportation task to the relevant AGV. In the process of on-line scheduling, the information evaluation of machines and AGVs is similar to the process of responding to stimulus and secreting hormone, which is a kind of self-adjustment and adaptation mechanism to maintain the balance of the system. By utilizing this model, the transportation tasks can be rapidly allocated without a supervisor. In the next section, the allocation process of transportation tasks is described in detail.

Allocation mechanism based on hormone-regulation mechanism

Hormone-regulation mechanism background

Farhy³⁸ defined the basic law for modeling the secretion of hormones by endocrine glands. In this model, the hormone regulation complies with Hill function which is composed of the rising function s and decreasing function $F_{down} (C)$ as shown in equation (1)

F (C) = {\begin{matrix} F_{up} (C) = \frac{C^{n}}{T^{n} + C^{n}}, rising function \\ F_{down} (C) = \frac{T^{n}}{T^{n} + C^{n}}, decreasing function \end{matrix}

(1)

where C is variable of hormone concentration, T is a threshold of hormone concentration, and T > 0; n is the Hill coefficient and n > 1.

If a hormone x is controlled by a set of hormones $I = {1, 2, \dots, i}$ simultaneously, the secretion speed of hormone x is determined by the concentration of these hormones, which is shown in equation (2)

S_{x} = S_{x 0} + \sum_{i = 1}^{I} a_{i} \cdot F (C_{i})

(2)

where S_x₀ represents the initial secretion speed of hormone x, C_i is the concentration of hormone i, and coefficient a_i is a positive constant associated with hormone i.

For example, the glucagon secreted by pancreatic islet α-cells has the function of raising blood sugar concentration; on the contrary, the insulin secreted by pancreatic islet β-cells has the function of reducing blood sugar concentration. When the blood sugar concentration is low, islet α-cells promote the glucagon secretion, and hormone regulation complies with up-Hill function for rapidly improving the blood sugar concentration; on the contrary, when the blood sugar concentration is high, islet β-cells promote the insulin secretion and hormone regulation complies with down-Hill function for agilely reducing the blood sugar concentration. Because hormone regulation has the characteristics of monotonicity and non-negativity, the affection of one hormone to another hormone can only be the stimulation or inhabitation. In biology, insulin and glucagon exist at the same time and have the function of mutual antagonism to regulate blood sugar concentration.

If $S_{x}$ represents the secretion speed of blood sugar, and $C_{y}$ and $C_{z}$ are the hormone concentration of insulin and glucagon, respectively, $S_{x}$ can be calculated according to the influence on blood sugar concentration caused by antagonism between glucagon and insulin

S_{x} = S_{x 0} + a_{y} F_{up} (C_{y}) + a_{z} F_{down} (C_{z})

(3)

There are not only antagonistic effects but also synergistic effects between different hormones. For example, glucagon and epinephrine have the synergistic function of elevating blood sugar concentration. If $S_{x}$ represents the secretion speed of blood sugar, and $C_{y}$ and $C_{z}$ are the hormone concentration of glucagon and epinephrine, respectively, $S_{x}$ can be calculated in accordance with the influence on blood sugar concentration caused by synergy between glucagon and epinephrine

S_{x} = S_{x 0} + a_{y} F_{up} (C_{y}) + a_{z} F_{up} (C_{z})

(4)

The next sections describe the design of AGV allocation approach inspired by hormone-regulation mechanism.

Time parameters in scheduling

In the on-line scheduling problem of machines and AGVs, a task has two main stages: the task being operated by a machine (TO) and the task being transported by an AGV (TT), shown in Figure 4. The notations are given below:

st is the start time of an operation task.

ct is the completion time of an operation task.

ot is the duration of an operation task.

lt is the loading time of a transportation task.

ult is the unloading time of a transportation task.

tt is the duration of a transportation task.

M is the set of machines.

K is the set of AGVs.

J is the set of jobs.

L is the set of operations of a job.

Z is the makespan.

Figure 4.

Two main stages of a task.

The objective of on-line scheduling problem of machines and AGVs is to minimize Z. According to the interrelation between time parameters, constraints are extracted and formulized as follows

s t_{jl + 1} \geq c t_{jl} + t t_{jl}, j \in J, l \in L

(5)

c t_{jl} + t t_{jl} \leq ul t_{jl} \leq s t_{jl + 1}, j \in J, l \in L

(6)

Formula (5) presents a time constraint between adjacent operations of a job and Formula (6) presents time constraints between AGV and adjacent operations of a job. In the on-line scheduling problem, only ot and tt are considered as given parameters and other parameters are variables to be determined. According to the constraints (5) and (6), interrelation between parameters is determined. Taking the operation l of job j as an example, calculation processes of the above parameters are illustrated as follows. When an operation task (TO_jl) is executed on a machine, st_jl and ot_jl are determined. And then ct_jl can be obtained in accordance with equation (7)

c t_{jl} = s t_{jl} + o t_{jl}

(7)

According to the operation state of AGV (i.e. transporting a task; or being idle and waiting for a task to transport), the loading time of AGV is described by the following equations

{lt}_{k}^{jl} = {\begin{matrix} {\begin{matrix} {eft}_{k}^{jl} + Δ t (NL, P L_{jl}), ef t_{k} > ep t_{jl} \\ {eft}_{k}^{jl} + max {Δ t (NL, P L_{jl}), (ep t_{jl} - ef t_{k})}, ef t_{k} \leq ep t_{jl} \end{matrix} transporting state \\ {\begin{matrix} t + Δ t (CL, P L_{jl}), t > ep t_{jl} \\ t + max {Δ t (CL, P L_{jl}), (ep t_{jl} - t)}, t \leq ep t_{jl} \end{matrix} idle or waiting state \end{matrix}

(8)

where t is the current time; $ef t_{k}$ is the earliest finish time of the current transportation task of AGV_k; $ep t_{jl}$ is the earliest pickup time of the operation l of job j; NL and CL denote the next location and current location of AGV_k, respectively; PL_jl is the pickup location of the operation l of job j; and $Δ t$ is the required transportation time between two locations. In this article, the post-processes after TO_jl are not taken into account, therefore, the value of ept_jl is equal to ct_jl (ept_jl = ct_jl). The upper part of equation (8) defines the situation in which the AGV is transporting a task and the lower part of equation (8) defines the situation in which the AGV is idle and waiting to transport a new task. When the workpiece is picked up by AGV_k, $t t_{jl}$ is calculated as follows

t t_{jl} = Δ t (P L_{jl}, D L_{jl})

(9)

where DL_jl is the destination location of the operation l of job j. The unloading time of AGV_k is computed according to equation (10)

ul t_{jl} = {lt}_{k}^{jl} + t t_{jl}

(10)

Finally, the makespan is selected in accordance with equation (11)

Z = \underset{j \in J}{MAX} {ul t_{j L_{j}}}

(11)

where L_j is the number of the last operation of job j.

Allocation mechanism

In the case of normal operation, hormone concentrations of the multi-AGV system are in the equilibrium state. Once a transportation task emerges in the manufacturing system, the balance will be disturbed. It is assumed that the secretion of hormone is triggered in the manufacturing environment, stimulated by the transportation task. The level of hormone concentration is related to the effect on the system balance caused by the initiation of transportation task. If the effect on the system balance is small, the level of hormone concentration released by the system is low; otherwise, the level of hormone concentration is high. Taking this principle as a basis, a transportation task allocation mechanism is proposed. In the following subsections, the operation l of job j is taken as an example to describe the allocation mechanism in detail.

Hormone secretion of machines

When an operation task $(T O_{jl})$ is executed on one machine (M_m), the allocation of transportation task $(T T_{jl})$ will be triggered; at the same time, M_m will search for the appropriate AGV to perform $T T_{jl}$ . In order to ensure that $T T_{jl}$ can be started after $c t_{jl}$ , which means the workpiece of $T T_{jl}$ is picked up by an AGV at time $c t_{jl}$ , $T T_{jl}$ stimulates M_m to secrete hormone according to equation (15). The level of hormone concentration represents the urgency of the machine’s demand for an AGV

H_{m}^{jl} (t) = c e^{\frac{(t - c t_{jl})}{o t_{jl}}}

(12)

where, c is a positive constant.

An example of hormone secretion curve of a machine is shown in Figure 5 according to equation (12). When $t < c t_{jl}$ , $H_{m}^{jl} (t) < c$ can be obtained, and the hormone concentration increases moderately as time goes on. It indicates that there is a less demand for an AGV to perform $T T_{jl}$ . When $t \geq c t_{jl}$ , $H_{m}^{jl} (t) \geq c$ can also be obtained, and the hormone concentration increases faster with the passage of time. It demonstrates that the demand for an AGV to perform $T T_{jl}$ is urgent.

Figure 5.

Hormone secretion curve of machine stimulated by transportation task.

Hormone secretion of AGVs

When an AGV with transport capability senses the stimulation of $H_{m}^{jl} (t)$ , the AGV will secrete hormone according to the secretion speed proposed in equation (13)

S_{k} (H_{m}^{jl} (t)) = {\begin{matrix} S_{k}^{basal} + a_{H} F_{down} (H_{m}^{jl} (t)), H_{m}^{jl} (t) < c \\ S_{k}^{basal} + a_{H} {F'}_{down} (H_{m}^{jl} (t)), H_{m}^{jl} (t) \geq c \end{matrix}

(13)

where, $S_{k}^{basal}$ is the basal secretion speed of AGV_k and $S_{k}^{basal} \geq 0$ .

An example of hormone secretion speed curve of AGV stimulated by $H_{m}^{jl} (t)$ (Figure 6) is plotted in accordance with equation (13). Affected by the inhibition of $H_{m}^{jl} (t)$ , the secretion speed of AGV_k reduces as time goes on. When $t \geq c t_{jl}$ , $H_{m}^{jl} (t)$ will speed up to inhibit the hormone secretion of AGV_k, to assure that the machine with higher hormone concentration $(H_{m}^{jl} (t))$ can be selected more easily.

Figure 6.

Hormone secretion speed curve of AGV stimulated by $H_{m}^{jl} (t)$ .

Besides $H_{m}^{jl} (t)$ , $T T_{jl}$ can also stimulate AGV_k to secrete hormone. In such case, stimulated by $T T_{jl}$ , AGV_k computes the time node $(ul t_{jl})$ to complete $T T_{jl}$ according to equation (10). The performance of AGV_k to finish $T T_{jl}$ depends on the time interval between $ul t_{jl}$ and $s t'_{jl + 1}$ , where $s t'_{jl + 1}$ is the earliest and estimated start time of the next operation of job j under the constraints. Thus, stimulated by the performance of an AGV to finish a transportation task, the AGV secretes hormone in accordance with equation (2) as follows

S_{k} (ul t_{jl}) = {\begin{matrix} S_{k}^{basal} + a_{ult} F_{down} (ul t_{jl}), ul t_{jl} < s {t'}_{jl + 1} \\ S_{k}^{basal} + a_{ult} F_{up} (ul t_{jl}), ul t_{jl} \geq s {t'}_{jl + 1} \end{matrix}

(14)

When $ul t_{jl} < s t'_{jl + 1}$ , the hormone secretion of AGV_k complies with the down-Hill function, otherwise complies with the up-Hill function.

An example of hormone secretion speed curve of AGV stimulated by ult (Figure 7) is plotted according to equation (14). When $ul t_{jl}$ is close to $s t'_{jl + 1}$ , the secretion speed is slower. It indicates that AGV_k can be a better option to complete $T T_{jl}$ , thus it is easier for AGV_k to be selected; on the contrary, when $ul t_{jl}$ is far from $s t'_{jl + 1}$ , the secretion speed is faster. It indicates that AGV_k can be a worse option to complete $T T_{jl}$ , thus it is more difficult for AGV_k to be selected.

Figure 7.

Hormone secretion speed curve of AGV stimulated by ult.

As mentioned above, the hormone secretion of AGV_k is simultaneously influenced by two independent hormones ( $H_{m}^{jl} (t)$ and $ul t_{jl}$ ). Thus, stimulated by both $H_{m}^{jl} (t)$ and $ul t_{jl}$ at the same time, AGV_k secretes hormone in accordance with the speed following equation (15)

S_{k} (H_{m}^{j l} (t), u l t_{j l}) = {\begin{array}{l} a_{H} F_{down} (H_{m}^{j l} (t)) + a_{u l t} F_{down} (u l t_{j l}) + S_{k}^{b a s a l}, t < c t_{j l}, u l t_{j l} < s {t^{'}}_{j l + 1} \\ a_{H} F_{down} (H_{m}^{j l} (t)) + a_{u l t} F_{up} (u l t_{j l}) + S_{k}^{b a s a l}, t < c t_{j l}, u l t_{j l} \geq s {t^{'}}_{j l + 1} \\ a_{H} {F^{'}}_{down} (H_{m}^{j l} (t)) + a_{u l t} F_{down} (u l t_{j l}) + S_{k}^{b a s a l}, t \geq c t_{j l}, u l t_{j l} < s {t^{'}}_{j l + 1} \\ a_{H} {F^{'}}_{down} (H_{m}^{j l} (t)) + a_{u l t} F_{up} (u l t_{j l}) + S_{k}^{b a s a l}, t \geq c t_{j l}, u l t_{j l} \geq s {t^{'}}_{j l + 1} \end{array}

(15)

Decision making

When a machine senses the set ${S_{k} (H_{m}^{jl} (t), ul t_{jl})}$ , it will allocate $T T_{jl}$ to an AGV with the minimum secretion speed of hormone at time t according to equation (16)

S_{k} (t) = min_{k \in K} {S_{k} (H_{m}^{jl} (t), ul t_{jl})}

(16)

A machine selects the right (i.e. optimal) AGV according to the secretion speed of hormone, in which a machine’s need for an AGV and the performance of an AGV to perform a transportation task are taken into account simultaneously. In the selection of a transportation task, a weighted loading time is proposed as follow

l {\tilde{t}}_{k}^{jl} = \frac{({lt}_{k}^{jl} - t)}{H_{m}^{jl} (t)}

(17)

The weighted loading time reflects transportation efficiency between different tasks considering the influence of hormone $H_{m}^{jl} (t)$ . When an AGV senses the set ${H_{m}^{jl} (t), T T_{jl}}$ from different machines, it will select the transportation task with the minimum weighted loading time in accordance with equation (18)

l t'_{k} = min_{j \in J, l \in L} {l {\tilde{t}}_{k}^{jl}}

(18)

Therefore, stimulated by multiple tasks to transport, an AGV will choose the task with the highest transportation efficiency to secrete hormone. Taking transportation tasks as the communication media of mutual selection between AGVs and machines, the arrival of tasks on time and the transportation efficiency of the AGV system can be ensured simultaneously. In the processes of optimization, AGV can select the next task to transport ahead of schedule, so the coherence of processing between previous and the next operations can be guaranteed.

Distributed cooperation mechanism for on-line scheduling

In this section, a distributed cooperation mechanism for on-line scheduling is elaborated. This mechanism is mainly to solve mutual selection and optimization between machines and AGVs. The goal of the mechanism is that the distributed system can achieve an optimized production status and maintain a high production level. As shown in Figure 8, machines and AGVs are considered autonomous and cooperative cells³⁹ that follow the steps given below to conduct their inherent operations:

Step 1. When an operation task $(T O_{jl})$ is performed on one machine (M_m) at current time (t), the subsequent transportation task $(T T_{jl})$ will be allocated to an AGV by machine cell m. Stimulated by $T T_{jl}$ , machine cell m secretes hormone $(H_{m}^{jl} (t))$ according to the deviation between the completion time (ct_jl) and t.

Step 2. Machine cell m releases hormone information $(H_{m}^{jl} (t), T T_{jl})$ into the shop floor environment.

Step 3. When AGV cell k senses the set ${H_{m}^{jl} (t), T T_{jl}}$ , it will check its transportation capacity. If the number of transportation task is “0” or “1,” it means that AGV_k is available for transportation; otherwise, AGV cell k feeds back the maximum hormones to the related machine cells, and goes to Step (6).

Step 4. AGV cell k extracts the required information from the set ${H_{m}^{jl} (t), T T_{jl}}$ and computes the weighted loading time set ${l {\tilde{t}}_{k}^{jl}}$ according to equation (17). Then, AGV cell k selects the transportation task with the highest efficiency $(TT')$ in accordance with equation (18).

Step 5. Stimulated by $(H_{m}^{jl} (t), TT')$ , AGV cell k calculates the hormone secretion speed $(S_{k}^{TT'} (t))$ according to equation (15).

Step 6. AGV cell k feeds back hormone information $(S_{k}^{TT'} (t))$ to the corresponding machine cell.

Step 7. When machine cell m senses the set ${S_{k} (t)}$ from different AGV cells, it awards $T T_{jl}$ to the AGV with the minimum hormone secretion speed in accordance with equation (16).

Step 8. A loop between Steps (1)–(7) is repeated until all the transportation tasks are allocated, then the makespan is selected according to equation (11).

Figure 8.

Distributed cooperation mechanism between machines and AGVs.

Using this allocation mechanism, the machines can allocate the transportation tasks according to secretion speed of hormone and the AGVs can select the transportation tasks with the premise of transportation efficiency. Finally, the objective of distributed and on-line scheduling of machines and AGVs can be achieved.

Experimental study

In order to simulate the proposed hormone regulation–based approach (HRA) for on-line scheduling, a series of instances were selected from the benchmarks of Bilge and Ulusoy.¹³ These instances were used in both off-line and on-line scheduling by many researchers.^{11,13–17,30} In this article, the performance comparison between our proposal against off-line¹⁶ and on-line³⁰ approaches of the specialized literature was carried out. In the experiments, the performance measure selected was makespan. The performance of the off-line approach is considered as the lower bound of on-line approaches. The constraints and assumptions of the experiments were in the following:

One operation cannot be started before its preceding operations are finished and each machine is provided with sufficient input/output buffer space.

The processing parameters of the operation tasks are deterministic such as operation time and setup time.

All AGVs work with the same speed and transport a single task at a time.

Preemption is not allowed in transportation, that is, once task transportation is started, it must be finished without interruption.

Disturbances such as conflict, deadlock, delay, and resource malfunction, are not considered.

Let’s assume an experimental scenario in which two AGVs travel between four machines and one load/unload (L/U) station. Figure 9 shows the layout schemes of the instances, Table 1 lists the transportation time matrix of AGV, and Table 2 gives the data sets of jobs. In the design of this test problem, the ratio between transportation time and operation time is taken into consideration as a significant characteristic. The ratio can be described as $\bar{tt} / \bar{pt}$ , where $\bar{tt}$ represents the average value of the transportation time in the matrix and $\bar{pt}$ indicates the average value of all the operation time in the job sets. According to the ratio ( $\bar{tt} / \bar{pt}$ ), the problems can be divided into two groups: the one with relatively low ratio ( $\bar{tt} / \bar{pt} < 0.25$ ) and the other with relatively high ratio ( $\bar{tt} / \bar{pt} > 0.25$ ).

Table 1.

Transportation time matrix of AGV.¹³

	L/U	M1	M2	M3	M4
Layout 1
L/U	0	6	8	10	12
M1	12	0	6	8	10
M2	10	6	0	6	8
M3	8	8	6	0	6
M4	6	10	8	6	0
Layout 2
L/U	0	4	6	8	6
M1	6	0	2	4	2
M2	8	12	0	2	4
M3	6	10	12	0	2
M4	4	8	10	12	0
Layout 3
L/U	0	2	4	10	12
M1	12	0	2	8	10
M2	10	12	0	6	8
M3	4	6	8	0	2
M4	2	4	6	12	0
Layout 4
L/U	0	4	8	10	14
M1	18	0	4	6	10
M2	20	14	0	8	6
M3	12	8	6	0	6
M4	14	14	12	6	0

L/U: load/unload.

Table 2.

Data sets of jobs.¹³

JobSet1	JobSet2
Job1: M1(8); M2(16); M4(12)	Job1: M1(10); M4(18)
Job2: M1(20); M3(10); M2(18)	Job2: M2(10); M4(18)
Job3: M3(12); M4(8); M1(15)	Job3: M1(10); M3(20)
Job4: M4(14); M2(18)	Job4: M2(10); M3(15); M4(12)
Job5: M3(10); M1(15)	Job5: M1(10); M2(15); M4(12)
	Job6: M1(10); M2(15); M3(12)
JobSet3	JobSet4
Job1: M1(16); M3(15)	Job 1: M4(11); M1(10); M2(7)
Job2: M2(18); M4(15)	Job2: M3(12); M2(10); M4(8)
Job3: M1(20); M2(10)	Job3: M2(7); M3(10); M1(9); M3(8)
Job4: M3(15); M4(10)	Job4: M2(7); M4(8); M1(12); M2(6)
Job5: M1(8); M2(10); M3(15); M4(17)	Job5: M1(9); M2(7); M4(8); M2(10); M3(8)
Job6: M2(10); M3(15); M4(8); M1(15)
JobSet5	JobSet6
Job1: M1(6); M2(16); M4(9)	Job1: M1(9); M2(11); M4(7)
Job2: M1(18); M3(6); M2(15)	Job2: M1(19); M2(20); M4(13)
Job3: M3(9); M4(3); M1(12)	Job3: M2(14); M3(20); M4(9)
Job4: M4(6); M2(15)	Job4: M2(14); M3(20); M4(9)
Job5: M3(3); M1(9)	Job5: M1(11); M3(16); M4(8)
	Job6: M1(10); M3(12); M4(10)
JobSet7	JobSet8
Job1: M1(6); M3(6)	Job1: M2(12); M3(21); M4(11)
Job2: M2(11); M4(9)	Job2: M2(12); M3(21); M4(11)
Job3: M2(9); M4(7)	Job3: M2(12); M3(21); M4(11)
Job4: M3(16); M4(7)	Job4: M2(12); M3(21); M4(11)
Job5: M1(9); M3(18)	Job5: M1(10); M2(14); M3(18); M4(9)
Job6: M2(13); M3(19); M4(6)	Job6: M1(10); M2(14); M3(18); M4(9)
Job7: M1(10); M2(9); M3(13)
Job8: M1(11); M2(9); M4(8)
JobSet9	JobSet10
Job1: M3(9); M1(12); M2(9); M4(6)	Job1: M1(11); M3(19); M2(16); M4(13)
Job2: M3(16); M2(11); M4(9)	Job2: M2(21); M3(16); M4(14)
Job3: M1(21); M2(18); M4(7)	Job3: M3(8); M2(10); M1(14); M4(9)
Job4: M2(20); M3(22); M4(11)	Job4: M2(13); M3(20); M4(10)
Job5: M3(14); M1(16); M2(13); M4(9)	Job5: M1(9); M3(16); M4(18)
	Job6: M2(19); M1(21); M3(11); M4(15)

Figure 9.

Layout schemes.¹³

All procedures were implemented in JAVA under JDK1.7.0 and the experimental tests were carried out on a 2.0 GHz Intel Core Duo computer with 2 GB RAM under Windows 7. Combining the 10 job sets and the 4 layout schemes from Tables 1 and 2, 82 test instances were created. These instances were tested using an off-line HA,¹⁶ a MAS approach,³⁰ and the proposed HRA. The off-line HA determined a lower bound of the makespan, so the aim of experimental study is to compare our proposal (HRA) against MAS and determine the deviation of both MAS and HRA with respect to HA (Dev1, Dev2). Thus, we also show the deviation of HRA with respect to MAS (Dev3). The results for the case $\bar{tt} / \bar{pt} > 0.25$ are listed in Table 3 and for the case of $\bar{tt} / \bar{pt} < 0.25$ are shown in Table 4. The two numbers following EX represent the series of job set and the layout scheme. In two tables, the bold values represent optimal makespan of the three approaches. In Table 4, number “0” or “1” in the last position indicates that the operation times are doubled or tripled, respectively, and in both cases transportation times are halved.

Table 3.

Comparison results in the case of $\bar{tt} / \bar{pt} > 0.25$

		HA¹⁶	MAS³⁰		HRA
Instance	$\bar{tt} / \bar{pt}$	makespan	makespan	Dev1 (%)	makespan	Dev2 (%)	Dev3 (%)
EX11	0.59	96	130	35.42	122	27.08	−6.15
EX21	0.61	100	143	43.00	140	40.00	−2.10
EX31	0.59	99	142	43.43	148	49.49	4.23
EX41	0.91	112	198	76.79	174	55.36	−12.12
EX51	0.85	87	130	49.43	129	48.26	−0.77
EX61	0.78	118	153	29.66	153	29.66	0.00
EX71	0.78	111	129	16.22	146	31.53	13.18
EX81	0.58	161	196	21.74	199	23.60	1.53
EX91	0.61	116	178	53.45	147	26.72	−17.42
EX101	0.55	147	188	27.89	175	19.05	−6.91
EX12	0.47	82	98	19.51	100	21.95	2.04
EX22	0.49	76	86	13.16	86	13.16	0.00
EX32	0.47	85	114	34.12	114	34.12	0.00
EX42	0.73	87	129	48.28	120	37.93	−6.98
EX52	0.68	69	98	42.03	100	44.93	2.04
EX62	0.54	98	123	25.51	106	8.16	−13.82
EX72	0.62	79	92	16.46	101	27.85	9.78
EX82	0.46	151	172	13.91	156	3.31	−9.30
EX92	0.49	102	123	20.59	127	24.51	3.25
EX102	0.44	135	154	14.07	158	17.04	2.60
EX13	0.52	84	109	29.76	102	21.43	−6.42
EX23	0.54	86	98	13.95	96	11.63	−2.04
EX33	0.51	86	103	19.77	115	33.72	11.65
EX43	0.80	89	155	74.16	127	42.70	−18.06
EX53	0.74	74	109	47.30	113	52.70	3.67
EX63	0.54	103	128	24.27	110	6.80	−14.06
EX73	0.68	83	93	12.05	119	43.37	27.96
EX83	0.50	153	172	12.42	167	9.15	−2.91
EX93	0.53	105	119	13.33	122	16.19	2.52
EX103	0.49	139	158	13.67	159	14.39	0.63
EX14	0.74	103	168	63.11	162	57.28	−3.57
EX24	0.77	108	169	56.48	156	44.44	−7.69
EX34	0.74	111	167	50.45	170	53.15	1.80
EX44	1.14	126	242	92.06	217	72.22	−10.33
EX54	1.06	96	168	75.00	160	66.67	−4.76
EX64	0.78	120	189	57.50	182	51.67	−3.70
EX74	0.97	126	156	23.81	180	42.86	15.38
EX84	0.72	163	251	53.99	243	49.08	−3.19
EX94	0.76	122	181	48.36	170	39.34	−6.08
EX104	0.69	158	246	55.70	222	40.51	−9.76
MTD				37.04		33.83	−1.65

MTD: mean total deviation. The bold values represent optimal makespan of the three approaches.

Table 4.

Comparison results in the case of $\bar{tt} / \bar{pt} < 0.25$ .

		HA¹⁶	MAS³⁰		HRA
Instance	$\bar{tt} / \bar{pt}$	makespan	makespan	Dev1 (%)	makespan	Dev2 (%)	Dev3 (%)
EX110	0.15	126	135	7.14	131	3.97	−2.96
EX210	0.15	148	157	6.08	151	2.03	−3.82
EX310	0.15	150	154	2.67	156	4.00	1.30
EX410	0.15	119	211	77.31	129	8.40	−38.86
EX510	0.21	102	118	15.69	108	5.88	−8.47
EX610	0.16	186	204	9.68	189	1.61	−7.35
EX710	0.19	137	138	0.73	150	9.49	8.70
EX810	0.14	272	330	21.32	287	5.51	−13.03
EX910	0.15	176	191	8.52	190	7.95	−0.52
EX1010	0.14	238	269	13.03	260	9.24	−3.35
EX120	0.12	123	127	3.25	127	3.25	0.00
EX220	0.12	143	151	5.59	145	1.40	−3.97
EX320	0.12	145	144	−0.69	148	2.07	2.78
EX420	0.12	114	161	41.23	121	6.14	−24.84
EX520	0.17	100	110	10.00	104	4.00	−5.45
EX620	0.12	181	196	8.29	181	0.00	−7.65
EX720	0.15	136	132	−2.94	144	5.88	9.09
EX820	0.11	287	319	11.15	287	0.00	−10.03
EX920	0.12	173	187	8.09	181	4.62	−3.21
EX1020	0.11	236	266	12.71	250	5.93	−6.02
EX130	0.13	122	134	9.84	127	4.10	−5.22
EX230	0.13	146	151	3.42	147	0.68	−2.65
EX330	0.13	146	129	−11.64	154	5.48	19.38
EX430	0.13	114	228	100.00	126	10.53	−44.74
EX530	0.18	99	111	12.12	110	11.11	−0.90
EX630	0.14	182	198	8.79	183	0.55	−7.58
EX730	0.17	137	132	−3.65	146	6.57	10.61
EX830	0.13	288	273	−5.21	288	0.00	5.49
EX930	0.13	174	187	7.47	183	5.17	−2.14
EX1030	0.12	237	266	12.24	245	3.38	−7.89
EX140	0.18	124	137	10.48	138	11.29	0.73
EX241	0.13	217	230	5.99	224	3.23	−2.61
EX340	0.18	151	155	2.65	167	10.60	7.74
EX341	0.12	221	227	2.71	232	4.98	2.20
EX441	0.19	172	344	100.00	187	8.72	−45.64
EX541	0.18	148	158	6.76	158	6.76	0.00
EX640	0.19	184	211	14.67	189	2.72	−10.43
EX740	0.24	137	158	15.337	154	12.41	−2.53
EX741	0.16	203	206	1.48	214	5.42	3.88
EX840	0.18	293	331	12.97	293	0	−11.48
EX940	0.19	175	195	11.43	191	9.14	−2.051
EX1040	0.17	240	276	15.00	253	5.42	−8.33
MTD				14.09		5.23	−5.28

MTD: mean total deviation. In two tables, the bold values represent optimal makespan of the three approaches.

The results show that our approach HRA outperforms MAS in most instances of Tables 3 and 4. It can be observed that HA obtained the best results in almost all instances due to the fact that it is an off-line heuristic and all information of the scheduling problem is known in advance.

From the results in Table 3, the mean total deviation (MTD) of HRA to HA is 33.83%, which means that HRA does not go beyond HA in makespan. This result is in accordance with our expectations as HRA is not an off-line algorithm but on-line and distributed approach. Compared with an on-line approach (MAS), 55% of the results from HRA are better than MAS and the MTD of HRA to MAS is −1.65%. Thus, HRA shows better performance in makespan. From the results in Table 4, the performance of HRA is better. Compared with on-line approach, the performance of HRA is better than MAS in 69% test instances and the MTD of HRA to MAS is −5.28%. Because the MTD of HRA to HA is 5.23%, it shows that the optimization capability of our approach is closed to off-line method. Similar results are obtained for EX110, EX220, EX630, and so on. In other instance of EX820, is shows the same performance with HA. Similar results are obtained for EX 620, EX830, and EX 840. By comparing the results, it is clear that HRA exhibits better performance in the case of relatively low $\bar{tt} / \bar{pt}$ ratio. As discussed above, the HRA shows the potential to improve the performance in terms of distributed an on-line scheduling of machines and AGVs.

The Gantt chart of instance EX23 is shown in Figure 10. The numbers in the Gantt chat represent the serial number of tasks. For example, the number “21” in M2 represents the first operation task of job2 and the number “21” in AGV1 indicates the first transportation of job2. As can be seen from the Gantt chart, at the time 48, a new round of mutual selection between machines and AGVs starts; two AGVs have the transportation capacity to accept more transportation tasks; and operations “61,”“52,” and “32” demand AGVs for transportation. In AGV selection stage, affected by the hormone H and loading time, the two AGVs select the operation “61” with the lowest weighted loading time; then in machine selection stage, AGV2 is selected as the winner. Because compared with AGV1, AGV2 can finish the task with lower deviation and the hormone secretion speed is lower than AGV1. The mean value of transportation task of AGV is 11.2 which can be computed using the data in Table 1. As shown in the Gantt chart, 21 transportation tasks are implemented by two AGVs and the distribution of time for AGVs is shown in Figure 11. Of the transportation tasks, 90.48% have time consumption less than 15. As shown in Figure 12, the utilization rate of two AGVs remains at a high and balanced level.

Figure 10.

Gantt chart of EX23.

Figure 11.

Distribution of time for AGVs.

Figure 12.

Utilization rates of AGVs and machines.

Conclusion

In this article, HRA for distributed and on-line scheduling of machines and AGVs is proposed. The principle of hormone diffusion and reaction in endocrine system provides a new information processing method for the on-line scheduling model to agilely cope with new arrival tasks. According to hormone-regulation mechanism, the deviations between completion time and planned time in on-line allocation processes are used to optimize makespan. Thus, in the mutual selection between machines and AGVs, machines can allocate transportation tasks according to the minimum secretion speed of hormone and AGVs can select transportation tasks with the highest transportation efficiency. As the tasks are well allocated, good performances of the system can be obtained.

The proposed approach was tested and compared with classical instances in the literature. The performance of HRA was close to off-line approaches. Especially in the low ratio, the performance in some instances was the same with off-line approaches. Compared with the on-line approach, performance of HRA was better in more than half of the test instances, and the rest was the same or close to. The results show that HRA reflects a promising performance in terms of distributed and on-line scheduling of machines and AGVs. The application of hormone regulation in this area shows great potential. Especially, its reaction and diffusion mechanisms can quickly respond and satisfy scheduling requirements in the system. And it expands the view of research on dynamic scheduling problems. Future research can be directed toward the decision-making modules in different stages to improve the performances of the scheduling approach. Besides, the proposed approach can be enhanced taking into account conflict, deadlock, delay, recourse malfunction, rush orders, and so on.

Footnotes

Declaration of conflicting interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was sponsored by the National Natural Science Foundation of China (NSFC) under Grant Nos 51175262 and 51575264 and the Jiangsu Province Science Foundation for Excellent Youths under Grant No. BK2012032. This research was also sponsored by the CASES project which was supported by a Marie Curie International Research Staff Exchange Scheme Fellowship within the 7th European Community Framework Programme under grant agreement no. 294931.

References

Lin

Shinn

Gen

et al . Network model and effective evolutionary approach for AGV dispatching in manufacturing system. J Intell Manuf 2006; 17(4): 465–477.

Qiu

Hsu

Huang

et al . Scheduling and routing algorithms for AGVs: a survey. Int J Prod Res 2002; 40(3): 745–760.

Dotoli

Fanti

MP.

Coloured timed Petri net model for real-time control of automated guided vehicle systems. Int J Prod Res 2004; 42(9): 1787–1814.

Mohammed

Khan

WU.

Implementation issues of AGVs in flexible manufacturing system: a review. Global J Flex Syst Manag 2010; 11(1–2): 55–62.

Singh

Sarngadharan

Pal

PK.

AGV scheduling for automated material distribution: a case study. J Intell Manuf 2011; 22(2): 219–228.

Shah

Lin

Nagi

A production order-driven AGV control model with object-oriented implementation. Comput Integr Manuf 1997; 10(96): 35–48.

Blazevicz

Eiselt

Finke

et al . Scheduling tasks and vehicles in a flexible manufacturing system. Int J Flex Manuf Sys 1991; 4(1): 5–16.

Kesen

Das

Güngör

A genetic algorithm based heuristic for scheduling of virtual manufacturing cells (VMCs). Comput Oper Res 2010; 37(6): 1148–1156.

Vijay Kumar

Murthy

ANN

Chandrasekhara

. Dynamic scheduling of flexible manufacturing system using heuristic approach. Opsearch 2011; 48(1): 1–19.

10.

Bülbül

A hybrid shifting bottleneck-tabu search heuristic for the job shop total weighted tardiness problem. Comput Oper Res 2011; 38(6): 967–983.

11.

Babu

Jerald

Haq

et al . Scheduling of machines and automated guided vehicles in FMS using differential evolution. Int J Prod Res 2010; 48(16): 4683–4699.

12.

Confessore

Fabiano

Liotta

A network flow based heuristic approach for optimising AGV movements. J Intell Manuf 2013; 24(2): 405–419.

13.

Bilge

Ulusoy

A time window approach to simultaneous scheduling of machines and material handling system in an FMS. Oper Res 1995; 43(6): 1058–1070.

14.

Ulusoy

Sivrikaya-Şerifoǧlu

Bilge

A genetic algorithm approach to the simultaneous scheduling of machines and automated guided vehicles. Comput Oper Res 1997; 24(4): 335–351.

15.

Abdelmaguid

Nassef

Kamal

et al . A hybrid GA/heuristic approach to the simultaneous scheduling of machines and automated guided vehicles. Int J Prod Res 2004; 42(2): 267–281.

16.

Reddy

BSP

Rao

CSP

. A hybrid multi-objective GA for simultaneous scheduling of machines and AGVs in FMS. Int J Adv Manuf Tech 2006; 31(5): 602–613.

17.

Lacomme

Larabi

Tchernev

Job-shop based framework for simultaneous scheduling of machines and automated guided vehicles. Int J Prod Econ 2013; 143(1): 24–34.

18.

Sabuncuoglu

Hommertzheim

DL.

Dynamic dispatching algorithm for scheduling machines and automated guided vehicles in a flexible manufacturing system. Int J Prod Res 1992; 30(5): 1059–1079.

19.

Le-Anh

De Koster

MBM

. A review of design and control of automated guided vehicle systems. Eur J Oper Res 2006; 171(1): 1–23.

20.

Vis

IFA

. Survey of research in the design and control of automated guided vehicle systems. Eur J Oper Res 2006; 170(3): 677–709.

21.

Ghasemzadeh

Behrangi

Azgomi

MA.

Conflict-free scheduling and routing of automated guided vehicles in mesh topologies. Robot Auton Syst 2009; 57(6–7): 738–748.

22.

Liu

Yih

A multiple-attribute method for concurrently solving the pickup-dispatching problem and the load-selection problem of multiple-load AGVs. J Manuf Syst 2012; 31(3): 288–300.

23.

Lee

Choi

Lee

et al . A study for AGV steering control and identification using vision system. In: Proceedings of IEEE international symposium on industrial electronics, Pusan, Korea, 12–16 June 2001, vol. 3, pp.1575–1578. New York: IEEE.

24.

Lau

Woo

HSO

. An agent-based dynamic routing strategy for automated material handling systems. Int J Comp Integ M 2007; 21(3): 269–288.

25.

Morten

Olivier

RD.

Holonic shop-floor application for handling, feeding and transportation of workpieces. Int J Prod Res 2011; 49(5): 1441–1454.

26.

Babiceanu

Chen

Sturges

RH.

Real-time holonic scheduling of material handling operations in a dynamic manufacturing environment. Robot Comput Integr Manuf 2005; 21(4–5): 328–337.

27.

Singh

Tiwari

MKS

. Intelligent agent framework to determine the optimal conflict-free path for an automated guided vehicles system. Int J Prod Res 2010; 40(16): 4195–4223.

28.

Breton

Maza

Castagna

. A multi-agent based conflict-free routing approach of bi-directional automated guided vehicles. In: Proceedings of the 2006 American control conference, Minneapolis, N, 14–16 June 2006, pp.2825–2830. New York: IEEE.

29.

Wallace

Multi-agent negotiation strategies utilizing heuristics for the flow of AGVs. Int J Prod Res 2007; 45(2): 309–322.

30.

Erol

Sahin

Baykasoglu

et al . A multi-agent based approach to dynamic scheduling of machines and automated guided vehicles in manufacturing systems. Appl Soft Comput 2012; 12(6): 1720–1732.

31.

Zahadat

Schmickl

Generation of diversity in a reaction-diffusion-based controller. Artif Life 2014; 20(3): 319–342.

32.

Hamann

Stradner

Schmickl

et al . Artificial hormone reaction networks: towards higher evolvability in evolutionary multi-modular robotics. In: Proceedings of the ALife XII conference, Odense, 19–23 August 2010, pp.773–780. Cambridge, MA: MIT Press.

33.

Qin

Kan

Production dynamic scheduling method based on improved contract net of multi-agent. In: Z

(eds) Intelligence computation and evolutionary computation. Berlin, Heidelberg: Springer, 2013, pp.929–936.

34.

Rajabinasab

Mansour

Dynamic flexible job shop scheduling with alternative process plans: an agent-based approach. Int J Adv Manuf Tech 2011; 54(9): 1091–1107.

35.

Kouider

Bouzouia

Multi-agent job shop scheduling system based on co-operative approach of idle time minimisation. Int J Prod Res 2012; 50(2): 409–424.

36.

Zheng

Tang

Giret

et al . Dynamic shop floor re-scheduling approach inspired by a neuroendocrine regulation mechanism. Proc IMechE, Part B: J Engineering Manufacture 2015; 229(S1): 121–134.

37.

Budilova

Teriokhin

AT.

Endocrine networks. In: IEEE symposium on neuroinformatics and neurocomputers, Rostov-on-Don, 7–10 October 1992, vol. 2, pp.729–737. New York: IEEE.

38.

Farhy

LS.

Modeling of oscillations of endocrine networks with feedback. Method Enzymol 2004; 384: 54–81.

39.

Tang

Wang

et al . A neuroendocrine-inspired approach for adaptive manufacturing system control. Int J Prod Res 2011; 49(5): 1255–1268.