Abstract
Internet of Things or wireless sensor networks (WSNs) can be utilized in monitoring electrical power consumption. For electrical power application, the main issue is how to effectively apply self-organized WSNs technology to handle the last mile communication and supply the reliable, real-time transmission. For example, great number of renewable generators' instantaneous voltage and power parameters should be reported in real time to dispatching center, which is the primary guarantee to keep the power system's stability. In this paper, integrating traffic engineering and distributed agent technologies, a novel distributed agents QoS routing algorithm is proposed to transmit electrical information flows with multi-QoS constraints. The algorithm can explore fast forward path with multiagents and guarantee transmitting quality with smooth allocating different traffic. We also present the mathematical analysis to prove the algorithm's validity. Finally, in the computer simulation, the average end-to-end delay, routing overhead, and links' bandwidth occupation ratio are computed to evaluate the algorithm performance. Coincident results show that the new algorithm can provide short end-to-end transmission with optimal utilized communication resource. A health infrastructure with load balance can effectively avoid the potential congestion and has robust capability to bear abrupt strong traffic flows.
1. Introduction
In intelligent home system, Internet of Things (IoTs) or wireless sensor networks (WSNs) are widely employed to transmit different kinds of information, in which electrical power consumption is one of important information effects on people's daily life. On the other hand, smart grid systems also require real-time electrical power consumption information from consumer sides [1, 2]. It is necessary to design a network architecture that is capable of providing secure and reliable end-to-end communication among intelligent electrical meters, power supply system, and consumers [1, 3].
Presently, there are a number of wired communication technologies and standards that can be used in electrical power communication networks, such as 100 Gbps optical fibers physical infrastructure, Synchronous Digital Hierarchy (SDH) technology, and Automatically Switched Optical Network (ASON) architecture [4]. But there is also another important challenge that is to provide a reliable and flexible last mile communication. Wireless communication technique and self-organized networks theory with the qualities of easy access and cost effectiveness have been extensively considered [5].
For the electrical power application, the main issue is how to effectively apply self-organized WSNs technology to handle the last mile communication and supply the reliable, real-time transmission. As it is well known, many adverse factors in application scene affect data delivery integrally. Unattended sensor nodes have miniaturization size (mm scale for smart dust motes) and low-reliability hardware circuit when coping with harsh conditions, such as the industrial utilization. In addition, different kinds of atrocious conditions and unpredictable accidents are also prone to fail in data transmission, such as from physical damage to the node or malicious attack to the system. Moreover, even if the condition of the hardware is healthy, the communication between sensor nodes is always affected by many factors, such as fading, signal strength, obstacles, weather conditions, and interference.
On the other hand, while WSNs get the benefit from data aggregation via “intranetwork processing” to reduce communication costs and improve energy efficiency, the aggregated data carries more information than each individual data packet [6]. Losing any part of the aggregated data or long transmission delay will incur a fatal failure. Hence, guaranteeing data delivery multi-QoS and integrality is greatly challenging, which are distinctive from contemporary wireless cellular communications and wireless ad hoc networks [7, 8].
Considering the electrical power application, in one self-governed smart grid, different kinds of electric information are transmitted among digital secondary meters, called microflows. Different kinds of electrical parameter flows, including switchgear's boolean controlling variable, feeder voltage/current analog signals, and incorrect information files, have different QoS requirements. To control multiple microgrids combined and divided, voltage and power parameter should be reported in real time to dispatching center. Different transmitting attributes of information flows in digital electronics secondary equipments are ubiquitous, in which distributed topologic control and fast protocols should be employed to accurately operate micro grid combined or divided in smart grid system [4]. Unfortunately, achieving multiple kinds of flow requirements in electric power communication networks is NP-complete problem.
Integrating traffic engineering and distributed agent technologies, the paper proposes a novel electrical information flow transmitting algorithm-Distributed Agents QoS Routing Algorithm (DAQRA). The algorithm can explore fast forward path with multiagents and guarantee transmitting quality. Moreover, DAQRA can make the scarce resource in WSNs optimal used by smooth allocating different traffic, with which congestion can be efficiently avoided, and the capability of bidirectional communication is enhanced. In the following section, we will present this algorithm in detail and provide an evaluation of its effectiveness based on mathematical analysis and computing simulations.
The remainder of this paper is organized as follows. Section 2 presented the related work; Section 3 established the mathematical model for the routing in last mile access wireless sensor networks; Section 4 described DAQRA algorithm in detail and presented the algorithm's validity with accurate mathematical analysis; Section 5 described the computer simulation and analyzed the results; Section 6 presented the final conclusion.
2. Related Work
The chief assignment of wireless sensor network is measure and transmitting quantity of distributed data to users, which decides the difference between WSN and traditional networks. The end-to-end transmission, such as IP telephone service in 3G or 4G cellular mobile communication network, is rarely used in WSN; moreover, its star-shaped topological structures in an infrastructure network are greatly different from the self-original structure of sensor networks. Protocols using in ad hoc consider how to provide a trusted point-to-point interconnection in highly mobilized environment.
In WSNs, unicast and multicast (or reverse-multicast model), such as multiple data sources transmitting to single data recipient (Sink), are always appointed [9]. To achieve these requirements with energy efficiency, many protocols have been studied [10–12]. He et al. [13] proposed SPEED, a protocol which combines feedback control and nondeterministic QoS aware geographical forwarding. Felemban et al. [14] proposed the multipath and multispeed routing protocol (MMSPEED) to provide a probabilistic QoS guarantee in WSNs. The algorithm used different delivery speeds and probabilistic multipath forwarding in the reliability domain to transmit data with multiple QoS levels. Djenouri and Balasingham [15] proposed a traffic-differentiation modular routing protocols to consider localized QoS. It is well known that energy consumption is a prime concern in WSNs. Many studies on energy efficient routing have been proposed [10, 16, 17]. In [10] a multichannel protocol with energy efficient data gathering for wireless sensor networks was designed, EAR-DPS [16] found multiple paths from the source to destination nodes, based on residual energy probability for every neighboring node. Lim and Park proposed energy efficient chain formation (EECF) algorithm to resolve the long-distance data transmission problems [17]. These studies only considered the energy efficiency of routing and did not consider the need to ensure real-time, reliable packets delivery. Only a couple of studies considered a deadline or the reliability of a packet in wireless communication. Considering QoS delivery, Hsu et al. [18] designed a QoS-aware power management method for a kind of spherical energy harvesting sensor network. Mahapatra et al. [19] proposed an energy aware QoS routing protocol for real-time packets. The concept of providing real-time communication is very similar to SPEED and MMSPEED. However, to satisfy real-time transmission with energy efficiency, more overheads are used in the protocol. Some other scholars focus on QoS in forwarding routine data and unusual events in wireless sensor networks.
Different from the WSNs' traditional application, which always detects and perceives single physical metric, different kinds of electrical information have different QoS requirements. For example, to control multimicrogrids combined and divided, the voltage and power parameters should be reported in real time to dispatching center; the correct information files should be transmitted integrally. Different transmitting attributes of information flows among digital electronics secondary equipments are ubiquitous; thus fast forwarding WSNs protocol satisfied multi-QoS is necessary for the electric power communication application.
3. Self-Organized Network Architecture and System Mathematical Model
The architecture of wireless networks plays a crucial role in reliable access among intelligent electrical meters. For instance, to avoid service disruption, routing protocols must be robust to link failures. In most application scenes, covering a residential area may not terminate in a single access point but requires more than one data aggregation point (DAP) to improve the reliability. Figure 1 shows a network architecture that includes communication between home appliances and their home intelligent electrical meters as well as communication between meters and several AMI access points through DAPs. The difference of the novel architecture from traditional network architecture is that a meter represents a home gateway node. It can access to home appliances and has the communication ability to other DAPs located on neighborhood distribution poles. Flexible self-organized network theory and wireless communication technologies, such as PIEEE 802.11s and IEEE 802.15.4, supply the realization [20].

Self-organized network architecture for the last mile wireless communication in smart grid.
As shown in Figure 1, meters are represented as the distributed sensor nodes. DAPs are represented as Sinks. Thus, the novel network architecture is a kind of multiple sinks model. Sensor nodes forward packets containing their measurements or observations information towards any of Sinks. As the above all description, because sensor nodes have limited wireless range, multihop communications are generally required to forward the data to the multiple sinks.
Based on graph theory, sensor nodes can represent vertexes set
To satisfy the electrical information's multi-QoS requirements, the WSNs' mathematic model is a connected and weighted simple graph
Based on the mathematic model, control algorithms should be distributed to compute different kinds of single-source shortest paths from dispatching center to each second equipment or sensor with multi-QoS requirements. Therefore, the attitude of information traffic in electrical power system should be analyzed, and classification model should be built.
Traffic is exchanged among the same class logical nodes. In the smart grid operation, the logical nodes information categories are presented with IEC 61850 as follows.
Common logical node information: information independent of the dedicated function, for example, mode, health, and name plate; Status information: information representing either the status of the process or of the function allocated to the LN, for example, switch type, switch operating capability; Settings: information needed for the function of a logical node, for example, first, second, and third reclose time; Measured values: analogue data measured from the process or calculated in the functions like currents, voltages, power, and so forth, for example, total reactive power, frequency; Controls information: data, which are changed by commands like switchgear state (ON/OFF), resettable counters, for example, position, block opening.
IEC 61850 also defines different kinds of interfaces among the equipments [21]. We specially consider the multiply QoS requirements from the various electrical information in WSNs operation. WSNs must offer characteristics of reliability, availability, and fault-tolerance abilities to collect measuring data, aggregate and transmit them. To achieve these requirements, DAQRA algorithm is designed for dynamic routing with distributed mobile agents, and the established routing path satisfied multi-QoS requirements.
4. Distributed Agents QoS Routing Algorithm Description
4.1. DAQRA Algorithm Process
DAQRA uses distribute agent technique to achieve multi-QoS requirements. Each agent maps a class of flows from same source vertex, which has a unique united measurement, shown in Figure 2.

Format of mobile agent.
The figure shows compound measurements of traffic. Traffic should be transmitted from “Source” vertex to “Destination” one, satisfied with the multiply QoS requirements (1) Select-excellence Operation: weight p is better than q, if and only if
(2) Accumulation Operation: accumulate link
In the electric power communication network, each logical node real-time monitors its interface state and dynamic updates the set of each vertex's attribute measurements
When any data generated from one logical node

Master-slave mobile agents dividing pattern.

Slave-slave mobile agents competing pattern.
Because there are mobile agents' master-slave dividing and slave-slave competing patterns in relay nodes, the agents' arrival time cannot exactly denote the total delay of each delivery path. The really transmitting delay has been recorded in the metric of
4.2. Convergence and Validity
Proposition 1.
Distributed agents QoS routing algorithm can find the single-source shortest path in the bidirectional nonnegative weighted connected graph.
We used the reduction to absurdity to prove this proposition.
Proof.
Supposing the conclusion is erroneous, that is, there is another path shorter than the selected path by DAQRA, assumed (
In the first issue, if there is more than one edge between vertexes i and j, master agent will divide into equal number of slave agents and travel those edges. When the agents reach node j, the weights of each agent must be changed by “Accumulation Operation.” The following “Select-excellence Operation” will exactly select the best one and delete all the others. It means that
In the second issue, if
4.3. Feasibility for Smart Grid Communication
DAQRA is a distributed algorithm to suit for smart grid communication. Each vertex only forwards mobile agent with neighbors in its own time sequence. But, in centralized algorithms, such as Dijkstra algorithm, each subprocess must wait for all of the painted vertexes counting its shortest distance.
Moreover, with distributed agents, DAQRA can maximally achieve multi-QoS requirements in the same time. And characters
5. Simulation and Performance Evaluation
For simulation, we developed a residential networks consisting of 500 nodes in a community location. In this scenario each meter or sensor node is independent of any Sinks. A free space propagation channel model is assumed with the capacity set to 0.5 Mbps; Packet lengths are 1.5 Kbit for data packets, and 256 bits for routing overheads. The buffers for real-rime data and normal data have default size of 30 packets and the packets are generated at a constant rate of 3 packet/sec. The IEEE 802.11 MAC protocol is adopted to detect links' connectivity, in which the mechanism visiting wireless channel is Carrier Sense Multiple Access with Collision Avoidance (CSMA/CA).
The paper simulates DAQRA, AODV, and SPEED in same simulation scenes, and three performance metrics are utilized to evaluated the algorithms' performance. (1) Average end-to-end delay: it is one of primary metrics for real-time transmission, which includes all possible delays caused by buffering during route discovery latency, queuing at the interface queue, retransmission delays at the MAC, and the delivery path repaired times. (2) Routing overhead: number of routing packets in the rectification process, in which all router packets forwarded and received are counted. (3) Bandwidth occupation ratio: the amount of bandwidth has been utilized or reserved in each link, which can be defined as
Here,
5.1. Average End-to-End Delay Analysis
The average end-to-end delay of data packets is one of important QoS factors for the electrical power system WSNs application, especially for real-time application. For example, great number of renewable generators' instantaneous voltage and power parameters should be reported in real time to dispatching center to keep the system's stability. Figure 5 presents such measurement for different algorithms under different traffic load. Because the two previous protocols used routing tables, with which the primal transmission has lower transmitting delay. We can find the 0.138 s delay with the SPEED in the 5% traffic load scenario. However, when traffic load has noticeable increase, SPEED and AODV need to repeatedly update their routing tables to explore alternative hops. Great quantity of routing update packets commingled with heavy traffic load makes the congestion and loss packets occur more often. As a result, the higher the percentage of traffic load is, the more frequent updates are required, and consequently, the longer time is consumed to build paths and transmit data. Comparing with DLS's 0.374 s in 50% failure nodes, SPEED worsened to 0.532 s, and AODV is 0.593 s.

Average end-to-end delay versus traffic load.
5.2. Routing Overhead Analysis
Figure 6 presents routing overhead versus different traffic load. This figure shows that DAQRA causes more number of routing overheads among the three algorithms, mainly because distributed mobile agents are counted in the overhead. To explore the best performance delivery path, DAQRA uses the master-slave mobile agents dividing technology. In SPEED and AODV, each node has a routing table to record all nodes adjacent to the destination. Thus, if the current delivery path to DAPs turns faulty, the two algorithms have to reestablish a new path through its “route discovery” process (the rectification mechanisms in AODV). This process will consume much more routing overhead. As a result, for networks with heavy traffic load, up to 40%, AODV and SPEED consume more routing overhead than DAQRA. When the traffic load percentage reached 50%, DAQRA consumes less 9.43% and 21.07% routing overhead than AODV and SPEED, respectively. Therefore, our algorithm is more suitable for big traffic industrial system application.

Routing overhead versus traffic load.
5.3. Bandwidth Occupation Ratio Analysis
As we know, one of wireless sensor networks inherent defects is the scarce wireless communication resource. Smooth allocating great quantity of traffic to the network and keeping load balance have important significance for WSNs. A health infrastructure with load balance can effectively avoid the potential congestion and have robust capability to bear abrupt strong traffic flows. Bandwidth occupation ratio is employed to evaluate the current traffic allocation, and the standard variance of bandwidth occupation ratio is defined to measure the Load Balance Factor (LBF); the calculation formula is shown as
Here

Standard variance of bandwidth occupation ratio versus traffic load.
6. Conclusion
Smart grid systems require real-time electrical power consumption information communication to keep the stability and controllability. It is necessary to design a network architecture that is capable of providing secure and reliable two-way communication among intelligent electrical meters, power supply system, and consumers. Internet of Things or wireless sensor networks can be employed to realize the reliable and flexible last mile communication. Considering the electrical power application, different kinds of electrical parameter flows transmitted in smart grid, including switchgear's boolean controlling variable, feeder voltage/current analog signals, and incorrect information files have different QoS requirements. Achieving multiply kinds of flow requirements in one connected communication networks is NP-complete problem.
Integrating traffic engineering and distributed agent technologies, the paper proposes distributed agents QoS routing algorithm to transmit electrical information flow with multi-QoS constraints. The algorithm can explore fast forward path with multiagents and guarantee transmitting quality with smooth allocating different traffic. We also present the mathematical analysis to prove the algorithm's validity. Finally, in the computer simulation, the average end-to-end delay, routing overhead, and links' bandwidth occupation ratio are computed to evaluate the algorithm performance. Coincident results show that the new algorithm can provide short end-to-end delivery path with optimal utilized communication resource.
Footnotes
Acknowledgments
This work was sponsored by the National Program of International S&T Cooperation no. 2013DFA11040, the National Natural Science Foundation of China no. 61172014, and the Natural Science Foundation of Tianjin no. 12JCZDJC21300.
