Efficient Routing Strategy with Memory Information for Complex Networks

In this paper, we propose a new packet routing strategy that incorporates memory information for reducing congestion in communication networks. First, we study the conventional routing strategy which selects the paths for transmitting packets to destinations using the distance information and the dynamical information such as the number of accumulating packets at adjacent nodes. Then, we evaluate the effectiveness of this routing strategy for the scale-free networks. From results of numerical simulations, we conclude that this routing strategy is not effective when the density of the packets increases due to the impermeability of the communication network. To avoid this undesirable problem, we incorporate memory information to the routing strategy. By using memory information effectively, packets are spread into the communication networks, achieving a higher performance than conventional routing strategies for various network topologies, such as scale-free networks, small-world networks, and scale-free networks with community structures.


Introduction
As a result of the rapid expansion of the Internet and associated applications such as World-Wide-Web, increasing volume of data traffic is required to be carried by communication networks.Appropriate transmission protocols are mandatorily used to optimize the carried data traffic.It has been shown that the shortest path protocol commonly employed by communication networks is facing serious challenge if the data volume continues to increase [1].Specifically, the shortest path protocol transmits data using only the distance information of the network, and the routers where a large number of shortest paths go through are easily congested.Thus, it is imperative to enhance the transmission algorithm in order to ensure reliable communication through the network.In this connection, an understanding of the data flow dynamics of the packets would be necessary.For example, Ohira et al. [2] studied the optimal network structure for packet flow in communication networks, and they showed the onset of phase transition behavior from free-flow state to congestion state as the packet creation rate increases.Arenas et al. [3] analyzed the phase transition behavior for hierarchical branching networks.Zhao et al. [4] studied the dynamics of flowing packets for various network topologies, and showed that the networks with significant heterogeneous property would inhibit packet congestion.
To improve the capability of the network in carrying a large volume of data traffic, we need effective routing strategies which can reduce drastically the congestion of the network.Recent works in the development of routing strategies have evolved along two basic ideas.The first one is the selection of paths for transmitting packets based on only local information of the network such as degree information [5,6], and/or the number of packets waiting at adjacent nodes [7].These routing strategies can be applied to networks of any size because collection of the distance information of the whole network is not necessary.The second idea is to utilize global information such as the shortest distance information of the network.For example, Echenique et al. [1,8] proposed a deterministic routing strategy, which calculates the efficient paths of sending packets by distance information and dynamic information.Yan et al. [9] proposed a routing strategy using both the distance information and the degree information in the network.Zhang et al. [10] proposed an adaptive routing strategy based on measurement of the accumulated number of packets on the shortest paths.A routing strategy with traffic awareness was proposed by Wang et al. [11].Also, Horiguchi et al. [12] proposed a routing strategy employing mutual con-nected neural networks.This method was further improved by reinforcement of a learning strategy [13] and incorporation of stochastic effects [14].
In this paper, we study the routing strategy along the idea of using global network information, and we propose a new approach to reduce congestion by incorporating memory information.First, we construct a routing strategy which selects the paths for transmitting the packets using the distance information and the dynamical information such as the number of accumulating packets in the network.We evaluate this conventional routing strategy for scale-free network.It is shown that due to the impermeability of the network [8], this routing strategy performs poorly as the density of the packets increases.
To overcome this problem, we introduce the use of memory information in the routing strategy.It can be shown that memory information such as the amount of packets sent in adjacent nodes can be exploited to avoid congestion substantially.Numerical simulations show that the proposed routing strategy achieves higher performance than the conventional routing strategies for various network topologies, including scale-free networks [15], small-world networks [16], and scale-free networks with community structures [17].
This paper is organized as follows.In Section 2, we describe a communication network model.In Section 3, we consider the conventional type of routing strategy that uses distance information and dynamical information, and evaluates the performance of this routing strategy for scale-free networks.The cause for poor performance as the density of the packets increases is identified.In Section 4, we introduce the use of memory information in the routing strategy, and evaluate the effectiveness of the proposed routing strategy in Section 5. We conclude the paper in Section 6.

Communication Network Model
We take an unweighted and undirected graph G = (V, E) as the network model, where V is the set of nodes and E is the set of links.Each node represents a host and a router in the network, and each link represents a physical connection between two nodes.If a packet is created at a node, the packet is stored at the tail of the buffer of the node.In addition, a packet at the head of the buffer of the node is transmitted to an adjacent node.In other words, all the packets are transmitted to their destinations according to the first-in-first-out principle.Sources and destinations of the packets are randomly selected using uniformly distributed random numbers.In addition, if a node to which a packet will be transmitted has a full buffer, movement of the packet is cancelled and the packet must wait for the next opportunity to be transmitted in the following step.To construct realistic commu-nication networks, we assign to each node a largest storage capacity and a processing capacity [5].
The largest storage capacity corresponds to the maximum size of the buffer that stores the packets, and the processing capability corresponds to the maximum number of transmitting packets at a time.
The largest storage capacity of the i node, B i , is defined as where, 0 is a controlling parameter and k i is the degree of the ith node.The largest storage capacity is proportional to the degree of the node.In other words, hub nodes in the network have a large memory to store packets.The processing capability of the ith node, C i , is defined as are set to large values, congestion of packets hardly occurs because each node has much capacity for storing and transmitting the packets.However, the cost of such a communication network is very high.Thus, it is desirable to develop a packet routing strategy that works well with small values of B i and C i .From this viewpoint, we set  and  in Equations ( 1) and (2) to 2.0 and 0.2, respectively [5].

Evaluation of the Routing Strategy for Scale-Free Networks
First, we consider the routing strategy that estimates the paths for transmitting the packets based on the distance information and the dynamical information, such as the number of accumulating packets at the adjacent nodes.In this routing strategy, the shortest path length from the ith node to a destination though the jth adjacent node,   where, with  being a controlling parameter, i being the number of the adjacent nodes of the ith node, N   i being a packet transmitted from the ith node at the tth time, the number of accumulating packets of the jth adjacent node at the tth time.
We note that in Equation ( 4), the first term expresses the distance from the ith node to the destination of the packet through the jth adjacent node and the second term expresses the number of packets that are being accumulated at the jth adjacent node.If Equation (3) of the jth adjacent node takes the smallest value among all the i adjacent nodes, i.e., the jth adjacent node is the closest to the destination of the packet and has the smallest number of accumulated packets in its buffer, a packet at the ith node is transmitted to the jth adjacent node.The routing strategy with H = 1 is same as the one used in the real communication network, i.e., the packets are transmitted to the destinations using the distance information only.For ease of distinction, we refer to this routing strategy with H = 1 as standard routing strategy.If H < 1, the routing strategy uses not only the distance information but also the dynamical information of the numbers of accumulating packets at the adjacent nodes.We call such a routing strategy a gain routing strategy.Although the deterministic protocol proposed by Echenique et al. [1,8] uses the same information, both the distance information and the dynamical information of the number of accumulating packets at the adjacent nodes, for routing packets, the difference between the deterministic protocol [1,8] and the gain routing strategy is that Equation ( 4) is normalized in the case of the gain routing strategy and the deterministic protocol uses the direct information [1,8].
Here we evaluate the gain routing strategy for scalefree networks.Since real communication networks are scale-free [18], we will adopt the scale-free topology as the network topology studied here.The scale-free networks are constructed by the following procedure [15].We begin with a complete graph with four nodes.Then, we put a new node with four links at every time step.Next, we connect four links of the newly added node to the nodes that already exist in the network with probability , where k i is the degree of the ith node , and N is the number of the nodes at the current iteration.
Numerical simulations are conducted as follows.First, packets are created from randomly selected sources and destinations.Then, at every node, an optimal adjacent node was selected using Equations ( 3) and (4), and the packets are simultaneously transmitted to their destinations.The number of packets in the communication networks is fixed.Thus, when a packet arrives at its destination, it is removed and a new packet is created from randomly selected source and destination.We repeat the node selection and packet transmission, I, for I = 1000.Also,  in Equation ( 4) is set to 1.
To evaluate the performance of the gain routing strat-egy, we use the following metrics.1) Density of the packets (D): 1 where i is the largest storage capacity defined by Equation (1) and   is the ratio of the number of packets to the capacity of the network.If p increases, a large number of packets are flowing in the network.
2) The number of flows (F):   f where t is the number of packets transmitted to the adjacent nodes at the tth time and I is the number of iterations.If there is no packet congestion in the network, each node can transmit the packets to their destinations because the adjacent nodes can store the packets in their buffers.Thus, the number of flows (F) increases.
3) Average arrival rate of the packets (A): where c is the total number of packets created in the network and a is the total number of arriving packets.
The average arrival rate (A) is an important measure to evaluate the routing strategy.By reducing or inhibiting the packet congestion in the network, the routing strategy can maintain a higher arrival rate (A).4) Average arrival time of the packets (T): where N r is the number of packets to record the arrival times and T i is an arrival time of the ith packet.In Equation (8), if the ith packet cannot be transmitted to its destination during the simulation, the arrival time of the ith packet, T i , will be assigned as T i = I.We set N r to 1000.If the arrival rate (T) becomes small as a result of the routing strategy, packets can be sent to their destinations very quickly.
Results for scale-free networks of 100 nodes are shown in Figure 1.In Figure 1(a), in the case of the standard routing strategy (H = 1 in Equation ( 4)), the number of flows (F) rapidly decreases when the density of the packets (D) is larger than 10.This result indicates that congestion of the packets occurs at D = 10, and the packets cannot be transmitted to the adjacent nodes.As a result, the value of F of the standard routing strategy decreases.The gain routing strategy with H = 0.2 and the one with H = 0.3 give larger values of F than with other H values. Also, the gain routing strategy with H = 0.3 has a higher arrival rate of the packets (A) than with other H values, as shown in Figure 1(b).Furthermore, the gain routing strategy with H = 0.3 transmits packets faster than with other H values, as shown in Figure 1(c).Thus, from Figure 1, we may conclude that the gain routing strategy with H = 0.3 gives the best performance for scale-free networks.
However, we can see that the number of flows (F) for all cases rapidly decreases when the density of the packets (D) becomes large.Also, the average arrival time (T) becomes large as the density of the packets (D) increases.Thus, to probe further, we measure the congestion levels of the nodes for the scale-free networks.The congestion level of the ith node can be found using takes 1, no adjacent nodes can transmit the packets to the ith node at the tth iteration because the ith node has a full buffer.The congestion levels of the nodes by the gain strategy with H = 0.3 are shown in To understand this phenomenon, we consider the following typical situation [8].The ith node has a packet for destination node g.In this case, the ith node has two adjacent nodes, i.e., node j 1 and node j 2 .Then, we assume that for node j 1 , the second term of (4) has a smaller value than that of node j 2 .In addition, node j 1 needs to take two hops to reach node g, while node j 2 needs to take one hop to reach node g.In other words, node j 2 is closer to the destination g than node j 1 .However, the packet cannot be transmitted to node j 2 if following relation is not satisfied: Thus, node j 2 becomes impenetrable for the ith node in this case.
Figure 3 shows the percentage of the available paths in the network for the gain strategy with H = 0.3.Although 100% of the available paths are used for routing the packets when the density of the packets (D) is 10, the number of available paths decreases to 60% when D is 70.These results indicate that if the number of impenetrable nodes increases in the network, the number of available paths decreases.This phenomenon is known as impermeability of the network which was originally studied by Echenique et al. [8].We also see that although there are some non-congested nodes when D is 70 as shown in Figure 2(c), the arrival rate of the packets is  much lower, as given in Figure 1(b).This is because there are a small number of available paths for transmitting the packets in the network.

Packet Routing Strategy with Memory Information
In Section 3, we have shown that the gain routing strategy becomes ineffective when the density of the packets becomes large due to the impermeability of the network.It is thus imperative to develop effective routing strategies to overcome the impermeability problem.Intuitively, an effective routing strategy should avoid sending packets to nodes to which many packets have already been transmitted in the past routings.In this work, we introduce the use of memory information in the gain routing strategy [19].Specifically, we modify Equation (3) as follows:   has been defined in Equation ( 4), i.e., where

 
    of the jth adjacent node takes the smallest value among all the i adjacent nodes, a packet at the ith node is transmitted to the jth adjacent node.Then, the transmission history of the jth adjacent node,

Numerical Simulations for Various Complex Networks
In this section we evaluate the performance of the proposed routing strategy for different network topologies.
In particular, since existing communication networks exhibit scale-free and small-world properties, it is of interest to consider scale-free networks [15], small-world networks [16], and scale-free networks with community structures [17].In our simulations, we compare the proposed routing strategy with two conventional routing strategies.The first one is the standard routing strategy described in Section 3, which is realized by setting H to 1.0.The second one is the gain routing strategy with H = 0.3.We set the parameters in Equations ( 4), ( 10) and (11) for the proposed routing strategy as follows:

Scale-Free Networks
First, we evaluate the proposed routing strategy for scalefree networks under the same experimental conditions as used in Section 3. Figure 4 shows the percentage of available paths for scale-free networks using the standard routing strategy, the gain routing strategy, and the proposed routing strategy.As shown in Figure 4, the percentage of the available paths for the proposed routing strategy is larger than those of the standard routing strategy and the gain routing strategy.This result indicates that the impermeability of the network is eliminated as a result of the use of the memory information.
As shown in Figure 5(a), the proposed routing strategy allows a higher number of flows (F) than the standard routing strategy and the gain routing strategy, when the density of the packets (D) is larger than about 55.
In addition, as shown in Figure 5(b), the proposed routing strategy shows a higher arrival rate (A) than the other strategies when D is larger than 50.Further, the proposed routing strategy gives a shorter arrival time when D is larger than 70.Clearly, as the impermeability of the network is eliminated in the case of the proposed routing strategy, the packets can be transmitted to the destinations using various routes even if the density of the packets becomes large in the network.

Small-World Networks
Next, we evaluate the performance of the routing strategies for small-world networks [16].Small-world networks are constructed in the same manner as described in Watts and Strogatz [16].First, N nodes are put on a closed one-dimensional ring and each node is connected to its K-th nearest neighbors.Then, each link is randomly re-wired with probability R p .We set N and K to 100 and 4, respectively.Results for the small-world network topology are shown in Figure 6.From Figure 6(a), although the number of flows (F) for the standard routing strategy is very small for the whole range of R p , the gain routing strategy and the proposed routing strategy show higher flows, as indicated in Figures 6(b

Scale-Free Networks with Community Structures
destinations quickly using the proposed strategy compared to the other routing strategies for the whole range of R p , as shown in Figure 6(f).In the case of small-world networks, the proposed routing strategy shows better performance if the topology of the network becomes more random.In a random network, there are numerous shortcuts that allow packets to be quickly transmitted to the destinations.Thus, when the network topology becomes random, the proposed routing strategy shows better performance as more shortcuts are available.
Finally, we evaluate the routing strategies for scale-free networks with community structures [17].The construction procedure follows the one described in Wu et al.  and (f).These results indicate that the proposed strategy effectively selects the paths for routing packets when C increases.Thus, even if F decreases, the proposed strategy is able to maintain a high A. Figures 7(g), (h), and  (i) show that the proposed strategy transmits the packets much faster than the other strategies even if C increases.Thus, we may conclude that in the case of scale-free networks with community structures, the proposed routing strategy can effectively route the packets to the destinations, and is able to transmit the packets quickly to their destinations even if the number of communities is large.

Conclusions
In this paper, we study the routing strategies in communication networks exploiting the use of global information, and in particular we incorporate memory information to select paths for transmitting packets that can eliminate traffic congestion.We first examined the routing strategy that uses the distance information and the dynamical information, and evaluated its performance for the scale-free networks.It has been shown that such a routing strategy becomes ineffective if the density of the packets increases due to the impermeability of the network that results in reduced number of paths available for routing.To avoid network impermeability, we have proposed the inclusion of memory information in the routing strategy.By using the memory information effectively, we maintain a large number of available paths even if the density of the packets becomes high.As a result, the proposed routing strategy shows better performance than the conventional routing strategies for various network topologies such as scale-free networks, small-world networks [16] and scale-free networks with community structure [17].
In our future work, the use of memory information may be combined with consideration of the use of cellular automata for congestion elimination.In evaluating the performance of routing strategies, an order parameter may be used to indicate the phase transition point between free state and congested state for the network under study [1,[8][9][10][11].A novel evaluation method may be proposed for routing strategies using the order parameter.
The research of T. K. was partially supported by Grantin-Aid for Young Scientists (B) from JSPS (No. 23700180).

Figure 1 .
Figure 1.Relationship between the density of the packets (D) and (a) Number of flows (F); (b) Arrival rate of the packets (A); and (c) Average arrival time of the packets (T) for scale-free networks.

Figure 2 .
Here, we see that although the congestion levels of the nodes show similar values when the density of the packets (D) is 10 (see Figure 2(a)), the nodes show higher congestion values when D is 70, as shown in Figure 2(b).Further, in Figure 2(b), we can see that the congestion levels have two separate states: non-congested states (green) and congested states (red).Moreover, once the state of the node changes, it remains unchanged throughout the simulation.

Figure 2 .
Figure 2. Congestion levels of the nodes as a function of the number of iterations (I) and the node index by the gain routing strategy with H = 0.3 when (a) the density of the packets (D) is 10, and (b) D = 70.

Figure 3 .
Figure 3. Relationship between the percentage of the available paths and the number of iterations (I for the gain routing strategy with H = 0.3. 10) with  being a scaling parameter of the memory information, r a decay parameter, and ij k mission history of the jth adjacent node at the tth time, i.e., to Equation(11).

Figure 4 .
Figure 4. Relationship between the percentage of available paths and the number of iterations (I) using the standard routing strategy (Standard), the gain routing strategy (Gain), and the proposed routing strategy (Proposed) for scale-free networks.The density of the packets (D) is 70.

Figure 5 .Figure 6 .
Figure 5. Relationship between the density of the packets (D) and (a) The number of flows (F); (b) The arrival rate of the packets (A); and (c) The average arrival time of the packets (T), using the standard routing strategy (Standard), the gain routing strategy (Gain), and the proposed routing trategy (Proposed) for scale-free networks.s [20].We begin with C complete graphs, each of which forms a community of m nodes.Then, we add a new node with m links to each community at every time step.In each step, m-n links of the newly added node are con-nected to the nodes in the same community, and n links are connected to the nodes in the other communities.The nodes in the same community and the ones in the other communities are selected by the principle of preferential attachment.In the simulations, we set m = 4 and n = 1.Results for scale-free networks with community structures of 100 nodes are shown in Figure7.Although the number of flows (F) decreases with increasing number of communities (C) in the case of the proposed routing strategy, as shown in Figures7(a), (b), and (c), either a higher arrival rate (A) can be achieved, as shown in Figure 7(d), or similar performance as the gain routing strategy can be achieved, as shown in Figures 7(e )

Figure 7 .
Figure 7. Relationship between the density of the packets (D) and the number of flows (F) for (a) the number of communities C = 2; (b) C = 10; and (c) C = 15; the average arrival rate (A) for (d) C = 2; (e) C = 10; and (f) C = 15; and the average arrival ime of the packets (A) for (g) C = 2; (h) C = 10; and (i) C = 15, for scale-free networks with community structures.t