Searching for a Target Traveling between a Hiding Area and an Operating Area over Multiple Routes

We consider the problem of searching for a target that moves between a hiding area and an operating area over multiple fixed routes. The search is carried out with one or more cookie-cutter sensors, which can detect the target instantly once the target comes within the detection radius of the sensor. In the hiding area, the target is shielded from being detected. The residence times of the target, respectively, in the hiding area and in the operating area, are exponentially distributed. These dwell times are mathematically described by Markov transition rates. The decision of which route the target will take on each travel to and back from the operating area is governed by a probability distribution. We study the mathematical formulation of this search problem and analytically solve for the mean time to detection. Based on the mean time to capture, we evaluate the performance of placing the searcher(s) to monitor various travel route(s) or to scan the operating area. The optimal search design is the one that minimizes the mean time to detection. We find that in many situations the optimal search design is not the one suggested by the straightforward intuition. Our analytical results can provide operational guidances to homeland security, military, and law enforcement applications.


Introduction
Since World War II, search theory has provided many valuable tools to decision makers in both civilian and military operations including search and rescue (SAR), intelligence, surveillance, and reconnaissance (ISR), and enhanced situational awareness [1]- [4].The prevalence of mobile robotic search agents such as unmanned aerial vehicles (UAVs) or unmanned underwater vehicles (UUVs) has stimulated various search problems in recent years [5]- [10].
In this article, we consider a search problem as depicted in Figure 1 where a target follows constrained pathways, moving between a hiding area and an operating area.The target can stay in the hiding area (e.g.port or foliage) where the sensors cannot penetrate and consequently the target is not detectable; it can travel along one of the routes connecting the hiding area and the operating area; and it can spend time in the operating area to carry out certain activities/tasks before returning to the hiding area via one of the routes.In Figure 1, the hiding area is denoted by A; the collection of all routes is represented by B; and the operating area is marked by C. The target is detectable by a searcher both along the set of routes B and in the operating area C. In the hiding area A, the target is not detectable.We refer this scenario as the A-B-C search problem and it is practically relevant to homeland security, military, counter-drug UAV patrol, and law enforcement operations.To the authors' knowledge, the A-B-C search problem has not been examined systematically in the open literature.
We consider the situation where one or more searchers are deployed.Each searcher possesses an ideal sensor.The definite-range law, or cookie-cutter sensor is an ideal sensor which detects the target instantly once the target comes within distance R to the center of the sensor but cannot detect the target outside that range.The radius R is called the detection radius of the searcher.For the present discussion, we assume that the detection radius of the searcher is large enough to cover the full width of any route in the problems considered here.Under this assumption, if the target chooses to travel along a route that is monitored by a searcher, then the target will definitely be detected by the searcher along that route.Our goal here is to evaluate the performance of placing the searcher(s) at various routes/areas and obtain a search plan that minimizes the mean time to detection of the target.
The rest of this paper proceeds as follows.In Section 2, we consider a moving target which follows the constrained pathways defined above in the presence of one searcher and for which the probability of taking a given route is the same for both travel directions.Section 3 extends the results of Section 2 to the case where the target has different probability of taking a given route for the two travel directions.In Section 4 we further generalize the discussions in Section 3 to include two searchers.Section 5 presents a discussion of three or more searchers.Finally, Section 6 concludes the paper and points out avenues for future study.

Mathematical Formulation and Solution for a Target Following Constrained Pathways in the Presence of One Searcher
We consider the situation where there is one searcher and the target behaves as follows.
• The dwell time of the target in the hiding area is exponentially distributed with rate r f , the forward rate of going from the hiding area to the operating area.• On its travels between the hiding area and the operating area, the target takes route k with probability p k .In particular, the probability of choosing route k is the same for both directions.This assumption will be relaxed in the later discussion.• The dwell time of the target in the operating area is exponentially distributed with rate r b , the backward rate of going from the operating area back to the hiding area.• The travel time between the operating area and the hiding area is negligible in comparison with the dwell times in the hiding area and the operating area.Mathematically, we treat the travel time along a route as zero.After this setup, we have several options of placing the cookie-cutter searcher.

Case 2A: The Searcher Is Placed on Route k
First, we investigate the situation where the searcher is placed on route k.In this case, the target is detected if and only it travels via route k.As mentioned above, we assume that the detection radius of the searcher is large enough to cover the full width of the route and the detection is instantaneous once the target enters into the detection area of the searcher.
Before the arrival of the searcher, the target jumps between two Markov states with forward rate r f and backward rate r b , as shown in Once the searcher arrives at route k to commence monitoring there, the diagram of Markov transitions contains 3 states.As shown in Figure 3, the third state is the target being detected.When the target leaves the hiding area, it has probability k p of taking route k (and thus being detected).The transition rate from the hiding area to being detected is f k r p ; the rate of going from the hiding area to the operating area (without being de- tected on the way) is ( ) . Similarly, the transition rate from the operating area to being detected is b k r p ; the rate of traveling from the operating area back to the hiding area (without being detected on the way) is ( )  ( ) with initial conditions (t = 0 being the time when the searcher arrives at route k) ( ) ( ) The initial conditions (3) correspond to the equilibrium distribution of the target between the hiding area and the The probability that the target is not detected by time t (i.e. the non-detection probability, also called the escape probability) has the same form which reads where the coefficients c 1 and c 2 are calculated below and are contained in Equation ( 8).The non-detection probability is constrained by two other conditions, namely, ( ) where the second condition is derived from differential equations (2) and initial conditions (3).The two constraints in (7) allow us to calculate the coefficients c 1 and c 2 in (6) explicitly.After some algebra, we find the non-detection probability has the expression ( ) ( ) ( ) where the coefficient α is given by Note that 0 α > .Observe also that according to (8), the non-detection probability is a linear combination of two exponential modes: one decreases with fast rate 1 λ , the other with slow rate 2 λ .Since 0 α > , the slow decaying mode carries more weight, usually a lot more than the weight of the fast decaying mode.
When k p is moderately small, we obtain the following asymptotic expansions: Therefore, when k p is moderately small (for example, 0.1 ), the decay of the non-detection probability is mainly described by the slow decay rate .
In an effort to use one quantity to characterize the decay of the non-detection probability, we compute the mean time to detection.Let detection T denote the time to detection, which is a random variable.We calculate the mean time to detection from ( ) The derivative of [ ] Thus, the mean time to detection is a strictly decreasing function of k p .Among all possible routes, placing the searcher on the route with the largest probability k p will yield the fastest decay of the non-detection probabili- ty and the shortest mean time to detection.In other words, if the searcher is placed on one of the pathways, then the best choice is to place the searcher on the route that the target is most likely to journey.This is consistent with intuition.As we will see later, in the case of the target having different probabilities of taking a given route for the two travel directions, and/or in the case of more than one searcher, the straightforward intuition often fails to yield the optimal placement.
When k p is small, it follows from (10) that the mean time to detection can be approximated by which is inversely proportional to k p .

Case 2B: The Searcher Is Placed in the Operating Area to Scan Search the Area
Now we consider the situation where the searcher looks over only the operating area.Since the searcher is committed to searching the operating area, the target can only be detected when it is in the operating area.
Here we do not specify how the searcher conducts search over the operating area, which may include random search, parallel sweeps (mowing the lawn), spiral-in or spiral-out paths.We consider the conditional probability of the non-detection given that the target is in the operating area.We model the conditional non-detection probability as a single exponential decay.

( ) ( ) ( )
target in operating area exp where d r is the detection rate in the operating area.In addition to transitions between the hiding area and the operating area, there is now a new transition of the target going from the operating area to being detected.Upon the arrival of the searcher in the operating area, the Markov transitions of the target are depicted in the diagram shown in Figure 4.
For mathematical convenience, we represent the detection rate d r as ( ) ( ) Proceeding exactly as for Case 2A, we can succinctly express the non-detection probability as where 1 λ and 2 λ are the eigenvalues of the coefficient matrix of the linear ODE system (14): ( ( ) The non-detection probability also satisfies two other conditions: We solve for coefficients 1 c and 2 c in (15) from these two conditions.We obtain ( ) ( ) ( ) where the coefficient α is defined by As discussed before, the non-detection probability contains two exponential modes: one decays with fast rate 1 λ , the other with slow rate 2 λ .Since 0 α > , the slow decaying mode bears more weight.When η is mod- erately small (i.e., the probability of being detected in one trip to the operating area is mall), we arrive at the following asymptotic expansions: From the results of these asymptotic expansions, we see that when η is moderately small, the decay of the non-detection probability can be characterized by the slow decay rate Again, we calculate the mean time to detection from ( ) Notice that the mean time to detection contains a constant part that does not decrease with increasing detection rate d r .This reflects the fact that no matter how fast the target can be detected in the operating area, the detec- tion can occur only when the target moves to the operating area.The constant term is the mean elapsed time until the first arrival of the target in the operating area.This constant term gives the lower bound on the mean time to detection, which can be achieved when the detection rate in the operating area is much larger than other transition rates: Combining the results of Case 2A and Case 2B, we can now determine the optimal placement of the searcher (on a particular route vs. in the operating area ) in order to attain the minimum mean time to detection of the target.We introduce the probability and identify of the route that is most likely to be travelled by the target: We compare the mean times to detection in the two cases r r p r r r r r r r r r p r r r r r p If the former is smaller, we place the searcher on route max k , the route with the highest probability of being tra- veled by the target; if the later is smaller, we place the searcher in the operating area to scan search the area.Note that when the probability of taking a given route is the same for the two travel directions, the minimum mean time to detection among all routes is the one corresponding to the route most likely to be traveled by the target.This is consistent with intuition.This intuitive strategy, however, breaks down when the probability of taking a given route has different values for the two travel directions.That situation is discussed in the next section.

A Target Having Different Probabilities of Taking a Given Route for the Two Travel Directions
In this section, we consider the target which behaves the same as in Section 2 except that the probability of taking route k may have different values for the forward travel (from the hiding area to the operating area) and the backward travel (from the operating area to the hiding area).We use k p and k q to denote, respectively, the probabilities of taking route k in the two opposite travel directions.More specifically, • On its travel from the hiding area to the operating area, the target takes route k with probability k p .• On its travel from the operating area back to the hiding area, the target chooses route k with probability k q .We study the performance of placing the searcher on a route, which is analogous to Case 2A.Note that regardless of the target's behavior in selecting which route to take, the results of Case 2B apply directly here, which is affected only by how frequently the target visits the operating area and how fast the target is detected while in the operating area.

Case 3A: The Searcher Is Placed on Route k
To analyze the case where the searcher is placed on route k, we observe that the Markov transitions are illustrated in Figure 5.When the target leaves the hiding area, it has probability k p of taking route k (and thus being detected).The transition rate from the hiding area to being detected is f k r p ; the rate of going from the hiding area to the operating area (without being detected on the way) is ( ) . Likewise, on the target's returning trip to the hiding area, the transition rate from the operating area to being detected is b k r q ; the rate of traveling from the operating area back to the hiding area (without being detected on the way) is ( ) . The time evolution of probabilities ( ) ( ) with initial conditions ( ) ( ) The non-detection probability is of the form ( ) ( ) ( ) where 1 λ and 2 λ are the eigenvalues of the coefficient matrix of the linear ODE system (21) The non-detection probability needs to meet two more conditions: With the help of these two constraints, we can determine the coefficients 1 c and 2 c .We write out the non- detection probability as ( ) ( ) ( ) with the coefficient α satisfying As in the earlier discussion, the non-detection probability is a linear combination of two exponential modes: one decreases with fast rate 1 λ while the other with slow rate 2 λ .The fact that α is positive suggests that the slow decaying component weighs more than the fast decaying one.When both k p and k q are moderately small, we carry out the asymptotic analysis to obtain It therefore follows that when k p and k q are moderately small (for example, 0.1 ), the decay of the non-detection probability is dominated by the slow decay rate ( ) which is approximately proportional to probability ( ) . Furthermore, the non-detection probability is well approximated by Next we find the mean time to detection.Using the formula (23), we compute the mean time to detection: The most important thing to notice about this result is that the mean time to detection is not just a function of ( ) , the sum of probabilities of taking route k in the two travel directions.Consequently, the optimal route is not necessarily the one that has the largest value of ( ) To illustrate this point, we consider a simple and interesting example in the following.
An Example: Let us consider a target traveling between the hiding area and the operating area.The transition rates and the probabilities of taking individual routes in each travel direction are listed below.
, , , 0.47, 0.35, 0.13, 0.05 p p p p = ( ) ( ) , , , 0.15, 0.3, 0.0, 0.55 q q q q = The small value for f r corresponds to the fact that the target stays in the hiding area for most time.If we compute the values of k k p q + , we have 0.62, 0.65, 0.13, 0.6.p q p q p q p q Intuitively, the optimal route for placing the searcher seems to be 2 k = , which yields the largest value of k k p q + ; the second candidate for the optimal route seems to be 1 k = , which leads to the second largest value of k k p q + .However, to select the optimal route for placing the searcher, we appeal to (25) and calculate the mean time to detection for each route: ( ) It is clear that route 4 has the smallest mean time to detection, and thus, is the optimal route for placing the searcher.This example highlights that when the probability of taking a given route has different values the two travel directions, the optimal placement of the searcher is not the one suggested by straightforward intuition.

A Moving Target and Two Searchers
We study the effect of two searchers where each searcher acts and detects independently.We assume the same setup for the target as in Section 3. The difference here is that there are two cookie-cutter searchers deployed in search for the target.We consider several options of placing the two cookie-cutter searchers.

Case 4A: Both Searchers Are Placed on Routes: One on Route k and the Other on Route j
Since we assume that one searcher is capable of covering the full width of a route, there is absolutely no benefit for placing more than one searchers on any one route.Thus, the two searchers are to be placed on two different routes.In this case, the mathematical formulation is exactly the same as in Case 3A in Section 3 except that probability k p in Section 3 is now replaced with the effective probability k j p p + ; and in place of k q in Case 3A we have k j q q + .We introduce two short notations that will be convenient throughout this section: , .
k j k j p p p q q q ≡ + ≡ + Then, the non-detection probability is given by ( ) ( ) ( ) where eigenvalues 1 λ and 2 λ , and coefficient α are ( Recalling (25) obtained in Case 3A of Section 3, one finds the mean time to detection in the form where function ( ) The optimal routes for placing the two searchers are selected by minimizing the mean time to detection: .
It is attempting to simplify the selection process by using the optimal route for a single searcher plus the second optimal route for a single searcher.The example below demonstrates that this intuitive approach does not necessarily give us the optimal routes for placing the two searchers.
An example: We consider a target traveling between the hiding area and the operating area over 5 routes.The transition rates and the probabilities of taking route k in the two travel directions are given below for the target 0.1, 1 , , , , 0.45, 0.0, 0.25, 0.25, 0.05 p p p p p = ( ) ( ) , , , , 0.0, 0.46, 0.25, 0.25, 0.04 .q q q q q = When only a single searcher is present, the mean times to detection for individual routes are calculated from (25) ( ) The optimal route and the second optimal route for placing a single searcher are, respectively, route 2 and route 1.It seems reasonable to conclude that in the case of two searchers, the optimal routes for placing the two searchers are routes 2 and 1.However, this is not true.When the two searchers are placed respectively on routes 1 and 2, the mean time to detection is then obtained from (28) as  ( ) In comparison, when the two searchers are placed respectively on routes 1 and 3, the mean time to detection becomes which is still not yet the optimal.It turns out that the smallest mean time to detection among all possible pairs of routes is achieved by placing the two searchers respectively on routes 3 and 4:

E T h p p q q
In this example, the optimal pair of routes for placing the two searchers are routes 3 and 4, not the collection of optimal and second optimal routes for a single searcher.

Case 4B: Both Searchers Are Placed in the Operating Area to Scan Search the Area
When both searchers are put to search only the operating area, the mathematical formulation is exactly the same as in Case 2B of Section 2 except that the detection rate d r in Section 2 is now doubled to 2 d r because the operating area is patrolled by two searchers.
Based on the results in Case 2B of Section 2, the mean time to detection can be written as where function ( ) .  ( ) These probability functions satisfy the initial conditions ( ) ( ) Once again, one finds that the non-detection probability has the form ( ) ( ) ( ) λ and 2 λ correspond to the two eigenvalues of the coefficient matrix of the linear ODE system (31): p q r r r r r r r r p q p q r r r r p q r r r r r r r r r p q p q f r p q This result lies at the heart of everything else that is going on and it includes all of these as special cases.In particular, function ( ) , h p q and function ( ) ( ) ( ) , 0, , h p q f p q = ( ) ( ) ,0,0 .

Optimal Placement of Two Searchers
When the two searchers are placed on two routes k and j (one searcher on each route), the shortest mean time to detection is given by When one searcher is placed on route k and the second searcher is placed in the operating area, the smallest mean time to detection is similarly defined by ( ) min , , .
When both searchers are placed in the operating area, the mean time to detection is ( ) where function ( ) , , .

Three or More Searchers
We now turn to the case where three cookie-cutter searchers are deployed in the search for the target.Probabilistic independence is assumed for each searcher.Suppose the target behaves exactly the same as described in Sections 3 and 4. We apply function ( ) , , f p q β to calculate the optimal placement of the three searchers.When all three searchers are placed on three routes (one searcher on each route), the shortest mean time to detection is found to be ( ) ( ) , , min 0, , .k j i k j i k j i f p p p q q q + + + + Similarly, when two searchers are placed on two routes (one searcher on each route) and the third searcher is placed in the operating area, the shortest mean time to detection is  Finally, when all three searchers are placed in the operating area, it follows that the mean time to detection is ( ) We conclude that the overall minimum mean time to detection over these options can be computed by comparing the results in these cases , , , min min 0, , , min , , , min 2 , , , 3 , 0, 0 .
k j k f p p p q q q f r p p q q f r p q f r  It is also evident that this method can be extended to finding the optimal placement for any number of searchers.

Conclusions
This paper presented a mathematical approach to investigate the search problem of detecting a mobile target that travels between a hiding area and an operating area over a collection of fixed pathways in the presence of single or multiple searchers with cookie-cutter sensors.Both the dwell time of the target in the hiding area and the dwell time of the target in the operating area were assumed to be exponentially distributed and were modeled mathematically by Markov transition rates.The travel time of the target on a pathway was assumed to be short in comparison with the dwell times in the hiding area and the operating area.The target took a route to and from the operating area based on a probability distribution.Under these assumptions, a mathematical formulation was developed and solved analytically.
The main results can be summarized as follows.
1) When only one searcher is present, one can compute the mean time to detection, respectively, when the searcher is placed on route k or when the search is placed in the operating area.By comparing the mean times to detection, we can decide whether to put the searcher on a certain route or in the operating area.
2) In a similar fashion, when multiple searchers are deployed, we can calculate the mean times to detection for various scenarios and thereby obtain the overall minimum time to detection and the optimal placement of searchers.
It was discovered that in many cases the optimal search design was not necessarily the one indicated by straightforward intuition.
There are a few possible future research directions.For example, extending current study to include timedependent transition rates and detection rates would provide a more sophisticated modeling.Multiple targets could also be considered in the future studies.

Figure 1 .
Figure 1.The A-B-C search problem.The target may stay in the hiding area A where it is not detectable; it may travel along one of the routes in collection B; it may spend time in the operating area C before returning to the hiding area.

Figure 2 .
Figure 2. Markov transitions of the target between the hiding area and the operating area before the arrival of the searcher.

Figure 3 .
Figure 3. Markov transitions after the searcher is placed on route k.
proportional to probability k p .Consequently, the non-detection probability simplifies approximately to

Figure 4 .
Figure 4. Markov transitions after the searcher is placed in the operating area.
non-detection probability takes the approximate form

Figure 5 .
Figure 5. Markov transitions after the searcher is placed on route k in Case 3A where the probability of taking route k is p k for the forward travel and q k for the backward travel.
a set of ODEs:

4 . 3 . 6 .
Case 4C: One Searcher Is Placed on Route k and the Other in the Operating AreaThe last mathematical formulation is for the case where one searcher is put on a pathway while the other scans the operating area.After the arrival of one searcher at route k and the other in the operating area, target evolves stochastically according to the Markov process shown in Figure For mathematical convenience, we express the detection rate d r in the operating area as d

Figure 6 .
Figure 6.Markov transitions after one searcher is placed on route k and a second searcher is placed in the operating area. f

d g r
can be expressed in terms of function ( ) We are now ready to summarize what we have found so far.
When one searcher is placed on route k and the two other searchers are placed in the operating area, the smallest mean time to detection is equal to denote, respectively, the probability of being in the hiding area and that of being in the operating area at time t.The probability of the target having been detected by time t is o p t