Performance of Stochastically Intermittent Sensors in Detecting a Target Traveling between Two Areas

We study the problem of detecting a target that moves between a hiding area and an operating area over multiple fixed routes. The research is carried out with one or more cookie-cutter sensors with stochastic intermission, which turn on and off stochastically governed by an on-rate and an off-rate. A cookie-cutter sensor, when it is on, can detect the target instantly once the target comes within the detection radius of the sensor. In the hiding area, the target is shielded from being detected. The residence times of the target, respectively, in the hiding area and in the operating area, are exponentially distributed and are governed by rates of transitions between the two areas. On each travel between the two areas and in each travel direction, the target selects a route randomly according to a probability distribution. Previously, we analyzed the simple case where the sensors have no intermission (i.e., they stay on all the time). In the current study, the sensors are stochastically intermittent and are synchronized (i.e., they turn on or off simultaneously). This happens when all sensors are affected by the same environmental factors. We derive asymptotic expansions for the mean time to detection when the on-rate and off-rate of the sensors are large in comparison with the rates of the target traveling between the two areas. Based on the mean time to detection, we evaluate the performance of placing the sensor(s) to monitor various travel route(s) or to scan the operating area.


Introduction
Search and detection theory has a history of principal importance in operations research.It has fundamental military and civilian applications such as anti-submarine warfare, counter-mine warfare, and search and rescue operations [1]- [4].
Nowadays when combating piracy at sea, detecting and intercepting threat objects (boats) such as terrorists and drug or weapon smugglers, or securing coastlines and trade routes, it is important to understand the behavior of a target and plan a search and detection strategy accordingly.In a recent work [5] we considered the problem of searching for a target that travels between a hiding area and an operating area via multiple routes.By assuming certain behaviors of the moving target, we obtained analytic expressions for the mean time to detection and thereby were able to determine the optimal placement of m cookie-cutter sensors (i.e.how many sensors should we place on which routes and the rest is placed to search the operating area).Interestingly, we found that the optimal placement, sometimes, is not the one suggested by intuition.
In this paper we would like to extend our earlier study to include stochastically intermittent sensors in detecting a target moving between a hiding area and an operating area.

Mathematical Formulation for the Case of Sensors without Intermission
We consider the search problem in which a target moves between a hiding area and an operating area via constrained pathways, as depicted in Figure 1.The target can stay in the hiding area where the target is shielded from being detected by the sensors.There are N given routes connecting the hiding area and the operating area.The target can travel along one of these N given routes from the hiding area to the operating area.The target can spend time in the operating area to carry out certain activities/tasks.Afterwards, the target can return to the hiding area via possibly a different route.In the hiding area, the target is not detectable.Outside the hiding area, the target is detectable along the routes and in the operating area if it comes into the detection range of a sensor.
In the search problem, variable number of synchronized intermittent cookie-cutter sensors are used to detect the target.We will first introduce the mathematical model for the simple case of non-intermittent sensors (i.e., they stay on all the time) and then extend the model to accommodate the stochastic intermission of the sensors.
We start by specifying the target behavior.The target moves stochastically between the hiding area and the operating area according to the following rules.
• The dwell time of the target in the hiding area is exponentially distributed with rate f r , the forward rate of the target going from the hiding area to the operating area.
• On its travel from the hiding area to the operating area, the target takes route k with probability k p , which satisfies the constraint where N is the total number of given routes.• The dwell time of the target in the operating area is exponentially distributed with rate b r , the backward rate of the target going from the operating area back to the hiding area.
• On its travel from the operating area back to the hiding area, the target chooses route k with probability k q , which satisfies the condition The travel time between the operating area and the hiding area is negligible in comparison with the dwell times in the hiding area and the operating area.Mathematically, we treat the travel time along a route as zero.The target's travel between the two areas is mathematically described by a Markov process of two states, with forward rate f r and backward rate b r , as illustrated in Figure 2. Next, we describe the interaction between the target and sensors.A non-intermittent cookie-cutter sensor is an ideal sensor which detects the target instantly once the target comes within distance R to the center of the sensor where the radius R is called the detection radius of the sensor.When the target is outside the detection radius, it is not detected.In this study, we assume that the detection radius of sensors is large enough to cover the full width of any one of the given routes.Consequently, if a non-intermittent sensor is assigned to monitor a route and the target happens to move along that route, the target will definitely be detected by the sensor.Of course, the situation will be different for an intermittent sensor that turns on and off stochastically.
When a sensor is used to search the operating area, when the sensor is on, and when the target is in the operating area, the interaction between the target and the sensor is modeled using a detection rate d r (probability of detection per time).rate of detecting the target in the operating area This detection rate is affected by the size of the operating area, and by the detection radius and the speed of the sensor.
When one or more non-intermittent sensors are deployed to monitor one or more routes or to search the operating area, the transitions and detection of the target are governed by a 3-state Markov process of the same parameter form as the one shown in Figure 3.The values of p, q, and d depend on how many sensors are used and which route(s) and area are monitored/searched.Values of p, q, and d are given below for several cases.
• When only one sensor is deployed and it is placed to monitor route k, this gives , , 0 k k p p q q d = = = • When only one sensor is deployed and it is used to search the operating area, this corresponds to 0, 0, • When two sensors are placed to monitor, respectively, routes k and j ( k j ≠ ), it follows that , , 0 k j k j p p p q q q d = + = + = • When two sensors are both used to search the operating area, we find The parameter form of the normalized Markov process is shown in Figure 4.
In the absence of sensors, at equilibrium, the probabilities of the target being in the hiding area or the operating area are, respectively, ( ) − and α .This fact will be used later in the calculation of mean time to detection.

Mean Time to Detection in the Case of Sensors without Intermission
Figure 4 describes the general model for the case of non-intermittent sensors.It can accommodate arbitrary number of sensors.For mathematical convenience, we label the hiding area as state 1 and the operating area as state 2. We solve for the mean time to detection.
Let T denote the time to detection (random variable), and ( ) S t denote the state of the target at time t.Time 0 is defined as the time when the sensors are deployed.We examine the conditional mean time to detection given that the target is in state j at time 0.
We derive two equations for 1 t and 2 t based on the Markov process in Figure 4. Starting with ( ) the probability distribution of ( ) with probability 1 2, with probability 1 detected, with probability Using the law of total expectation, we have which, when divided by t ∆ and in the limit of t ∆ going to zero, yields ( ) Solving linear system (5), we obtain ( ) Before the deployment of sensors, the equilibrium distribution of the target is Thus, the overall mean time to detection has the expression

Mathematical Formulation for the Case of Synchronized Stochastically Intermittent Sensors
We extend above discussions to consider synchronized intermittent sensors that stochastically turn on or off simultaneously.We model the stochastic evolution of sensors as a 2-state Markov process with an on-rate on r and an off-rate off r , as illustrated in Figure 5.
As in the previous section, we divide all rates by ( ) Note that the parameter β defined above corresponds to the equilibrium probability of sensors being on, which is also the fraction of time that sensors are on.The quantity ( ) is the equilibrium probability of sensors being off.The choice of notation ε indicates that we will focus on the parameter regime of 1 ε  .
That is, we will focus on the case of ( ) ( ) . Note that ( ) is the rate of sensors relaxing to equilibrium between the on-and off-states; ( ) is the rate of the target relaxing to equilibrium between the hiding area and the operating area.Parameter ε in (9) measures the ratio of these two relaxation rates.
We now combine the stochastic travel of the target and the stochastic intermission of the sensors into a 5-state Markov process for the target-sensors system as illustrated in Figure 6.The normalized version of this 5-state Markov process where all transition rates are divided by ( ) In the model, the sensors' intermission and the target's travel between the two areas are independent of each other.The targetsensors system can reside in any of 4 states before the detection.For mathematical convenience, we number the 4 states as follows: (Figure 7).
• State 1: the target is in the hiding area and the sensors are on.
• State 2: the target is in the operating area and the sensors are on.
• State 3: the target is in the hiding area and the sensors are off.
• State 4: the target is in the operating area and the sensors are off.
Figure 7 gives the general model for the target-sensors system with synchronized stochastically intermittent sensors.It can accommodate arbitrary number of sensors.We study the mean time to detection in this 5-state Markov process.
Again, let T represent the time to detection (random variable), and ( ) S t denote the state of the target at time t.We consider the conditional mean time to detection ( ) ( ) We derive four equations for ( ) , , , t t t t based on the 5-state Markov process in Figure 7. Starting with ( ) 0 1 S = , the probability distribution of ( ) ∆ is  ( The law of total expectation gives us ( ) ( ) Dividing both sides by t ∆ and taking the limit as t ∆ going to zero, we arrive at ( ) This is an equation for ( ) , , , t t t t .Three other equations are derived using the same approach, starting with, respectively, ( ) , , , t t t t are ( ) Analytical solutions to the above linear system is hard to obtain.Instead, in the next section, we use this linear system to calculate asymptotic expansions for ( ) , , , t t t t and for the overall mean time to detection when ε is small.

Asymptotic Solutions for the Mean Time to Detection in the Case of Synchronized Intermittent Sensors
We derive asymptotic solutions for the mean time to detection for small ε .We start by writing the conditional mean time to detection in the asymptotic form of ( ) ( ) Substituting this asymptotic form into Equations ( 12)-( 15) and examining terms of the order , which are of the largest magnitude, we obtain From Equations ( 12)-( 15), we will derive two equations that do not contain any coefficient of the order . These two equations will then be used to calculate the leading coefficients in the asymptotic form: ( ) t .We rewrite Equations ( 12)-( 15) to separate terms with coefficients The two equations are constructed by The resulting two equations are ( ) ( ) ( ) Substituting asymptotic form (16) into the two equations above, keeping only terms of order ( ) 1 O , and using result (17), we arrive at 24) is of the same parameter form as system (5) except that p, q, and µ in (5) are replaced by p β , q β , and βµ in (24).The solution of (24) immediately gives us the leading coefficients: We introduce quantity , which will be useful in the subsequent calculation.Quantity Next, we calculate coefficients ( ) ( ) ( ) ( ) ( ) , , , t t t t .Substituting the asymptotic form (16) into equation ( 20)-(21), and using the fact that all leading coefficients are already known, we find expressions for ( ) ( ) ( ) Substituting the asymptotic form (16) into Equations ( 22)-( 23), collecting all terms of the order ( ) O ε , and using results ( 27)-(28), we obtain two equations for ( ) and ( ) The solution of (30) gives us expressions for coefficients ( ) ( ) ( ) ( ) ( ) , , , t t t t .
Before the sensors are assigned to monitor/search routes, the equilibrium distribution of the target-sensors The normalized transition rates and parameters (shown in

Behaviors of the Mean Time to Capture
We examine behaviors of the mean time to detection, ( ) ( ) ( ) , as a function of parameters µ , α , β , p, q, and ε .
We differentiate ( ) 0 t as defined in (33) with respect to µ and find that In the derivative above, the right-hand side is negative because factors ( ) − , p, and q are all positive and bounded by 1.This property of ( ) 0 t is not surprising.Recall that µ is the normalized detection rate in the operating area.For a larger µ , it is reasonable to expect that the target will be detected sooner.
Observation 2: t (0) is a decreasing function of p and a decreasing function of q.We differentiate ( ) 0 t , respectively, with respect to p and q and obtain that q are negative, which follows directly from the fact that all terms in the numerators are positive.In particular, it is true that 0 1 p q pq p q pq µ β α This property of ( ) 0 t is also expected.Remember that p and q are, respectively, the probability of the target being detected on its way to the operating area and the probability of being detected on its way back to the hiding area.Increasing either p or q while keeping the other unchanged will speed up the detection of the target.
In the expression of ( ) 0 t , while the sum ( ) p q + is fixed, the combination ( ) pq appears only in the denominator.( ) pq is increased, the denominator is decreased, and as a result, ( ) 0 t is increased.This behavior tells us that when evaluating several options with the same value of ( ) p q + , the optimal option is the one with the smallest value of ( ) pq .Observation 4: t (0) is a decreasing function of β.
We differentiate This property of ( ) 0 t is expected.β is the fraction of time that the sensors are on.Increasing the value of β leads to an increase in the probability that the sensors are on at a random time.and thus reduces the time to detection.Therefore, we conclude that ( ) t is always positive.It follows that as a function of ε while other para- meters are fixed, the mean time to detection ( ) E T decreases as is reduced.In other words, when the fraction of time that sensors are on is fixed (i.e., β is kept at a constant), and when the normalized time scale of sensors relaxing to equilibrium between the on-and off-states is reduced (i.e., ε is made smaller), the detection performance of sensors is improved (i.e., the mean time to detection is shorter).
Finally, we demonstrate the accuracy of the asymptotic solution for the mean time to detection.

Conclusion
We have addressed the performance of stochastically intermittent sensors when used to detect a target that moves between a hiding area and an operating area via multiple routes.We have derived asymptotic expansions for the mean time to detection when the on-rate and off-rate of the sensors are large in comparison with the rates of the target moving between the hiding area and the operating area.Using the mean time to detection, we have evaluated the performance of placing sensor(s) to monitor various travel route(s) or to scan the operating area., and 1.4 µ = .

Figure 1 .
Figure 1.A target traveling between two areas.The target may stay in the hiding area where it is not detectable; it may travel from the hiding area to the operating area along one of the N given routes; it may spend time in the operating area before returning to the hiding area via possibly a different route.

Figure 2 .
Figure 2. Markov transitions of the target between the hiding area and the operating area in the absence of any sensor.

Figure 3 .•
Figure 3. Markov transitions of the target in the presence of non-intermittent sensor(s).Note that the parameter form of the Markov process is the same for all cases while values of parameter p, q, and d vary from case to case.

Figure 4 .
Figure 4.The normalized Markov process governing the transitions of the target.

Figure 5 .
Figure 5.The 2-state Markov process governing the intermittent sensors.

Figure 7 .
Figure 7.The normalized 5-state Markov process governing the target-sensors system.In the non-dimensionalization scaling, all transition rates are divided by ( ) f b r r + .

Figure 7 )
are related to the physical transition rates (shown in Figure6) as follows Figure 9 compares an accurate numerical solution and the asymptotic expansion

.
It is clear that the dependence of ( ) E T on ε is well captured in the asymptotic solution

Figure 9 .
Figure 9.Comparison of an accurate numerical solution of ( ) E T and the asymptotic