SAR Image Change Detection Algorithm Based on Different Empirical Mode Decomposition ()
1. Introduction
Synthetic aperture radar (SAR) imaging has a typical characteristic of obtaining data in all-weather and all-time, so it has been widely used. But SAR is a microwave imaging remote sensing, so the received electromagnetic echo signal is a typical nonlinear and non-stationary signal, and there are some difficulties with traditional methods to process SAR images. Although the wavelet transform and multi-scale geometric analysis theory are very good modern signal processing methods, they are related to the choice of parameters and basic functions in signal processing process. Different parameters and basic functions will bring some influences on the final results. Empirical mode decomposition (EMD) is a kind of completely data-driven and adaptively multi-scale transform theory. It does not need to choose the basic function, but it can adaptively adjust according to the characteristics of the signal itself. Therefore, the EMD theory is better than the wavelet transform and the multi-scale geometric analysis theory; in other words, it can make up for the shortcomings of these typical multi-scale transform theories. EMD can not only deal with linear and stationary signals, but also can deal with nonlinear and non-stationary signals. Especially in non-stationary and nonlinear signal processing, it has great advantages and has been widely used in many fields [1] - [6] .
The definition of empirical mode decomposition and the related theory were proposed by Huang in 1998 [7] . EMD theory can decompose the signal into a set of linear intrinsic mode function (IMF) according to the characteristics of the signal itself, and IMF has its physically meaning. Since the EMD theory has been proposed, although it is not very mature, the theory has been improved and applied, and many fruitful results has been achieved. For example, aiming at the aliasing phenomenon in EMD decomposition, Wu et al. proposed the theory of ensemble empirical mode decomposition (EEMD) in 2009 [8] . It can not only solve the phenomenon of mode aliasing, but also can restrain the phenomenon of boundary point flying caused by too few points. The principle of EEMD is to use the characteristic that EMD has the approximate two enter filter banks to Gauss white noise. Due to the addition of Gauss noise in signal processing process in EEMD, some residual noises are introduced. In order to overcome this phenomenon, Yeh et al. proposed the complementary ensemble empirical mode decomposition (CEEMD) theory [9] , which can effectively eliminate the noise, and can make the further improvement to the one-dimensional EMD decomposition theory. When the one-dimensional EMD processes the two-di- mensional image signal, it not only does not consider the pixel spatial relationship, but also the calculation speed is very slow. So Billing et al. proposed the theory of bidimensional empirical mode decomposition (BEMD) [10] . Because BEMD directly decomposes the two-dimensional image signal, considering the spatial relationship of pixel, it has been widely applied in remote sensing image processing [11] [12] . Based on the BEMD development, Rehman and Mandic proposed the trivariate empirical mode decomposition (TEMD) [13] and the multivariate empirical mode decomposition (MEMD) [14] in 2010.
The SAR image is the mapping from the feature space to the image space. SAR receives the electromagnetic echo is scattered from the ground objects, and then after a series of complex processing, then the SAR image is obtained. The echo signal received by SAR is a typical non-stationary and nonlinear signal; meanwhile, the SAR imaging mechanism is the coherent imaging, so the SAR image contains a lot of speckle noise. However, SAR is a microwave imaging which can obtain target area data under all-weather and all-time, and is very suitable for dynamic monitoring and change information acquisition. According to the characteristics of SAR images, after studying the principle of EEMD and BEMD, this paper proposed a new fusion change detection algorithm for SAR images based on different empirical mode decompositions, and it is referred to FCD-EMD algorithm. The feasibility of FCD-EMD algorithm is tested with SAR image data, and good experimental results are obtained.
2. Empirical Mode Decomposition Theory
2.1. EEMD Theory
Using EMD theory to decompose an input signal, we can obtain a finite number of intrinsic mode function (IMF) and a residual quantity. Whether the input signal is linear, nonlinear or stationary, non-stationary, the decomposed IMF features are linear and stationary.
For an input signal
, after processing of EMD decomposition, it can be expressed as the sum of the modal characteristic component
and the residua
, and definition is given in Equation (1).
(1)
Here
is the ith IMF component, N is the total number of IMF components.
Although EMD is a fully adaptive data-driven and multi-scale decomposition theory, it is easy to produce the aliasing when there is interference signal in the signal to be decomposed. EEMD adds white noise into the original signal, uses the characteristic that the mean value of white noise is zero, and makes the ensemble average to the IMF feature components obtained by EMD decomposition, which can well eliminate the aliasing. The realization process is as follows.
1) Generate N stripe white noise which is as same as the equal length with the input original signal
, the white noise is added into
, and the signal which is added by the noise is
.
(2)
Here
the signal which is added by white noise after the ith time,
is the white noise that is added by the ith time.
2) All
is decomposed by EMD, respectively. Finally, M number of
and one Residual
is got. Here
denotes the jth IMF component obtain by adding white noise after the ith time,
,
.
3)
and
perform the ensemble average processing operation, respectively. When N is large enough, the sum of the IMF components which has been added by white noise will tend to zero. The results of the ensemble average are shown as following.
(3)
(4)
2.2. BEMD Theory
The decomposition process and idea of BEMD is the same as that of EMD decomposition method. A complex two-dimensional signal is decomposed into a number of bidimensional intrinsic mode function (BIMF) components
and a residual
by the screening method. Every BIMF component is independent of each other, including the local feature signals of the original signal of different frequencies and different spatial.
Next the two-dimensional image signal is as an example to introduce the screening process of BEMD method.
denotes the two-dimensional image signal that will be processed,
denotes the maximum envelope surface,
denotes the minimum envelope surface, and the screening steps are as follows.
1) Finding the local maxima and local minima of the curved surface in an image.
2) Using the interpolation method perform the interpolation operation on the extreme points, and the maximum and minimum envelope surfaces
and
are obtained.
Computing the mean of the envelope surface
, and
; extracting high frequency detail information, i.e.
.
4) Determine whether
satisfies the two conditions of BIMF. If it does not satisfy, sign
, repeat steps form step (1) to step (4), until the conditions is satisfied. At this time,
is a BIMF component, sign
,
.
5) Sign
, and it is as a new signal to be decomposed, repeat the operations from step (1) to step (4) until the second BIMF component
is obtained. Here the residual is
. Repeat the above steps, until the remainder
has only one extreme point surface, and no longer can any BIMF components be extracted from it.
The image
can be expressed as a sum of several BIMF components and the residual, i.e. Equation (5).
(5)
Here
is the number of BIMF feature components.
In the step (4) to determine whether the screening process is over, which see if it satisfies the two conditions in the definition of BIMF. The standard deviation (SD) of the two screening results is usually used to determine it. And the definition is given as following.
(6)
Here the value of SD is generally between 0.2 and 0.3, and
denotes the ith residual.
3. FCD-EMD Algorithm Description
When the EMD method is used to process an image, if one wants to extract the much IMF feature information, the original image should have the better direction information. For the SAR images with artificial targets, the direction information is usually obvious. BEMD method is suitable for the processing of SAR images, not only can get abundant BIMF feature information, but also keep the good spatial information of image pixels. Therefore, if the IMF feature and BIMF feature perform the fusion processing, it not only can get more abundant spatial information and direction information, but also is very helpful for target detection and change information obtaining. According to that the SAR imaging mechanism is sensitive to the azimuth; this paper proposes a new SAR image target change detection algorithm based on two different types of EMD decomposition theory, i.e. the FCD-EMD algorithm and its flow chart frame is shown in Figure 1. It can be seen from Figure 1; the proposed change detection algorithm consists of two parts. One is the change detection based on EEMD, which uses EEMD to obtain the IMF feature images and to get the change information; another part is to use BEMD obtaining the BIMF feature images and to get the change information. Finally, the two parts of the change detection results are fused and the final change information of the target area is got. The change detection process based on EEMD and BEMD is similar, therefore, the following detailed description of the change detection based on EEMD is introduced. The change detection based on BEMD can refer to the implementation of the EEMD method.
1) Input different temporal SAR images, i.e. input SAR images
and
which were obtained from the same target area but at different time
and
.
2) SAR images
and
performs the EEMD decomposition operations in horizontal and vertical direction, respectively.
3) The IMF feature images of horizontal and vertical directions on the same scale are fused to obtain the total IMF feature image for every scale, which are the parts including the frequency information and the detailed information.
4) Select the appropriate IMF feature components. In FCD-EMD algorithm, the first to third scale feature images are selected to perform the next fusion processing operation.
5) The selected IMF feature images are fused to obtain the fused feature images FIMF1 and FIMF2, respectively.
6) The corresponding pixels of feature images of FIMF1 and FIMF2 perform the subtraction operation, and the feature difference image FIMF-D1 will be got.
Figure 1. The block diagram of FCD-EMD algorithm.
7) The expectation maximization (EM) algorithm is used to generate an unsupervised detection threshold
in the feature difference image FIMF-D1. EM algorithm is a maximum likelihood estimation method for incomplete data problems, it does not need any external data or prior knowledge, and the detailed implementation process can refer to the document [15] .
8) Obtain the result image
of change detection with EEMD. Using the obtained detection threshold
performs the detection and determination operations in the feature difference image. If
, this shows that the change happens; If
, this shows that there is no changes. Here
denotes the gray value of the feature difference image at
pixel.
9) Obtain the result image
of change detection with BEMD. The change detection process based on BEMD is similar to EEMD change detection, and it also includes the above several steps. The difference is that BEMD directly decomposes the SAR image, and the two-dimensional feature images BIMF1 and BIMF2 are obtained from the SAR image
and
, respectively. Then the feature selection and fusion processing is performed to generate the feature difference image and the detection threshold; finally, the change detection result
is obtained. After obtaining
and
, they perform the fusion operation, and the change information between SAR images at
and
can be obtained.
10) Fuse the results obtained by the two different methods, and the fusion rule is given by
(7)
Here
denotes the final result,
is the result with EEMD and
is the result with BEMD. The parameters
and
are their weight value, respectively, and the value ranges of them is
, and here
.
4. Experimental Results and Analysis
In order to verify the feasibility of the proposed algorithm, the simulation experiments and the verification test of measured data are carried out. The experimental SAR image data came from the Sandia National Laboratories [16] and the Canadian RADARSAT satellite. For SAR image data from the Sandia, part of them performs the simulation experiments, which are shown in Figure 2. The targets are tanks and the background is bushes in the SAR images. Here Figure 2(A) and Figure 2(D) are the original SAR images. Assume that Figure 2(A) is the SAR image before change, i.e. the SAR image
at time
; Figure 2(D) is the image after change, that is, the SAR image
at time
. They are IMF features and BIMF features of Figure 2(A) in Figure 2(B) and Figure 2(C), respectively. Similarly, Figure 2(E) and Figure 2(F) are IMF features and BIMF features of Figure 2(D), respectively. What Figure 3 shows is the change detection results obtained by different empirical mode decomposition methods. But there are some changes, that is, the images which are used to extract the change information are no longer the original SAR images, but they are the feature images obtained by empirical mode decomposition. The change detection results are shown in Figure 3(a), which is based on one-dimensional EEMD. At this time, the feature images at
and
time are shown in Figure 2(B) and Figure 2(E), respectively. In Figure 3, the change shown in Figure 3(A) is that the SAR image at time
is relative to the SAR image at time
, i.e. the area of information weakening; the change of
relative to
is shown in Figure 3(B), i.e. the information enhancing area. Figure 3(C) are all change results, including both enhancement and weakening, namely the fusion of Figure 3(A) and Figure 3(B). The change detection results obtained by BEMD are shown in Figure 3(b). The image at
is the feature image shown by Figure 2(C), and the image at
is the feature image in Figure 2(F). The result of the FCD-EMD algorithm is shown in Figure 3(c). In fact, it is the fusion result of Figure 3(a) and Figure 3(b). It can be seen in Figure 3 that for those SAR images which is more obvious or their direction information is abundant, these detection methods all can get the target feature information and also can detect the change information, and the focus of each method is different. IMF features in EEMD
Figure 2. Simulation of SAR images and their IMF features. ((A), (D) is original SAR images; (B), (E) is IMF feature images; (C), (F) is BIMF feature images).
(a) Change detection results of EEMD
(b) Change detection results of BEMD
(c) Change detection results of FCD-EMD
Figure 3. Change detection results of different methods (t2 relative to t1, (A) weakened area, (B) enhanced area, (C) fusion of (A) and (B)).
focus on the acquisition of direction information and geometric detail information; BIMF features in BEMD focus on the acquisition of the spatial information of the target (the correlation of neighboring regions). Through the fusion, the formation of complementary advantages, one can get a better change detection effect, which is shown in Figure 3. At the same time, it also shows that the fusion algorithm of two different EMD methods can be used to detect the change information for different temporal SAR images, and it is feasible and has wide application prospect and popularization value.
Figure 4 shows the change detection results which are obtained after the fusion of different IMF and BIMF features. The change information shown in Figure 4(A) is the SAR image at time
relative to
. Contrary, what Figure 4(B) shows is
relative to
. Figure 4(C) is the sum of Figure 4(A) and Figure 4(B). Figure 3 and Figure 4 show that the sequence of fusion of different methods will affect the final change detection results. The change detection results in Figure 3 are better than that in Figure 4, so the FCD-EMD algorithm proposed in this paper is the first to carry out the change detection and then to perform fusion operations.
The SAR images in Figure 5 are from the Canadian RADARSART satellite, the imaging area is Bengbu area, Anhui province, China. Here, the imaging time of the SAR image in Figure 5(A) was in July 2001, assuming that it is the SAR image at time
, that is, it is the SAR image before change; the SAR image in Figure 5(D) obtained in July 2005, and assume that it is the SAR image at time
, i.e. the SAR image after change. Figure 5(B) and Figure 5(C) are the IMF and BIMF feature information image of Figure 5(A), respectively; similarly, Figure 5(E) and Figure 5(F) are IMF and BIMF feature information image of Figure 5(D).
Figure 4. Results of at first carry out fusion and then detect change information (t2 relative to t1, (A) weakened area, (B) enhanced area, (C) fusion of (A) and (B)).
Figure 5. Original SAR images and their IMF and BIMF feature images. ((A), (D) is original images; (B), (E) is IMF feature images; (C), (F) is BIMF feature images).
Figure 6. Change detection results of SAR images with different methods.
The results of change detection in Figure 5 are shown in Figure 6. What Figure 6(a) shows is obtained by Figure 5(B) and Figure 5(E), the results of Figure 5(C) and Figure 5(F) are shown in Figure 6(b), and the fused results of Figure 6(a) and Figure 6(b) are shown in Figure 6(c). Figure 6 further shows that the fusion FCD-EMD algorithm by different EMD theories can be used for real SAR image change detection, and it is feasible and effective. Because the IMF feature information is extracted by row or column, therefore, as long as there is azimuth information, it can acquire them; in other words, EEMD is more sensitive to the directional information, as can be seen in Figure 6(a). In this experiment, the change information based on the IMF feature is more than that of the BIMF feature, as shown in Figure 6(a) and Figure 6(b). However, there is more false alarm information in Figure 6(a). The reason is that IMF affected by speckle noise is greater than BIMF. In essence, another obvious feature of the FCD-EMD algorithm is that it can greatly reduce the effect of speckle noise. Because speckle noise mainly concentrates in the high-frequency part, when one selects the intrinsic mode function feature, the IMF feature at first scale may be removed without affecting the detection results, and the speckle noise is reduced. This merit is also reflected in Figure 5(C) and Figure 5(F).
5. Conclusion
Empirical mode decomposition is a fully adaptive data-driven signal processing theory. Although there are many kinds of decomposition methods, each method has its advantages and disadvantages. EEMD can obtain very good directional information, and BEMD can get the spatial information of the pixel. The proposed FCD-EMD algorithm fuses their advantages, holding good directional and spatial characteristics; at the same time, the new method can reduce the influence of speckle noise on obtaining change information with multi-temporal SAR images. So more accurate information will be obtained by the FCD-EMD algorithm that that of the single EMD method. The experimental results of simulation experiments and the measured SAR images show that the FCD-EMD algorithm can obtain good effects. This shows that the new proposed algorithm is feasible. In the future work, we will make a deep study of the quantitative analysis of the method.
Acknowledgements
The work was supported by Natural Science Foundation of China (No. 61379031, 41574008), Natural Science Basic Research Plan in Shaanxi Province of China (No. 2016JM6052) and Special Foundation for Special Talents of Xijing University (No. XJ17T04).