Medical Image Fusion Based on Wavelet Multi-Scale Decomposition

This paper describes a method to decompose multi-scale information from different source medical image using wavelet transformation. The data fusion between CT image and MRI image is implemented based on the coefficients fusion rule which included choice of regional variance and weighted average wavelet information. The result indicates that this method is better than WMF, LEF and RVF on fusion results, details and target distortion.


Introduction
Medical image fusion generally refers to match and superpose the same lesion area of image which acquired from 2 or more different medical imaging equipment, which obtain complementary information, and increase the amount of information to make the clinical diagnosis and treatment more accurate and complete.
Wavelet transform can decompose the image into approximation images and detail images which are representing different structure and facilitate to extract originnal image structure and detail information [1][2][3].It is a hot research of medical image fusion for its perfect reconfiguration.Wavelet transform is considered a breakthrough method of Fourier analysis.Known as the "mathematical microscope", it have locality in space and frequency domain to multi-scale analysis information through computing functions such as telescopic and shift.Earliest wavelet transform in image fusion study is the thermal images and visual multi-image fusion, medical image fusion has also been a lot of applications in present [4][5][6].
Head CT images and MRI images have been study in this paper.According to the choice of multi-wavelet based on multi-wavelet transform or fusion operator, the rule of weighting maximum fusion, local energy fusion and regional variance of image fusion are presented.Experimental results show that the choice based on regional variance and the weighting average fusion proposed in this paper achieved good fusion effect.

Principle of Wavelet Decomposition and Reconstruction
Mallat algorithm has been used to decompose and reconstruct of image signal.Suppose   , f x y is two-dimen- sional image and analysis based on two-dimensional multi-resolution: where k is different decomposition scales, λ is three different high-frequency components , ψ λ (x, y) is 2D generating wavelet function which composed by Scaling function and Wavelet function.
Then based on 2D Mallat decomposition algorithm, Wavelet coefficients define as follows: Each wavelet coefficient   can be consider a Sub-images, which is corresponding to where H and G is conjugate filter, H  and G is conjugate transport matrix of H and G. 

Medical Image Fusion Method
The same parts of slice images acquired by different medical equipment have similar low-frequency components and disparate frequency components.For high frequency components of integration is the key to medical image fusion, so it is important that distinguished high frequency and low frequency components in image processing by apply different fusion operator and fusion rule.The process of wavelet multi-scale decomposition image fusion is shown in Figure 1.
The process of Fusion as follows: 1) To decompose source image A, B by K-layer wavelet decomposition, and get 3K + 1 pieces of sub-images which include 3K pieces sub-images with different scales, spatial resolution and frequency characteristics of the high frequency and one pieces of top(K layers) low-frequency sub-images.
2) To fuse different frequency components of A, B corresponding decomposition level, and get 3K pieces of high frequency sub-images and K layer low-frequency sub-image.The different frequency component on each layer can be fused by different fusion operator, and then acquired wavelet transform pyramid.
3) To reconstruct wavelet transform pyramid sub-images and acquired the resulting image F.

Weighted Maximum-Fusion Rule
After wavelet transform, the images to be fused which used the weighted average method to get the low-frequency coefficient matrix of the fused image in the corresponding directions on low-frequency coefficient, and used the method of selecting a larger value in the corresponding directions on high-frequency coefficient.Fused image will be acquired by wavelet coefficient matrix after inverse transformation.Corresponding algorithm is: where  are weighted coefficient.

Local Energy-Fusion Rule
Wavelet P and Q are defined size of the local area (such as 3 3  , 5 5  , 7 7  ).
Local medium   ed M defined as follows: Match degree of corresponding local energy in two images defined as follows: , ,

Regional Variance Fusion Rule
The rule of regional variance fusion is that: after multiwavelet transforming, wavelet coefficient of fusion image F defined as which is wavelet coefficient max-variance of the current processing pixel as the center of a local area (generally 3 , , , here, take ) in image A or B.
where j is decomposition scale from 1 to N, VAR defines as following: where M and N are the number of rows and columns of local area , i j x is a gray value of pixel in current local area, x is gray average value of pixel in current local area.

Rule Based on Regional Variance and Weighted Average Fusion
The rule of regional variance fusion takes pixel which has larger local variance as fusion coefficient.Fusion coefficient choose one image's coefficient to cover another image's coefficient.When the two images' corresponding pixels local variance difference is not significant, some useful information will be lost.The fusion image will be distorted.For this, this paper present an improved fusion method based on local variance.The fusion rules are as follows: On the corresponding decomposed layer and direction, pixels which have larger local VAR has been taken as fusion wavelet coefficient when difference is significant between images A and B after normalized and illustrated that one image's detail information larger than another.If normalized local VAR between two images closed, it is indicated that two images are rich in details and weighted average fusion operator has been taken to confirm fusion wavelet coefficient.It could keep image signal's detail feature clearly, avoid loss of information, reduce noise and ensure consistency.

Experimental Results
The CT and MRI image used in this experiment have been redistricted already.The fusion result shown in Figure 2. Information Entropy (IE), mean square deviation (MSE), average gradient (MG), cross-entropy (CS) and mutual information (MI) have be used to measure    1. Figure 2 and Table 1 show that, the best result has been getting by the fusion method of based on choice of regional variance and weighted average wavelet information.More detail information and more amount of information get from image which avoid target edge distortion and fusion image clarity improved.

Conclusion
Wavelet decomposition is an image fusion of multi-scale, multi-resolution.Proposed in this paper, the fusion me-thod of based on choice of regional variance and weighted Average wavelet information is better than WMF, LEF and RVF on fusion results, details and target distortion.

Figure 1 .
Figure 1.Image fusion process based on wavelet transform.
Firstly, finding the high-frequency sub-image decomposed layers j(1 to N) of source image A and B; Weighted maximum-fusion (d) Local energy-fusion(e) Regional variance fusion (f) Improve regional variance

Figure 2 .
Figure 2. The fusion results of CT and MRI images.

Table 1 . Comparison for four fusion methods.
The principle of Fusion performance evaluation is that, in the same set of fusion experiments, the larger IE, MSE, MG and MI and smaller CE get by some kind fusion method, the method have better performance.Performance results of different methods shown in Table