Integer Wavelet-Based Image Interpolation in Lifting Structure for Image Resolution Enhancement

A floating-point wavelet-based and an integer wavelet-based image interpolations in lifting structures and polynomial curve fitting for image resolution enhancement are proposed in this paper. The proposed prediction methods estimate high-frequency wavelet coefficients of the original image based on the available low-frequency wavelet coefficients, so that the original image can be reconstructed by using the proposed prediction method. To further improve the reconstruction performance, we use polynomial curve fitting to build relationships between actual high-frequency wavelet coefficients and estimated high-frequency wavelet coefficients. Results of the proposed prediction algorithm for different wavelet transforms are compared to show the proposed prediction algorithm outperforms other methods.


Introduction
Resolution of an image has been always an important issue in many image-and video-processing applications.Image interpolation can be used for image resolution enhancement and many interpolation techniques have been developed to increase the quality of this task.Image and video codings, such as spatial scalability and transcoding, rely on image interpolation methods.Hence, these require fast and accurate interpolation methods.based on the dual-tree complex wavelet transform (DT-CWT) and nonlocal means (NLM) is proposed for resolution enhancement of the satellite images.In [15] [16], an image resolution enhancement technique based on interpolation of the high frequency subband images is obtained by DWT and the difference image.The edges are enhanced by using stationary wavelet transform (SWT).Then all these subbands are combined to generate a new high resolution image by using inverse DWT (IDWT).Furthermore, in [16], generalized histogram equalization (GHE) is used to obtain high resolution and high contrast satellite image.
Invertible wavelet transforms that map integers to integers [17] are important in the applications of lossless coding [18] [19].In this paper, we propose floating-point wavelet-based and integer wavelet-based image interpolations in lifting structures.It uses the low-band wavelet coefficients to estimate high-frequency wavelet coefficients of the original image, so that the original image can be reconstructed from the low-band wavelet coefficients by using the proposed prediction algorithms.Furthermore, the proposed method utilizes linear relations between original high-frequency coefficients and estimated high-frequency coefficients to further improve the accuracy of the predicted high-frequency coefficients.The coefficients of predicted high-frequency subbands can be formed in floating-point or in integers.And then, the inverse wavelet transform is performed for synthesis of an interpolated image.
The paper is organized as follows: The standard interpolation method and a brief overview of wavelet transform and reversible integer wavelet transforms are introduced in Section 2. Section 3 derives the proposed methods.Experiment results for the proposed methods are given in Section 4. Finally, Section 5 provides conclusions and future works.

Background
This section first introduces the common interpolation concept and its main drawback in Section 2.1.The detailed description of wavelet transform is in [20].Section 2.2 simply presents the concepts of the wavelet transform.Then, the wavelet-based interpolation framework with lifting structure [21] is described in Section 2.3.Reversible integer wavelet transforms and their advantages in compression systems are introduced in the following subsection.

Image Interpolation
The definition of interpolation is to determine the parameters of a continuous image representation from a set of discrete points.The resolution enhancement process can be conceptually regarded as a two-step operation.Initially, the discrete data is interpolated into a continuous curve.Second, for the additional samples, we need to stuff those added points with values to be determined.Here, the simplest method-bilinear interpolation-is selected to demonstrate the process of interpolation.Let the original image be denoted by f and the interpolated image be f  .In the following example, the interpolation ratio is assumed to be 2.In order to simplify the process, the one-dimensional linear interpolation is separately applied in vertical and horizontal directions of an image to achieve the two-dimensional bilinear interpolation.The bilinear interpolation with an interpolation ratio 2 can be formulated as where 0,1, 2, x =  .After performing the bilinear interpolation, the image can be zoomed in or out.
Wavelet-based interpolation is to predict high-frequency subbands, LH-band, HL-band, and HH-band, from the low-frequency subband.Figure 1 shows the forward two-dimensional wavelet transform, and the right side is the backward wavelet transform.By assuming that the input is a low-pass filtered image (LL-band), the unknown high-frequency subbands can be predicted from the low-frequency subband.The easiest prediction algorithm is shown in Figure 1.
is to pad zero values to high-frequency subbands as LH-band, HL-band, and HH-band.However, the image interpolation model in wavelet transform is desired to present a better prediction algorithm for effectively predicting the high-frequency subbands.
Because bilinear interpolation assumes the original data are first-derivative continuous, the result is usually blurred when it interpolates the points at edges.Nevertheless, the wavelet-based interpolation can avoid this artifact by its good approximation property.

Wavelet Transform
Wavelet transform is a valuable tool for image compression.It provides efficient time-frequency localization and multiresolution analysis; thus, it is suitable for image interpolation.Wavelet transformation decomposes data into different subbands hierarchically and each high-frequency subband can locate the regions of edges and details in the original image.Figure 2 shows single stage of a two-channel analysis and synthesis filter bank.In Figure 2, h 0 and h 1 are analysis filters, and g 0 and g 1 are synthesis filters.In the analysis step an input signal x is filtered with h 0 and h 1 and downsampled to generate the low-pass band s and the high-pass band d.In the synthesis step s and d are upsampled and filtered with g 0 and g 1 .The sum of the filter outputs results in the reconstructed signal x .Two-dimensional wavelet transform can be implemented using a one-dimensional filter on an image in each column vertically and in each row horizontally, which induces four subbands (i.e., LL-, LH-, HL-, and HH-band).The LL-band is the approximation of the original image, the LH-band represents vertical information, the HL-band represents horizontal information, and the HH-band represents diagonal information shown in Figure 3.The LH-, HL-, and HH-subbands will be estimated from the LL-band in our framework for image resolution enhancement.

Lifting Scheme
The wavelet transform uses two filters L and H to conduct the convolution operation.However, such convolution operation suffers from high computation cost and requires more memory for storage.Thus, an improved approach called lifting scheme for computing the discrete wavelet transform was developed.Any discrete wavelet transform can be computed with this scheme, and almost all these transforms have reduced computational complexity compared with the standard filtering algorithm.In this scheme a trivial wavelet transform, called lazy transform, is computed.This transform splits the input signal into evenand odd-indexed sequences.
[ ] [ ]  Next, dual lifting and lifting steps are applied to obtain

[ ] [ ] [ ] [ ]
Figure 4 illustrates the above process with M pairs of dual and lifting steps.
We can find the inverse transform by reversing the operations and flipping the signs.The inverse transform is illustrated in Figure 5.
Then undo the M lifting steps and dual lifting steps to obtain

Integer Wavelet Transform
The wavelet transform produces floating-point coefficients in most cases.Although this allows perfect reconstruction of the original image, the use of finite-precision  arithmetic and quantization results in lossy compression.For lossless compression, integer transform are needed.Traditionally, integer wavelet transform are difficulty to construct.However, the construction becomes very simple with lifting scheme.Since we can write every wavelet transform using lifting, it was shown that an integer version of every floating-point wavelet transform can be built by use of the lifting scheme.Integer wavelet transforms can be created by rounding-off the result of each dual lifting and lifting steps before adding and subtracting.
The dual lifting and the lifting step thus becomes It is invertible and the inverse can be obtained by reversing the lifting and the dual lifting steps and flipping signs: [

Proposed Method
This section illustrates the proposed prediction algorithm using the low-frequency coefficients to estimate the unknown high-frequency coefficients in order to enhance resolution of images to obtain a well-reconstructed image.

Prediction
Padding zero values into high-frequency subbands is an easy way to reconstruct the image.However, it causes blurred image.The proposed prediction method can solve this problem.The proposed prediction algorithm can estimate high-frequency subbands by where I is the proposed low-pass prediction filter and J is the proposed high-pass prediction filter to each row and column of an image, notation * represents a convolution operator, and LL is the input low-pass filtered image.The next subsection derives , I J according to ( ) 4, 2 filters as an example to explain the algorithm.
where ( ) and the high-pass filter ,1, , 0, 6 16 16 In the prediction problem, we need to find out the relationships between the input and the low-band images.In (20b), i s shows the input image has nine sequential pixels connected to one wavelet coefficient in the low-band image by dotted lines in Figure 7. Here, the input image is downsampled to the low-band image in the even sequence, where i s is dominated by 2i x for ( ) . In order to produce the low-band image from the input image, split the input image into even sequence ( i x for 0, 2, 4, , ) for i d .The relations from the low-band image to the even and odd sequences of the input image are given by Figure 8.
x a s a s a s a s a s and respectively, where ( ) which implies the low-pass prediction filter ( ) The prediction filters ( ) J should be symmetric and the low-pass wavelet filter of ( ) a a = (25a) 0 b = empirically as one solution for general images, one has 128 256 64 256 128 256 As a result, the unknown subbands (  LH ,  HL ,  HH ) can be constructed by substituting ( ) Applying to all coefficients of LH, we can obtain the weights LH a and LH b by These weights are subsequently used to gain accuracy of the coefficients of the estimated LH subband.Then, we round-off the result to get the integer version of wavelet coefficients of LH.
, LH m n y′ is the improved integer coefficient at position ( ) A similar process is possible for HL and HH subbands.After coefficient improvement, LH y′ , HL y′ and HH y′ are carried out as above, then the high-resolution image is obtained by applying the inverse integer wavelet transform.shows prediction filters of all integer wavelet filters used in this paper.

Experimental Results
In this paper, we evaluate the quality of the proposed interpolation method.The proposed method is compared with other interpolation methods, such as, zero padding, [11] without evolutionary programming (EP), [11] with EP, DT-CWT-NLM [14] and SWT-DWT [15].The methodologies in [11] are only for ( ) 2, 2 and 9 7 F − analysis filters, so we compare the results with ( ) 2, 2 and 9 7 F − analysis filters between the methodologies in [11] and the proposed algorithm.First, we show PSNR values of different prediction algorithms  ( )

2, 2
Zero padding [11] without EP [11] with EP DT-CWT-NLM [14]   Zero padding [11] without EP [11] with EP DT-CWT-NLM [14]  input images are continuous, so it is suitable to predict images which are smooth and soft, and not so well with images with a lot of edges and high frequency components.Peppers and Medical 2 have worse results because of the continuous assumption.By applying the linear relation to tune the coefficients in the proposed method, it reconstructs better results.Literature [11] with EP has better performance than the proposed method for Peppers and Medical 2. The results for 9 7 F − wavelet filter in Table 17 show that the proposed method outperforms other methods for Lena, Baboon, Barbara and Medical 1. Boat, Peppers, Medical 2 have worse results because of the continuous assumption.
But, the methodology [11] with EP needs more computational time to obtain the better results and it is used to verify the method in [11] without EP closes to optimal solution.The approach in [14] is used in satellite images; DTCWT can preserve more high-frequency components of original images.The interpolation algorithm used in this method does not estimate the high-frequency information, so it cannot obtain a better performance.
One can find which filter is the best in different condition from Table 18.Using high-order wavelet analysis filter can lead to a better performance than low-order wavelet analysis filter, because high-order wavelet analysis filter has higher vanishing moments.Consequently, the reconstructed high-order filtered signal will produce a better approximation and get a better reconstruction result.

Figure 1 .
Figure 1.Image interpolation model in wavelet transform.
the high-pass coefficients [ ] d n when scaled with a factor K:

Figure 4 .
Figure 4.The forward wavelet transform using lifting.
This obviously results in an integer to integer transform.But the coefficients not necessarily integers.Thus computing the integer transform coefficients still requires floating-point operations.However, all floating-point operations can be avoided when rational coefficients are power of two denominators in the transform.Here, we use the following integer wavelet transforms of the form ( ) , N N  , where N is the number of vanishing moments of the analyzing high pass filter, while N  is the number of vanishing moments of the synthesizing high pass filter.The S is for sequence, and the P is for prediction in S P + transform.( ) 2 2, 2 + transform is inspired by the S P + transform, using one extra lifting step to build the earlier ( ) 2, 2 into a transform with four vanishing moments of the high pass analyzing filter.The resulting transform is different from the earlier ( ) 4, 2 transform and therefore is called the ( ) 2 2, 2 + transform.The analysis low pass filter of 9 7 F − has nine coefficients, while the analysis high pass filter has seven coefficients.Both analysis and synthesis high pass filters have four vanishing moments.2/6 transform has two coefficients of the analysis low pass filter, while the analysis high pass filter has six coefficients.2/6 transform is a version of the ( ) 3,1 transform.
the input data size).The boundary conditions of an input image are extended symmetrically by i

Figure 7 .
Figure 7. Relationship between the input image and the low-band image for the even sequence of input image.

Figure 8 .
Figure 8. Relation from the low-band image to the input image for the even sequence and the odd sequence.

2 J
to J in (19a)-(19c).If we know the actual high-frequency coefficients of the reconstructed image, then we can build the relationship between actual high-frequency coefficients and estimated high-frequency coefficients.The relationship improves prediction algorithm which is based on polynomial curve fitting.In Section 4, we denote this situation as one layer.If we do not know the actual high-frequency coefficients of the reconstructed image, we can decompose the original low-frequency image into C.-Y. Chen et al.DOI: 10.4236/am.2018.9100771168 Applied Mathematics four subbands as layer two in wavelet transform of the reconstructed image.And we use LL in layer two to predict the other three high-frequency subbands in layer two.Then, we can build the relationship between actual high-frequency coefficients and estimated high-frequency coefficients in layer two to improve prediction algorithm on polynomial curve fitting.In Section 4, we denote this situation as two layers.By denoting the exact coefficients at position ( )

Figure 10 andFigure 11 .
Figure 10 and Figure 11 present the subjective image quality of the proposed

Table 1 Table 1 .
Prediction filters of all integer wavelet filters used in this paper.
The test images are shown in Figure9.Lena has various types of image components, Baboon has many detailed components, Barbara has mainly diagonal edges, Boat has mainly horizontal edges, and Peppers has strongly vertical edges.Medical 1 and Medical 2 are x-ray images of the breast and the tooth, respectively.These To evaluate the objective quality of the reconstructed high-resolution image based on the proposed method, the peak signal noise ratio (PSNR) measurement is manipulated.The LL-band of images is totally stored, and it is used to recover to the original size of images.
show that the proposed interpolation method reconstructed for test images in each integer wavelet transform for a zooming ratio 1/2.These test images are reduced by the different integer wavelet transforms and then the reduced images are enlarged with the proposed method.One layer in the table represents that the original input images are decomposed into one layer and the LL-band in layer one is used to predict the other high frequency subbands.Then build the linear relations between predicted high frequency coefficients in layer one and actual high frequency coefficients in layer one to reconstruct the original images.Two layers in the table represent that the original input images are decomposed into two layers and the LL-band in layer two is used to predict the other high frequency subbands.Then build the linear relations between pre-

Table 17 .
Comparison with different methods in zooming ratio 1 2