A Universal Approach to Designing an Image Interpolator with an Image Smoothing Filter

A number of conventional interpolation techniques have been proposed. However, it seems that there do not exist good criteria for the design of optimal linear interpolators. Also, such an interpolator can hardly provide a satisfactory solution for interpolating noisy images. In this paper, the novelty of this research is that a universal approach is proposed to design an image interpolator with any one image smoothing filter, thereby not only interpolating a down-sampled image but also preserving the characteristics of the performing filtering.


Introduction
As known, the process of decimation or down-sampling is an effective way aid often used to reduce image sizes, thus reducing the amount of information transmitted through the communication channels and the local storage requirements, while trying to preserve as much as possible the image quality.
Conversely, the reverse procedure of this, referred to as interpolation or up-sampling, is useful in restoring the original high resolution image from its decimated version or for resizing or zooming a digital image.Decimation and interpolation are used for several purposes in many practical applications, such as progressive image transmission systems, image zooming, photographic enlarging, image reconstruction, optical scanners, high resolution printer, and in multi-media applications which require browsing or retrieval of images from the internet or image and video databases.These problems are further aggravated in the case of color images which usually require larger storage capacity and A number of conventional interpolation techniques have been proposed in the literature to increase the spatial resolution of an image [1] [2] [3].Often, image interpolation is performed by pixel replication in a small neighborhood of each existing pixel.This is equivalent to a first-order linear filter.Obviously, such a scheme is very simple, but can hardly provide a satisfactory solution.In particular, the resulting blocking artifacts and blurring are quite annoying.The performance can be slightly improved by employing higher-order linear filters [4] [5] [6].However, it seems that there do not exist good criteria for the design of optimal linear interpolators.Also, such an interpolator can hardly provide a satisfactory solution for interpolating noisy images.As known, linear interpolation is generally preferred not for the performance but for computational simplicity whereas adaptive methods aim to avoid these problems by analyzing the local structure of the source image and using different interpolation functions with different areas of support.Several algorithms [7] [8] [9] [10] have been proposed to improve the subjective quality of the interpolated images by imposing more accurate models.However, few of them concern the problem of dealing with noisy images.In this paper, the novelty of this research is that a universal approach is proposed to design an image interpolator with any one image smoothing filter, thereby not only interpolating a down-sampled image but also preserving the characteristics of the used filter.
Following the above introduction, this paper is organized as follows.Section 2 describes in detail the approach to designing an interpolator with a smoothing filter.Section 3 illustrates some examples of the approach proposed here, the interpolators designed with a mean filter, a median filter or a probability filter.
Experimental results and evaluations are shown to highlight the approach in Section 4 and finally some concluding remarks are drawn in Section 5.

Approach to Designing an Interpolator
In this paper, we propose a universal approach for simultaneous image interpolation and smoothing by utilizing the smoothing filter coupled with a pyramidal decomposition shown as in Figure 1; furthermore, the approach includes three steps to accomplish interpolation.
Step 2: 1) is determined with the four original pixels, 1, i j g − , and − is determined with the four original pixels, ( ) , 1,1 i j g is determined with the four original pixels, , and Step 3: The interpolated pixel is determined by using the smoothing filter performed on the four original pixels.If odd pixels are needed, , i j g is repeat- edly added in convenience; for example, a median filter is applied.

Interpolator Derived from Smoothing Filters
In this section, we illustrate the approach discussed in Sec. 2 with interpolators derived from a mean filter, a median filter, or a probability filter.

Interpolator Based on the Mean Filter
The interpolator derived from the mean filter can be expressed as Equation (1).

Interpolator Based on the Median Filter
Similarly, the interpolator derived from the median filter can be expressed as Equation (2).

Interpolator Based on the Probability Filter
Originally, a probability filter [11] is designed for image smoothing or integration with variable weights which are interpreted as probabilities of respective pixel values in a local neighborhood of the current estimated pixel.The algorithm of this filter is explained in more detail as follows.

( )
* , f i j , the restored pixel at (i, j), is defined as M.-C.Pan where ( ) , p i k j l + + , the probability function of a (2n+1) by (2n+1) mask, is given as below: ( ) , p i k j l g i k j l g i j T Norm k l n n and , g i j and ( ) are the average of all pixels in the mask centered at (i, j) and the gray level of the pixel at ( ) For the purpose of image interpolation with noise removal, this probability filter is modified as follows.According the pyramidal decomposition as Figure 1, the new interpolated pixel, ( ) , , i j g k l , yielded from the original pixel, , i j g , can be defined as below: i j i j i j i k j i k j i j l i j l i k j l i k j l g k l p g p g p g p g Norm where ( ) exp 2 ( ) ( ) exp 2 i k j l i k j l p g g T i j i k j i j l i k j l Norm p p p p i j i k j i j l i k j l g g g g g and w, a weight number, is chosen to be 1.5 here and (k, l) = (−1, −1), (−1, 1), (1, −1), (1, 1) shown as in Figure 1.
As previous discussion, the interpolator associated with the probability filter, (8)~(15), employs the characteristics of interpolating an image with noise removal.Furthermore, the difference of the mean filtering, median filtering, and probability filtering has been discussed and illustrated as described in [11].

Results and Discussions
In this section, the interpolators are performed on two categories, grey-level and color images, including the following three cases: 1) case 1: noiseless images, 2) case 2: images with impulse noise, and 3) case 3: images with Gaussian white are to be compared with each other.The mean square error (M.S.E.) is adopted for the measure of evaluation.A 50 × 80 image of clown was used to be interpolated and obtained a "100 × 160" interpolated image.As can be seen, a bilinear or a spline interpolation demonstrates a good visual quality as other three interpolation do in noiseless images; however, when an image with unknown noise is to be processed, the interpolation with the proposed approach cooperated with probability filtering is best choice whereas a bilinear or a spline interpolation enhances noise.

Conclusion
This paper has developed the approach to designing an interpolator based on a smoothing filter.Such a universal approach can generalize the application of the image smoothing filter for the purpose of interpolation and smoothing simulta- neously.According to the above discussion, the interpolation using probability filtering is optimal either for noiseless images or for noisy images.
− .Journal of Signal and Information Processing

Figure 1 .
Figure 1.The pyramidal decomposition for interpolation.(a) Diagram of pyramidal decomposition, (b) The notation and relation of interpolated and original pixels, (c)

M
.-C.Pan noise.The results of interpolated images through five kinds of interpolators (a bilinear interpolator, a spline interpolator, and three filters designed in Sec.3,)

Figure 2 demonstrates case 1 .
Figure 2 demonstrates case 1.As shown in Figure 2, less difference is visualized but there is some difference among them in MSEs which are 106.9361,106.9361, 21.5693, 22.4969, and 21.5758 for Figures 2(d)-(h) corresponding to Figure 2(b), respectively.Figure 3 demonstrates case 2. Obviously, Figure 3(g) and Figure 3(h) are improved with less noise; MSEs are 157.1737,188.4837, 29.6231, 25.9398, and 26.2405 for Figures 3(d)-(h) corresponding to Figure 3(b), respectively.Thus, the interpolation using median or probability filtering is suggested for interpolating images with impulse noise.Figure 4 demonstrates case 3.As shown in Figure 4, Figure 4(f) and Figure 4(h) are better than other; MSEs are 153.8532,175.6014, 25.7838, 26.7301, and 25.7365 for Figures 4(d)-(h) corresponding to Figure 4(b), respectively.As can be seen, the interpolation using mean or probability filtering is recommended for interpolating images with Gaussian white noise.