A Comprehensive Evaluation of PAN-Sharpening Algorithms Coupled with Resampling Methods for Image Synthesis of Very High Resolution Remotely Sensed Satellite Data

Shridhar D. Jawak, Alvarinho J. Luis

Polar Remote Sensing Department, Earth System Sciences Organization (ESSO), National Centre for Antarctic and Ocean Research (NCAOR), Ministry of Earth Sciences, Government of India, Headland Sada, Gao, India.

DOI: 10.4236/ars.2013.24036                

Abstract

The merging of a panchromatic (PAN) image with a multispectral satellite image (MSI) to increase the spatial resolution of the MSI, while simultaneously preserving its spectral information is classically referred as PAN-sharpening. We employed a recent dataset derived from very high resolution of WorldView-2 satellite (PAN and MSI) for two test sites (one over an urban area and the other over Antarctica), to comprehensively evaluate the performance of six existing PAN-sharpening algorithms. The algorithms under consideration were the Gram-Schmidt (GS), Ehlers fusion (EF), modified hue-intensity-saturation (Mod-HIS), high pass filtering (HPF), the Brovey transform (BT), and wavelet-based principal component analysis (W-PC). Quality assessment of the sharpened images was carried out by using 20 quality indices. We also analyzed the performance of nearest neighbour (NN), bilinear interpolation (BI), and cubic convolution (CC) resampling methods to test their practicability in the PAN-sharpening process. Our results indicate that the comprehensive performance of PAN-sharpening methods decreased in the following order: GS > W-PC > EF > HPF > Mod-HIS > BT, while resampling methods followed the order: NN > BI > CC.

Keywords

PAN-Sharpening; WorldView-2; Resampling Methods

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Y. Zhang, “Highlight Article: Understanding Image Fusion,” Photogrammetric Engineering & Remote Sensing, Vol. 70, No. 6, 2004, pp. 657-661. http://studio.gge.unb.ca/UNB/zoomview/PERS_Vol70_No6_paper.pdf
[2]	U. Kumar, C. Mukhopadhyay and T. V. Ramachandra, “Pixel Based Fusion Using IKONOS Imagery,” International Journal of Recent Trends in Engineering, Vol. 1, No. 1, 2009, pp. 173-175. http://www.academypublisher.com/ijrte/vol01/no01/ijrte0101173177.pdf
[3]	I. Amro, J. Mateos, M. Vega, R. Molina and A. K. Katsaggelos, “A Survey of Classical Methods and New Trends in Pansharpening of Multispectral Images,” EURASIP Journal on Advances in Signal Processing, Vol. 2011, 2011, p. 79. http://dx.doi.org/10.1186/1687-6180-2011-79
[4]	Q. Du, N. H. Younan, R. King and V. P. Shah, “On the Performance Evaluation of Pan-Sharpening Techniques,” IEEE Geoscience and Remote Sensing Letters, Vol. 4, No. 4, 2007, pp. 518-522.
[5]	M. Choi, “A New Intensity-Hue-Saturation Fusion Approach to Image Fusion with a Tradeoff Parameter,” IEEE Transactions on Geoscience and Remote Sensing, Vol. 44, No. 6, 2006, pp. 1672-1682. http://dx.doi.org/10.1109/TGRS.2006.869923
[6]	U. Kumar, A. Dasgupta, C. Mukhopadhyay, N. V. Joshi and T. V. Ramachandra, “Comparison of 10 Multi-Sensor Image Fusion Paradigms for IKONOS Images,” International Journal of Research and Reviews in Computer Science (IJRRCS), Vol. 2, No. 1, 2011, pp. 40-47. http://www.ces.iisc.ernet.in/energy/paper/ijrrcs_ikonos_fusion/image.htm
[7]	J. Vrabel, P. Doraiswamy, J. McMurtrey and A. Stern, “Demonstration of the Accuracy of Improved Resolution Hyperspectral Imagery,” SPIE Proceedings, Vol. 4725, No. 1, 2002, pp. 556-567. http://dx.doi.org/10.1117/12.478790
[8]	W. A. Hallada and S. Cox, “Image Sharpening for Mixed Spatial and Spectral Resolution Satellite Systems,” Proceedings of the 17th International Symposium on Remote Sensing of Environment, Ann Arbor, 9-13 May 1983, pp. 1023-1032.
[9]	P. Pradhan, R. King, N. H. Younan and D. W. Holcomb, “The Effect of Decomposition Levels in Wavelet-Based Fusion for Multiresolution and Multi-Sensor Images,” IEEE Transactions on Geoscience and Remote Sensing, Vol. 44, No. 12, 2006, pp. 3674-3686. http://dx.doi.org/10.1109/TGRS.2006.881758
[10]	R. A. Schowengerdt, “Reconstruction of Multispatial, Multispectral Image Data Using Spatial Frequency Content,” Photogrammetric Engineering & Remote Sensing, Vol. 46, No. 10, 1980, pp. 1325-1334.
[11]	C. A. Laben, V. Bernard and W. Brower, “Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening,” US Patent No. 6011875, 2000.
[12]	L. Alparone, L. Wald, J. Chanussot, P. Gamba and L. M. Bruce, “Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest,” IEEE Transactions on Geoscience and Remote Sensing, Vol. 45, No. 10, 2007, pp. 3012-3021. http://dx.doi.org/10.1109/TGRS.2007.904923
[13]	C. Thomas, T. Ranchin, L. Wald and J. Chanussot, “Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics,” IEEE Transactions on Geoscience and Remote Sensing, Vol. 46, No. 5, 2008, pp. 1301-1312. http://dx.doi.org/10.1109/TGRS.2007.912448
[14]	F. Van Der Meer, “What Does Multisensor Image Fusion Add in Terms of Information Content for Visual Interpretation?” International Journal of Remote Sensing, Vol. 18, No. 2, 1997, pp. 445-452. http://dx.doi.org/10.1080/014311697219187
[15]	Y. Zhang, “A New Merging Method and Its Spectral and Spatial Effects,” International Journal of Remote Sensing, Vol. 20, No. 10, 1999, pp. 2003-2014. http://dx.doi.org/10.1080/014311699212317
[16]	L. Wald, T. Ranchin and M. Mangolini, “Fusion of Satellite Images of Different Spatial Resolutions: Assessing the Quality of Resulting Images,” PE & RS, Vol. 63, No. 6, 1997, pp. 691-699.
[17]	S. Li, Z. Li and J. Gong, “Multivariate Statistical of Measures for Assessing the Quality of Image Fusion,” International Journal of Image and Data Fusion, Vol. 1, No. 1, 2010, pp. 47-66. http://dx.doi.org/10.1080/19479830903562009
[18]	C. Pohl and J. L. Van Genderen, “Multi-Sensor Image Fusion in Remote Sensing: Concepts, Methods, and Applications,” International Journal of Remote Sensing, Vol. 19, No. 4, 1998, pp. 743-757.
[19]	R. Keys, “Cubic Convolution Interpolation for Digital Image Processing,” IEEE Transactions on Signal Processing, Acoustics, Speech, and Signal Processing, Vol. 29, No. 6, 1981, pp. 1153-1160. http://dx.doi.org/10.1109/TASSP.1981.1163711
[20]	D. L. Verbyla, “Practical GIS Analysis,” Taylor & Francis, London, 2002. http://dx.doi.org/10.1201/9780203217931
[21]	J. A. Parker, R. V. Kenyon and D. E. Troxel, “Comparison of Interpolating Methods for Image Resampling,” IEEE Transactions on Medical Imaging, Vol. 2, No.1, 1983, pp. 31-39, http://dx.doi.org/10.1109/TMI.1983.4307610
[22]	T. M. Lehmann, C. Gonner and K. Spitzer, “Survey: Interpolation Methods in Medical Image Processin,” IEEE Transactions on Medical Imaging, Vol. 18, No. 11, 1999, pp. 1049-1075. http://dx.doi.org/10.1109/42.816070
[23]	T. Updike and C. Comp, “Radiometric Use of WorldView-2 Imagery,” Technical Note, DigitalGlobe®, Colorado, 2010. www.digitalglobe.com/downloads/Radiometric_Use_of_WorldView-2_Imagery.pdf
[24]	T.-M. Tu, S.-C. Su, H.-C. Shyu and P. S. Huang, “A New Look at HIS-Like Image Fusion Methods,” Information Fusion, Vol. 2, No. 3, 2001, pp. 177-186. http://dx.doi.org/10.1016/S1566-2535(01)00036-7
[25]	Y. Zhang, “Problems in the Fusion of Commercial HighResolution Satellites Images as well as LANDSAT 7 Images and Initial Solutions,” International Archives of Photogrammetry and Remote Sensing, Vol. 34, No. 4, 2002.
[26]	S. D. Jawak and A. J. Luis, “Applications of WorldView-2 Satellite Data for Extraction of Polar Spatial Information and DEM of Larsemann Hills, East Antarctica,” Proceedings of International Conference on Fuzzy Systems and Neural Computing, Vol. 2, IEEE, Hong Kong, 2011, pp. 148-151.
[27]	S. D. Jawak and A. J. Luis, “WorldView-2 Satellite Remote Sensing Data for Polar Geospatial Information Mining of Larsemann Hills, East Antarctica,” Proceedings of 11th Pacific (Pan) Ocean Remote Sensing Conference (PORSEC), Kochi, 5-9 November 2012.
[28]	S. D. Jawak and A. J. Luis, “High Resolution 8-Band WorldView-2 Satellite Remote Sensing Data for Polar Geospatial Information Mining and Thematic Elevation Mapping of Larsemann Hills, East Antarctica,” 11th International Symposium on Antarctic Earth Sciences (ISAES XI), Edinburgh, 10-15 July 2011, p. 187.
[29]	S. D. Jawak and A. J. Luis, “Hyperspatial WorldView-2 Satellite Remote Sensing Data for Polar Geospatial Information Mining of Larsemann Hills, East Antarctica,” XXXII SCAR OSC, Portland, 2012.
[30]	S. D. Jawak and A. J. Luis, “A Spectral Index RatioBased Antarctic Land-Cover Mapping Using Hyperspatial 8-Band WorldView-2 Imagery,” Polar Science, Vol. 7, No. 1, 2013, pp. 18-38. http://dx.doi.org/10.1016/j.polar.2012.12.002
[31]	S. D. Jawak and A. J. Luis, “Improved Land Cover Mapping Using High Resolution Multiangle 8-Band Worldview-2 Satellite Remote Sensing Data,” Journal of Applied Remote Sensing, Vol. 7, No. 1, 2013, Article ID: 073573. http://dx.doi.org/10.1117/1.JRS.7.073573
[32]	V. Vijayaraj, N. Younan and C. G. O’Hara, “Concepts of Image Fusion in Remote Sensing Application,” IEEE International Conference on Geoscience and Remote Sensing Symposium, Vol. 10, No. 6, 2006, pp. 3781-3784. http://dx.doi.org/10.1109/IGARSS.2006.973
[33]	V. Vijayaraj, N. Younan and C. G. O’Hara, “Quantitative Analysis of Pansharpened Images,” Optical Engineering, Vol. 45, No. 4, 2004, Article ID: 046202. http://dx.doi.org/10.1117/1.2195987
[34]	Z. Wang and A. C. Bovik, “Universal Image Quality Index,” IEEE Signal Processing Letters, Vol. 9, No. 3, 2002, pp. 81-84. http://dx.doi.org/10.1109/97.995823
[35]	Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, “Image Quality Assessment: From Error Visibility to Structural Similarity,” IEEE Transactions on Image Processing, Vol. 13, No. 4, 2004, pp. 600-612. http://dx.doi.org/10.1109/TIP.2003.819861
[36]	L. Wald, “Quality of High Resolution Synthesised Images: Is There a Simple Criterion?” Proceedings of the Third Conference “Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images”, Sophia Antipolis, 26-28 January 2000, pp. 99-103.
[37]	C. Padwick, M. Deskevich, F. Pacifici and S. Smallwood, “WorldView 2 Pan-Sharpening,” ASPRS Annual Conference, San Diego, 26-30 April 2010.
[38]	J. Zhou, D. L. Civco and J. A. Silander, “A Wavelet Transform Method to Merge Landsat TM and SPOT Panchromatic Data,” International Journal of Remote Sensing, Vol. 19, No. 4, 1998, pp. 743-757. http://dx.doi.org/10.1080/014311698215973
[39]	Y. Zhang, “Methods for Image Fusion Quality Assessment —A Review, Comparison and Analysis,” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 37, Pt. B7, 2008, pp. 1101-1110.
[40]	C. Thomas and L. Wald, “Assessment of the Quality of Fused Products,” 24th EARSeL Symposium “New Strategies for European Remote Sensing”, Dubrovnik, 25-27 May 2005, pp. 317-325.