Image Fusion Real-time System Based on FPGA and Multi-DSP

Feng Qu, Bochao Liu, Jian Zhao, Qiang Sun

Changchun Institute of Optics, Fine Mechanics and Physics Chinese Academy of Sciences, Changchun, China.

DOI: 10.4236/opj.2013.32B019                

Abstract

In order to solve complex algorithm that is difficult to achieve real-time processing of Multiband image fusion within large amount of data, a real-time image fusion system based on FPGA and multi-DSP is designed. Five-band image acquisition, image registration, image fusion and display output can be done within the system which uses FPGA as the main processor and the other three DSP as an algorithm processor. Making full use of Flexible and high-speed characteristics of FPGA, while an image fusion algorithm based on multi-wavelet transform is optimized and applied to the system. The final experimental results show that the frame rate of 15 Hz, with a resolution of 1392 × 1040 of the five-band image can be used by the system to complete processing within 41ms.

Keywords

Multi-band; Real-time Image Fusion; Multi-wavelet Transform; Image Registration

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	X. Suxia, “Real-Time Fusion System Hardware Design of Visual/IR Image Based on DSP and FPGA,” Journal of Beijing Technology and Business University (Natural Science Edition), Vol. 26, No. 6, 2008, pp. 44-47.
[2]	Z. Jianbin, H. Bo, Y. Rong and Z. Yong, “A Improved Pyramidal Decompositions Algorithm for Image Fusion and the Implementation on DSP,” Journal of Wuhan University of Science and Engineering, Vol. 22, No. 1, 2009. pp. 17-20.
[3]	Q. Feng, L. Ying, W. Jian, D. Keyan, et al., “Infrared dual-Band Real-Time Image Fusion System,” Optics and Precision Engineering, Vol. 18, No. 7, 2010, pp.1684-1690.
[4]	H. Keming, W. Guocheng and W. Yang, “Multi-Source Image Fusion System Based on DSP,” Ordnance Industry Automation, Vol. 31, No. 2, 2012, pp. 61-63.
[5]	S. Yajun, Z. Zhenfu and L. Zhongling, “Analysis and Application Prospect of Image Fusion Technology Based on Multicolor FPA,” Infrared and Laser Engineering, Vol. 38, No. 4, 2009, pp. 725-730.
[6]	G. Zhiqiang and L. Yi, “Design of An Image Fusion System Based on DSP Parallel Processing,” Journal of WUT (Information & Management Engineering), Vol. 28 No. 11, 2006, pp. 107-109.
[7]	C. K. Chui and J. A. Lian, “A Study of Orthonormal Multiwavelets,” Applied Numerical Mathematics, Vol. 20, 1996, pp. 273-298.