A Fast Depth-Map Generation Algorithm based on Motion Search from 2D Video Contents

Weiwei Wang, Yuesheng Zhu

Communication and information Security Lab, Shenzhen Graduate School, Peking University, China.

DOI: 10.4236/jsea.2012.512B028                

Abstract

Generation of a depth-map from 2D video is the kernel of DIBR （Depth Image Based Rendering） in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.

Keywords

Block-matching, depth-map, motion search, DIBR

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	M. Op de Beeck, and A. Redert, “Three Dimensional video for the Home,” Proceedings of International Con-ference on Augmented, Virtual Environments and Three-Dimensional Image, May-June 2001, pp. 188-191.
[2]	Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. SPIE, vol.5291, no.2, pp. 93-104 2004.
[3]	P. Harman, J. Flack, S. Fox, M. Dowley.: Rapid 2D to 3D Conversion. Proceedings of SPIE, vol. 4660, pp. 78-86, 2002
[4]	Wa James Tam, Carlos Vázquez, Filippo Speranza.: Three-dimensional TV: A novel method for generating surrogate depth maps using color information. Proc. SPIE Electronics Imaging-stereoscopic Displays and Applications XX, 2009.
[5]	D. Kim, D. Min, K. Sohn.: Stereoscopic video generation method using mo-tion analysis. in Proceedings of the 3DTV Conference, pp. 1–4, Kos Island, May 2007.
[6]	Sung-Fang Tsai, Chao-Chung Cheng, Chung-Te Li, Liang-Gee Chen.：A Real-Time 1080p 2D-to-3D Video Conversion System. IEEE Transactions on Consumer Electronics, Vol. 57, No. 2, pp. 803–804, May 2011.
[7]	I. Ideses, L. P. Ya-roslavsky, B. Fishbain.: Real-time 2D to 3D video con-version. Journal of Real-Time Image Processing, vol. 2, no.1, pp. 3–9, 2007.
[8]	C. Tomasi, R. Manduchi.: Bilateral Filtering for Gray and Color Images. Proceedings of the IEEE International Conference on Computer Vision, Bombay, India, pp.839-846, Bombay January 1998.
[9]	M. T. Pourazad, P. Nasiopoulos, and R. K. Ward.: An H.264-based scheme for 2D to 3D video conversion. IEEE Transactions on Consumer Electronics, vol.55, no.2, pp. 742–748, 2009.
[10]	A.-M. Huang, T. Nguyen.: Motion vector processing using the color information. IEEE International Conference on Image Processing, ICIP, pp. 1605-1608, Cairo, 2009.
[11]	W. J. Tam, f. Speranza, L. Zhang, R. Renaud, J. Chan, C. Vazquez.: Depth Image Based Rendering for Multiview Stereoscopic Displays: Role of Information at Object Boundaries. Three-Dimensional TV, Video, and Display IV, vol. 6016, pp. 75-85, 2005.
[12]	L. Po, X. Xu, Y. Zhu, S. Zhang: Automatic 2D-to-3D video conversion technique based on depth-from-motion and color segmentation. IEEE International Conference on Signal Processing, ICSP, pp.1000-1003, 2010.
[13]	J. Chen, Yuesheng Zhu and X. Liu.: A New Block-Matching Based Approach for Automatic 2D to 3D Conversion. The 4th International Conference on Computer Engineering and Technology, ICCET, pp. 109-113，Thailand,2012.
[14]	D. Wu, S. Wu, K. Lim, F. Pan, Z. Li, X. Lin: Block INTER mode decision for fast encoding of H.264. IEEE International Conference on Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). vol.3, 2004 pp. iii- 181.
[15]	F. Pan, X. Lin, R. Susanto, K. P. Lim, Z. G. Li, G. N. Feng,D. J. Wu, and S. Wu.: Fast Mode Decision Algorithm for Intra Prediction in JVT. 7th JVT meeting, JVT-G013, Thailand, March 2003.
[16]	K. R. Castleman.: Digital Image Processing. Prentice Hall Inc, 1996.
[17]	Shan Zhu, Kai-Kuang Ma.: A new diamond search algorithm for fast block-matching motion estimation. IEEE Transactions on Image Processing, vol.9, no.2, pp.287-290, Feb 2000.