A Fast Depth-Map Generation Algorithm based on Motion Search from 2D Video Contents


Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.

Share and Cite:

W. Wang and Y. Zhu, "A Fast Depth-Map Generation Algorithm based on Motion Search from 2D Video Contents," Journal of Software Engineering and Applications, Vol. 5 No. 12B, 2012, pp. 144-148. doi: 10.4236/jsea.2012.512B028.

Conflicts of Interest

The authors declare no conflicts of interest.


[1] M. Op de Beeck, and A. Redert, “Three Dimensional video for the Home,” Proceedings of International Con-ference on Augmented, Virtual Environments and Three-Dimensional Image, May-June 2001, pp. 188-191.
[2] Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. SPIE, vol.5291, no.2, pp. 93-104 2004.
[3] P. Harman, J. Flack, S. Fox, M. Dowley.: Rapid 2D to 3D Conversion. Proceedings of SPIE, vol. 4660, pp. 78-86, 2002
[4] Wa James Tam, Carlos Vázquez, Filippo Speranza.: Three-dimensional TV: A novel method for generating surrogate depth maps using color information. Proc. SPIE Electronics Imaging-stereoscopic Displays and Applications XX, 2009.
[5] D. Kim, D. Min, K. Sohn.: Stereoscopic video generation method using mo-tion analysis. in Proceedings of the 3DTV Conference, pp. 1–4, Kos Island, May 2007.
[6] Sung-Fang Tsai, Chao-Chung Cheng, Chung-Te Li, Liang-Gee Chen.:A Real-Time 1080p 2D-to-3D Video Conversion System. IEEE Transactions on Consumer Electronics, Vol. 57, No. 2, pp. 803–804, May 2011.
[7] I. Ideses, L. P. Ya-roslavsky, B. Fishbain.: Real-time 2D to 3D video con-version. Journal of Real-Time Image Processing, vol. 2, no.1, pp. 3–9, 2007.
[8] C. Tomasi, R. Manduchi.: Bilateral Filtering for Gray and Color Images. Proceedings of the IEEE International Conference on Computer Vision, Bombay, India, pp.839-846, Bombay January 1998.
[9] M. T. Pourazad, P. Nasiopoulos, and R. K. Ward.: An H.264-based scheme for 2D to 3D video conversion. IEEE Transactions on Consumer Electronics, vol.55, no.2, pp. 742–748, 2009.
[10] A.-M. Huang, T. Nguyen.: Motion vector processing using the color information. IEEE International Conference on Image Processing, ICIP, pp. 1605-1608, Cairo, 2009.
[11] W. J. Tam, f. Speranza, L. Zhang, R. Renaud, J. Chan, C. Vazquez.: Depth Image Based Rendering for Multiview Stereoscopic Displays: Role of Information at Object Boundaries. Three-Dimensional TV, Video, and Display IV, vol. 6016, pp. 75-85, 2005.
[12] L. Po, X. Xu, Y. Zhu, S. Zhang: Automatic 2D-to-3D video conversion technique based on depth-from-motion and color segmentation. IEEE International Conference on Signal Processing, ICSP, pp.1000-1003, 2010.
[13] J. Chen, Yuesheng Zhu and X. Liu.: A New Block-Matching Based Approach for Automatic 2D to 3D Conversion. The 4th International Conference on Computer Engineering and Technology, ICCET, pp. 109-113,Thailand,2012.
[14] D. Wu, S. Wu, K. Lim, F. Pan, Z. Li, X. Lin: Block INTER mode decision for fast encoding of H.264. IEEE International Conference on Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). vol.3, 2004 pp. iii- 181.
[15] F. Pan, X. Lin, R. Susanto, K. P. Lim, Z. G. Li, G. N. Feng,D. J. Wu, and S. Wu.: Fast Mode Decision Algorithm for Intra Prediction in JVT. 7th JVT meeting, JVT-G013, Thailand, March 2003.
[16] K. R. Castleman.: Digital Image Processing. Prentice Hall Inc, 1996.
[17] Shan Zhu, Kai-Kuang Ma.: A new diamond search algorithm for fast block-matching motion estimation. IEEE Transactions on Image Processing, vol.9, no.2, pp.287-290, Feb 2000.

Copyright © 2022 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.