Efficient Image Stitching in the Presence of Dynamic Objects and Structure Misalignment

Chao Tao, Hanqiu Sun, Changcai Yang, Jinwen Tian

.

DOI: 10.4236/jsip.2011.23028                

Abstract

This paper presents a new method for simultaneously eliminating visual artifacts caused by moving objects and structure misalignment in image stitching. Given that the input images are roughly aligned, our approach is implemented in two stages. In the first stage, we discover motions between input images, and then extract their corresponding regions through a multi-seed based region growing algorithm. In the second stage, with prior information provided by the extracted regions, we perform a graph cut optimization in gradient-domain to determine which pixels to use from each image to achieve seamless stitching. Our method is simple to implement and effective. The experimental results illustrate that the proposed approach can produce comparable or superior results in comparison with state-of-the-art methods.

Keywords

Image Stitching, Motion Estimate, Region Growing, Graph Cut

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	R. Szeliski, “Image Alignment and Stitching: A Tutorial,” Microsoft Research, Technical Report MSR-TR-2004-92, 2004.
[2]	M. Uyttendaele, A. Eden and R. Szeliski, “Eliminating Ghosting and Exposure Artifacts in Image Mosaics,” Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, 8-14 December 2001, pp. 509-516.
[3]	A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin and M. Cohen, “Interactive Digital Photomontage,” Proceedings of ACM SIGGR- APH’04, Vol. 23, No. 3, 2004, pp. 294-302.
[4]	A. Eden, M. Uyttendaele and R. Szeliski, “Seamless Image Stitching of Scenes with Large Motions and Exposure Differences,” 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, pp. 2498-2505.
[5]	A. Mills and G. Dudek, “Image Stitching with Dynamic Elements,” Image and Vision Computing, Vol. 27, No. 10, 2009, pp. 1593-1602. doi:10.1016/j.imavis.2009.03.004
[6]	A. A. Efros and W. T. Freeman, “Image Quilting for Texture Synthesis and Transfer,” Proceedings of ACM SIGGRAPH’01, 2001, pp. 341-346.
[7]	V. Kwatra, A. Schodl, I. Essa, G. Turk and A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,” Proceedings of ACM SIGGRAPH’03, Vol. 22, No. 3, 2003, pp. 277-286.
[8]	A. Levin, A. Zomet, S. Peleg and Y. Weiss, “Seamless Image Stitching in the Gradient Domain,” Proceedings of European Conference on Computer Vision, 2004.
[9]	Y. Boykov, O. Versker and R. Zabih, “Fast Approximate Energy Minimization via Graph Cuts,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 11, 2001, pp. 1222-1329. doi:10.1109/34.969114
[10]	J. Y. Jia and C. K. Tang, “Image Stitching Using Structure Deformation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, No. 4, 2008, pp. 617-631. doi:10.1109/TPAMI.2007.70729
[11]	M. A. Fischler and R. C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Communications of the ACM, Vol. 24, No. 6, 1981, pp. 381-395. doi:10.1145/358669.358692
[12]	D. G. Lowe, “Distinctive Image Features from Scale-Invariant Keypoints,” International Journal of Computer Vision, Vol. 60, No. 2, 2004, pp. 91-110. doi:10.1023/B:VISI.0000029664.99615.94
[13]	J. Wills, S. Agarwal and S. Belongie, “What Went Where,” Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2003, pp. 37-44.
[14]	P. Bhat, K. C. Zheng, N. Snavely, A. Agarwala, M. Agrawala, M. Cohen and B. Curless, “Piecewise Image Registration in the Presence of Multiple Large Motions,” Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 2491-2497.
[15]	C. Tao, Y. H. Tan, Y. T. Wang and J. W. Tian, “Discard Wide-Baseline Mismatch Using Contour Fragments,” Electronic Letters, Vol. 46, No. 12, 2010, pp. 834-835. doi:10.1049/el.2010.1128
[16]	R. Adams and L. Bischof, “Seeded Region Growing,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 16, No. 6, 1994, pp. 641-654. doi:10.1109/34.295913
[17]	G. Borgefors, “Distance Transformations in Digital Images,” Computer Vision, Graphics, and Image Processing, Vol. 34, No. 3, 1986, pp. 344-371. doi:10.1016/S0734-189X(86)80047-0
[18]	M. Brown and D. G. Lowe, “Automatic Panoramic Image Stitching Using Invariant Features,” International Journal of Computer Vision, Vol. 74, No. 1, 2007, pp. 59-73. doi:10.1007/s11263-006-0002-3
[19]	The Panorama Factory, 2011. http://www.panoramafactory.com/