南京大学学报(自然科学版) ›› 2015, Vol. 51 ›› Issue (4): 810–817.

• • 上一篇    下一篇

形状与内容保护的多摄像机视频融合方法

孙金亮,姚 睿*,周 勇,陈 岱   

  • 出版日期:2015-07-08 发布日期:2015-07-08
  • 作者简介:(中国矿业大学计算机科学与技术学院,徐州,221116)
  • 基金资助:
    国家自然科学基金(61402483),中国博士后科学基金(2014M551696),中国矿业大学大学生创新创业基金(201447)

Shape and content preserving multiple cameras video fusion method

Sun Jinliang,Yao Rui*,Zhou Yong,Chen Dai   

  • Online:2015-07-08 Published:2015-07-08
  • About author:(School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, 221116, China)

摘要: 视频融合变换模型的设计是视频融合的关键技术,传统的视频融合变换模型使用单一的投影变换矩阵,投影变换在视频融合过程中通常会引起视频帧图像的变形,尤其是对于存在较大视差的视频帧图像,变形会更加严重。针对此问题,提出一种形状与内容保护的多摄像机视频融合变换模型,该模型通过拼接缝查找算法得到接缝均值,使用接缝均值将图像划分为两个半空间,在左半空间进行投影变换,右半空间使用相似变换代替投影变换,投影变换与相似变换的结合保护了视频帧图像在变形过程中不会发生较大的拉伸与缩放;同时在拼接缝邻域应用内容保护变形算法,更好地保证了过渡区域的融合精度。把新的视频融合变换模型应用于实际拍摄的视频数据上,实验结果表明该方法具有较高的鲁棒性与较强的实用性。

Abstract: The design of video fusion transform model is an important step in video fusion. Projection transformation matrix is used in the current multiple cameras video fusion transform model, but it usually causes the severe distortion. When there are larger parallax among cameras, the distortion will be larger. So the traditional video fusion transform model has a higher request for the camera position. For this problem, this paper presents a shape and content preserving video fusion transformation model. Finding the seam and getting the similarity transformation matrix are the key of the proposed model. The algorithm of dynamic programming is used to find the seam, and the similarity transformation matrix is calculated according to the continuity between the projection transformation and the similarity transformation. When we get the seam, the space is divided into two half spaces. Projection transformation model is used in the left space, and similarity transformation model is used in the right space. The combination of projection transformation and similarity transformation protects the shape does not occur with larger tensile scaling. In addition, content preserving algorithm is used in the seam neighborhood, which caused a better result. Applying this new model to the actual video data, the experimental results show that this method has high robustness and practicality

[1] Lowe D G.. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 2004, 60(2): 91-110.
[2] Brown M, Lowe D G. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, 2007, 74(1): 59-73.
[3] 王小强, 陈临强, 梁 旭. 实时全自动视频拼接方法. 计算机工程, 2011, 37(5): 291-292.
[4] Rav-Acha A, Engel G, Peleg S. Minimal aspect distortion (MAD) mosaicing of long scenes. International Journal of Computer Vision, 2008, 78(2-3): 187-206.
[5] Agarwala A, Agrawala M, Cohen M, et al. Photographing long scenes with multi-viewpoint panoramas. ACM Transactions on Graphics (TOG), 2006, 25(3): 853-861.
[6] Román A, Lensch H P A. Automatic multiperspective images. Rendering Techniques, 2006, 2(2006): 161-171.
[7] Lin W Y, Liu S, Matsushita Y, et al. Smoothly varying affine stitching. In: IEEE Conference on Computer Vision & Pattern Recognition, 2011, 32(14):345-352.
[8] Yuan Z, Kebin J, Pengyu L. Video stitch algorithm based on dynamic foreground extraction. International Congress on Image & Signal Processing, IEEE, 2009:1 - 5.
[9] Chang C, Sato Y, Chuang Y. Shape-preserving half-projective warps for image stitching. In: IEEE Conference on Computer Vision & Pattern Recognition, 2014:3254-3261.
[10] 徐 杰, 金湘亮, 自瑞广. 一种改进的摄像头视频实时拼接方法. 计算机工程与应用, 2013, 49(24): 179-181.
[11] 杨彦景. 摄像机标定与畸变图像矫正算法的设计与实现. 硕士学位论文. 沈阳:东北大学, 2008.
[12] Zhang Z. A flexible new technique for camera calibration. In: Proceedings of IEEE Transactions on Pattern Analysis & Machine Intelligence, 2000, 22(11):1330-1334.
[13] Fischler M A, Bolles R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 1981, 24(6): 381-395.
[14] Zheng S. Application of dynamic programming in dynamic image sequence analysis. International Symposium on Computational Intelligence & Design, 2008, 33(3):8-11.
[15] Zhang F, Liu F. Parallax-tolerant image stitching. In: IEEE Conference on Computer Vision & Pattern Recognition, IEEE Computer Society, 2014:3262-3269.
[16] 方贤勇. 图像拼接技术研究. 博士学位论文. 杭州:浙江大学, 2005.


No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!