Multivideo fusion with extended SURF based on CUDA parallel computing framework
Cui Zhe1，Meng Fanrong1，Yao Rui1*，Shi Jihong1，2
Author information+
{{custom_zuoZheDiZhi}}
About authors:
1.School of Computer Science，China University of Mining and Technology，Xuzhou，221116，China；2．Zhengzhou Coal Industry(Group)Co.，Ltd.，Zhengzhou，450042，China
{{custom_authorNodes}}
{{custom_bio.content}}
{{custom_bio.content}}
{{custom_authorNodes}}
Collapse
History+
Published
2016-07-23
Issue Date
2016-07-23
Abstract
In the process of multicamera fusion，it is necessary for each frame image acquired by multiple cameras to carry out a large number of image processing operations，such as feature extraction，image registration and image fusion.These operations take up a lot of computing time and are difficult to meet the requirements of realtime video fusion.This paper proposes a fast and reliable fusion method with multivideo camera based on CUDA(Compute Unified Device Architecture)parallel computing framework.This method firstly uses the extracting method of characteristics of SURF(speeded up robust features)which is based on partial annular extension and color descriptors to extracted image feature points；secondly，based on the block similarity measure tree，uses multiimage auto matic feature matching algorithm tomatch the images and the feature points；and then uses the RANSAC(Random Sample Consensus)algorithm to calculate the transformation matrix.Finally，multifrequency fusion algorithm is used for multicamera fusion.At the same time，the whole multivideo fusion process uses CUDA to carry on the parallel acceleration.The realtime and the effectiveness of the proposed algorithm are verified by experiments with a number of different scenarios and cameras.
Cui Zhe1，Meng Fanrong1，Yao Rui1*，Shi Jihong1，2 .
Multivideo fusion with extended SURF based on CUDA parallel computing framework[J]. Journal of Nanjing University(Natural Sciences), 2016, 52(4): 627
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}
References
[1] 苗立刚．视频监控中的图像融合与合成算法研究．仪器仪表学报，2009，30(4)：857－861.(Miao L G．Image mosaicing and compositing algorithm for video surveillance.Chinese Journal of Scientific Instrument，2009，30(4)：857－861.) [2] Zitová B，Flusser J．Image registration methods：A survey.Image & Vision Computing，2003，21(11)：977－1000. [3] Lowe D G．Distinctive image features from scaleinvariant keypoints.International Journal of Computer Vision，2004，60(2)：91－110. [4] Ke Y，Sukthankar R．PCASIFT：A more distinctive representation for local image descriptors.IEEE Computer Society，2004：506－513. [5] Krystian M，Cordelia S．A performance evaluation of local descriptors.IEEE Transactions on Pattern Analysis & Machine Intelligence，2005，27(10)：1615－1630. [6] 朱 进，丁亚洲，肖雄武等．基于SIFT改进算法的大幅面无人机影像特征匹配方法．计算机应用研究，2015，32(10)：3156－3159.(Zhu J，Ding Y Z，Xiao X W，et al.Feature detection of large format UAV images based on improved SIFT algorithm.Application Research of Computers，2015，32(10)：3156－3159.) [7] Bay H，Tuytelaars T，Gool L V．SURF：Speeded up robust features.Computer Vision & Image Understanding，2006，110(3)：404－417. [8] Valgren C，Lilienthal A J．SIFT，SURF and Seasons：Appearancebased longterm localization in outdoor environments.Robotics & Autonomous Systems，2010，58(2)：149－156. [9] 雷 飞，王文学，王雪丽等．基于改进SURF的实时视频拼接方法．计算机技术与发展，2015(3)：32－35.(Lei F，Wang W X，Wang X L，et al.Realtime video stitching method based on improved SURF.Computer Technology and Development，2015(3)：32－35.) [10] 卜 珂．基于SURF的图像配准与拼接技术研究．硕士学位论文．大连：大连理工大学，2009.(Bu K．Research on image registration and mosaic based on SURF.Master Dissertation.Dalian：Dalian University of Technology，2009.) [11] 熊云艳，毛宜军，闵华清．有序的KDtree在图像特征匹配上的应用．化工自动化及仪表，2011，37(10)：84－87.(Xiong Y Y，Mao Y J，Min Q H．Application of the ordered KDtree on the image features matching.Control and Instruments in Chemical Industry，2011，37(10)：84－87.) [12] 杜振鹏，李德华．基于KDTree搜索和SURF特征的图像匹配算法研究．计算机与数字工程，2012，40(2)：96－98.(Du Z P，Li D H．Image matching algorithm research based on KDtree search and SURF features.Computer and Digital Engineering，2012，40(2)：96－98.) [13] Ryoo S，Rodrigues C I，Baghsorkhi S S，et al.Optimization principles and application performance evaluation of a multithreaded GPU using CUDA.In：Proceedings of the 13th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming.Salt Lake City，UT，USA：ACM，2008：73－82. [14] Huang Y，Liu J，Tu M，et al.Research on CUDAbased SIFT registration of SAR image.In：2011 the 4th International Symposium on Parallel Architectures，Algorithms and Programming.IEEE Computer Society，2011：100－104. [15] 黄成满．基于CUDA并行计算的无人机遥感图像快速拼接．硕士学位论文．成都：电子科技大学，2011.(Huang M C．Fast image mosaic of UAV remote sensing image based on CUDA parallel computing.Master Dissertation.Chengdu：University of Electronic Science and Technology of China，2011.) [16] 刘有科，高 珏，谭 松等．一种基于CUDA的快速宽视频拼接的方法．计算机技术与发展，2015(1)：15－18.(Liu Y K，Gao Y，Tan S，et al.A fast wide video stitching method based on CUDA.Computer Technology and Development，2015(1)：15－18.) [17] Bentley J L．K－d trees for semidynamic point sets.In：Proceeding of the 6th Annual(SCG’90)．Symposium on Computational Geometry，1990：187－197.
PDF(4220745 KB)
