南京大学学报(自然科学版) ›› 2022, Vol. 58 ›› Issue (6): 10501058.doi: 10.13232/j.cnki.jnju.2022.06.013
• • 上一篇
Guifu Lu(), Rong Tang, Liang Yao
摘要:
最小二乘回归(Least Square Regression,LSR)算法是一种流行的子空间聚类方法,在处理计算机视觉和机器学习的相关问题中的应用十分普遍.然而,当数据含有噪声时,其求得的亲和矩阵不是块对角化的,还存在一定的噪声,这使亲和矩阵不够鲁棒可靠,因而降低了算法的聚类性能.为了解决以上不足,提出一种双重结构的最小二乘回归子空间聚类算法(Double Structure Least Squares Regression Subspace Clustering,DSLSR).首先对原始数据实施LSR算法,由于其生成的亲和矩阵往往不是块对角矩阵且含有噪声,需要对求得的亲和矩阵再次实施LSR算法来去除亲和矩阵中的噪声,使亲和矩阵更干净可靠,从而提升算法的聚类性能.最后,把两次LSR过程纳入一个统一的算法框架,设计一个统一的目标函数.此外,还采取了增广拉格朗日乘子方法对目标函数进行优化求解.在一些数据集上的实验证实,DSLSR算法比现有算法的性能更卓越.
中图分类号:
1 | Cai T T, Shen X T. High?dimensional data analysis. Singapore:World Scientific,2011:320. |
2 | Zhou T, Zhang C Q, Peng X,et al. Dual shared?specific multiview subspace clustering. IEEE Transactions on Cybernetics,2020,50(8):3517-3530. |
3 | Lauer F, Schn?rr C. Spectral clustering of linear subspaces for motion segmentation∥2009 IEEE 12th International Conference on Computer Vision. Kyoto,Japan:IEEE,2009:678-685. |
4 | Zheng Q H, Zhu J H, Li Z Y,et al. Feature concatenation multi?view subspace clustering. Neurocomputing,2020(379):89-102. |
5 | Yang J F, Liang J, Wang K,et al. Subspace clustering via good neighbors. IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(6):1537-1544. |
6 | Zhang C Q, Fu H Z, Hu Q H,et al. Generalized latent multi?view subspace clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(1):86-99. |
7 | Bradley P S, Mangasarian O L. K?plane clustering. Journal of Global Optimization,2000,16(1):23-32. |
8 | Zhang T, Szlam A, Lerman G. Median K?flats for hybrid linear modeling with many outliers∥2009 IEEE 12th International Conference on Computer Vision Workshops. Kyoto,Japan:IEEE,2009:234-241. |
9 | Costeira J P, Kanade T. A multibody factorization method for independently moving objects. International Journal of Computer Vision,1998,29(3):159-179. |
10 | Vidal R, Ma Y, Sastry S. Generalized principal component analysis (GPCA). IEEE Transactions on Pattern Analysis and Machine Intelligence,2005,27(12):1945-1959. |
11 | Elhamifar E, Vidal R. Sparse subspace clustering∥IEEE Conference on Computer Vision and Pattern Recognition. Miami,FL,USA:IEEE,2009:2790-2797. |
12 | Chen G L, Lerman G. Spectral Curvature Clustering (SCC). International Journal of Computer Vision,2009,81(3):317-330. |
13 | Tipping M E, Bishop C M. Mixtures of probabilistic principal component analyzers. Neural Computation,1999,11(2):443-482. |
14 | Ma Y, Derksen H, Hong W,et al. Segmentation of multivariate mixed data via lossy data coding and compression. IEEE Transactions on Pattern Analysis and Machine Intelligence,2007,29(9):1546-1562. |
15 | Liu G C, Lin Z C, Yan S C,et al. Robust recovery of subspace structures by low?rank representation. IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(1):171-184. |
16 | Elhamifar E, Vidal R. Sparse subspace clustering:Algorithm,theory,and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(11):2765-2781. |
17 | Lu C Y, Min H, Zhao Z Q,et al. Robust and efficient subspace segmentation via least squares regression∥The 12th European Conference on Computer Vision. Florence,Italy:Springer,2012:347-360. |
18 | 李海洋,王恒远. 基于TL1范数约束的子空间聚类方法. 电子与信息学报,2017,39(10):2428-2436. |
Li H Y, Wang H Y. Subspace clustering method based on TL1 norm constraints. Journal of Electronics & Information Technology,2017,39(10):2428-2436. | |
19 | 李波,卢春园,冷成财,等. 基于局部图拉普拉斯约束的鲁棒低秩表示聚类方法. 自动化学报,2015,41(11):1971-1980. |
Li B, Lu C Y, Leng C C,et al. Robust low rank subspace clustering based on local graph laplace constraint. Acta Automatica Sinica,2015,41(11):1971-1980. | |
20 | Zheng M, Bu J J, Chen C,et al. Graph regularized sparse coding for image representation. IEEE Transactions on Image Processing,2011,20(5):1327-1336. |
21 | Long M S, Ding G G, Wang J M,et al. Transfer sparse coding for robust image representation∥2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland,OR,USA:IEEE,2013:407-414. |
22 | Nie F P, Wang X Q, Huang H. Clustering and projected clustering with adaptive neighbors∥Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York,NY,USA:Association for Computing Machinery,2014:977-986. |
23 | Xu J, Yu M Y, Shao L,et al. Scaled simplex representation for subspace clustering. IEEE Transactions on Cybernetics,2021,51(3):1493-1505. |
24 | Lin Z C, Liu R S, Su Z X. Linearized alternating direction method with adaptive penalty for low?rank representation∥Proceedings of the 24th International Conference on Neural Information Processing Systems. Granada,Spain:Curran Associates Inc.,2011:612-620. |
25 | Yin M, Gao J B, Lin Z C,et al. Dual graph regularized latent low?rank representation for subspace clustering. IEEE Transactions on Image Processing,2015,24(12):4918-4933. |
26 | Bartels R H, Stewart G W. Solution of the matrix equation A X + X B = C F 4 . Communications of the ACM,1972,15(9):820-826. |
27 | Kuybeda O, Frank G A, Bartesaghi A,et al. A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo?electron tomography. Journal of Structural Biology,2013,181(2):116-127. |
28 | Wilkin G A, Huang X Z. K?means clustering algorithms:Implementation and comparison∥Second International Multi?Symposiums on Computer and Computational Sciences. Iowa City,IA,USA,IEEE,2007:133-136. |
[1] | 夏菁, 丁世飞. 基于低秩稀疏约束的自权重多视角子空间聚类[J]. 南京大学学报(自然科学版), 2020, 56(6): 862-869. |
[2] | 王丽娟,丁世飞,丁玲. 基于迁移学习的软子空间聚类算法[J]. 南京大学学报(自然科学版), 2020, 56(4): 515-523. |
[3] | 帅 惠, 袁晓彤, 刘青山. 基于L0约束的稀疏子空间聚类[J]. 南京大学学报(自然科学版), 2018, 54(1): 23-. |
[4] | 严丽宇1,魏 巍1,2*,郭鑫垚1,崔军彪1. 一种基于带核随机子空间的聚类集成算法[J]. 南京大学学报(自然科学版), 2017, 53(6): 1033-. |
[5] | 刘 波1, 王红军1*,成 聪2,杨 燕1. 基于属性最大间隔的子空间聚类[J]. 南京大学学报(自然科学版), 2014, 50(4): 482-. |
|