School of Software,Dalian University of Technology,Dalian,116620,China
{{custom_authorNodes}}
{{custom_bio.content}}
{{custom_bio.content}}
{{custom_authorNodes}}
Collapse
History+
Published
2017-05-30
Issue Date
2017-05-30
Abstract
In the era of big data,data often comes from multiple feature extractors or consists of multiple views.Multiview clustering is one of the common approaches for the analysis of such data,which separates data into several groups using information from multiple views.Multiview clustering via multimanifold regularized nonnegative matrix factorization has become one of the most modern multiview clustering algorithms in the past decade.However,they do not consider the cluster permutation in nonnegative matrix factorization,and they equally treat each view in the experiment.Based on the above issues,in this paper,an improved multimanifold regularized multiview nonnegative matrix factorization algorithm has been proposed.The key problems of this algorithm are the way of clustering multiview data and the integration of multimanifold.In the process of clustering multiview data,the multiview data share the same low dimensional submatrix and the weighted objective function of all views is minimized,which indicates the importance of each view in clustering and ensures the consistency of cluster permutations in nonnegative matrix factorization.In the process of integrating multiple manifolds,the consensus manifold is approximated by the weighted linear combination of multiple manifolds.To show the importance of each view’s manifold,the weighting schema based on multiview spectral clustering is adopted to find the consensus manifold.To show the effectiveness of the proposed strategy,we experiment on several benchmark datasets.Experimental results show that the proposed algorithm outperforms the state of the art and the proposed optimization strategies are effective for multiview clustering.
[1] Xu C,Tao D,Xu C.A Survey on multiview learning.Computer Science,arXiv:1304.5634,2013. [2] Bickel S,Scheffer T.Multiview clustering.In:IEEE International Conference on Data Mining.Brighton,UK:IEEE,2004:19-26. [3] Zhang X,Zong L,Liu X,et al.Constrained NMFbased multiview clustering on unmapped data.In:Proceedings of the 29th AAAI Conference on Artificial Intelligence.Austin,USA:AAAI,2015:3174-3180. [4] Li Y,Nie F,Huang H,et al.Largescale multiview spectral clustering via bipartite graph.In:Proceedings of the 29th AAAI Conference on Artificial Intelligence.Austin,USA:AAAI,2015:2750-2756. [5] Xu C,Tao D,Xu C.Multiview selfpaced learning for clustering.In:Proceedings of the 24th International Joint Conference on Artificial Intelligence.Buenos Aires,Argentina:AAAI,2015:3974-3980. [6] Cai X,Nie F P,Huang H.Multiview kmeans clustering on big data.In:Proceedings of the 23rd International Joint Conference on Artificial Intelligence.Beijing,China:AAAI,2013:2598-2604. [7] Gao J,Han J W,Liu J L,et al.Multiview clustering via joint nonnegative matrix factorization.In:Proceedings of the 13th SIAM International Conference on Data Mining.Austin,USA:SIAM,2013:252-260. [8] Singh A P,Gordon G J.Relational learning via collective matrix factorization.In:ACM SIGKDD Conference on Knowledge Discovery and Data Mining.Las Vegas,USA:ACM,2008:650-658. [9] Cai D,He X,Han J,et al.Graph regularized nonnegative matrix factorization for data representation.IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(8):1548-1560. [10] Zhang X,Zhao L,Zong L,et al.Multiview clustering via multimanifold regularized nonnegative matrix factorization.In:IEEE International Conference on Data Mining.Shenzhen,China:IEEE,2014,1103-1108. [11] Tzortzis G,Likas A.Kernelbased weighted multiview clustering.In:IEEE International Conference on Data Mining.Brussels,Belgium:IEEE,2012:675-684. [12] Lee D,Seung H.Learning the parts of objects by nonnegative matrix factorization.Nature,1999,401(6755):788-791. [13] Lee D,Seung H.Algorithms for nonnegative matrix factorization.In:Advances in Neural Information Processing Systems.San Francisco,USA:Morgan Kaufmann Publishers,2001:556-562. [14] Li T,Ding C.The relationships among various nonnegative matrix factorization methods for clustering.In:Proceedings of the 6th International Conference on Data Mining.Hong Kong,China:IEEE,2006:362-371. [15] Luxburg U.A tutorial on spectral clustering.Statistics & Computing,2007,17(4):395-416. [16] Huang H C,Chuang Y Y,Chen C S.Affinity aggregation for spectral clustering.In:IEEE Conference on Computer Vision and Pattern Recognition.Providence,USA:IEEE,2012:773-780. [17] Boyd S,Vandenberghe L.Convex optimization.Cambridge:Cambridge University Press,2004,727. [18] Cai D,He X,Han J.Document clustering using locality preserving indexing.IEEE Transactions on Knowledge and Data Engineering,2005,17(12):1624-1637. [19] Zhang X,You Q.Clusterability analysis and incremental sampling for nystrom extension based spectral clustering.In:IEEE International Conference on Data Mining.Vancouver,Canada:IEEE,2011:942-951. [20] Hubert L,Arabie P.Comparing partitions.Journal of Classification,1985,2:193-218.