A multi­manifold regularized multi­view non­negative matrix factorization algorithm

Zong Linlin,Zhang Xianchao*,Zhao Qianli,Yu Hong,Liu Xinyue

Journal of Nanjing University(Natural Sciences) ›› 2017, Vol. 53 ›› Issue (3) : 557.

PDF(3877110 KB)
PDF(3877110 KB)
Journal of Nanjing University(Natural Sciences) ›› 2017, Vol. 53 ›› Issue (3) : 557.

 A multi­manifold regularized multi­view non­negative matrix factorization algorithm

  • Zong Linlin,Zhang Xianchao*,Zhao Qianli,Yu Hong,Liu Xinyue
Author information +
History +

Abstract

 In the era of big data,data often comes from multiple feature extractors or consists of multiple views.Multi­view clustering is one of the common approaches for the analysis of such data,which separates data into several groups using information from multiple views.Multi­view clustering via multi­manifold regularized non­negative matrix factorization has become one of the most modern multi­view clustering algorithms in the past decade.However,they do not consider the cluster permutation in non­negative matrix factorization,and they equally treat each view in the experiment.Based on the above issues,in this paper,an improved multi­manifold regularized multi­view non­negative matrix factorization algorithm has been proposed.The key problems of this algorithm are the way of clustering multi­view data and the integration of multi­manifold.In the process of clustering multi­view data,the multi­view data share the same low dimensional sub­matrix and the weighted objective function of all views is minimized,which indicates the importance of each view in clustering and ensures the consistency of cluster permutations in non­negative matrix factorization.In the process of integrating multiple manifolds,the consensus manifold is approximated by the weighted linear combination of multiple manifolds.To show the importance of each view’s manifold,the weighting schema based on multi­view spectral clustering is adopted to find the consensus manifold.To show the effectiveness of the proposed strategy,we experiment on several benchmark datasets.Experimental results show that the proposed algorithm outperforms the state of the art and the proposed optimization strategies are effective for multi­view clustering.

Cite this article

Download Citations
Zong Linlin,Zhang Xianchao*,Zhao Qianli,Yu Hong,Liu Xinyue.  A multi­manifold regularized multi­view non­negative matrix factorization algorithm[J]. Journal of Nanjing University(Natural Sciences), 2017, 53(3): 557

References

 [1] Xu C,Tao D,Xu C.A Survey on multi­view learning.Computer Science,arXiv:1304.5634,2013. 
[2] Bickel S,Scheffer T.Multi­view clustering.In:IEEE International Conference on Data Mining.Brighton,UK:IEEE,2004:19-26.
[3] Zhang X,Zong L,Liu X,et al.Constrained NMF­based multi­view clustering on unmapped data.In:Proceedings of the 29th AAAI Conference on Artificial Intelligence.Austin,USA:AAAI,2015:3174-3180.
[4] Li Y,Nie F,Huang H,et al.Large­scale multi­view spectral clustering via bipartite graph.In:Proceedings of the 29th AAAI Conference on Artificial Intelligence.Austin,USA:AAAI,2015:2750-2756.
[5] Xu C,Tao D,Xu C.Multi­view self­paced learning for clustering.In:Proceedings of the 24th International Joint Conference on Artificial Intelligence.Buenos Aires,Argentina:AAAI,2015:3974-3980.
[6] Cai X,Nie F P,Huang H.Multi­view k­means clustering on big data.In:Proceedings of the 23rd International Joint Conference on Artificial Intelligence.Beijing,China:AAAI,2013:2598-2604. 
[7] Gao J,Han J W,Liu J L,et al.Multi­view clustering via joint nonnegative matrix factorization.In:Proceedings of the 13th SIAM International Conference on Data Mining.Austin,USA:SIAM,2013:252-260.
[8] Singh A P,Gordon G J.Relational learning via collective matrix factorization.In:ACM SIGKDD Conference on Knowledge Discovery and Data Mining.Las Vegas,USA:ACM,2008:650-658.
[9] Cai D,He X,Han J,et al.Graph regularized nonnegative matrix factorization for data representation.IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(8):1548-1560.
[10] Zhang X,Zhao L,Zong L,et al.Multi­view clustering via multi­manifold regularized nonnegative matrix factorization.In:IEEE International Conference on Data Mining.Shenzhen,China:IEEE,2014,1103-1108.
[11] Tzortzis G,Likas A.Kernel­based weighted multi­view clustering.In:IEEE International Conference on Data Mining.Brussels,Belgium:IEEE,2012:675-684.
[12] Lee D,Seung H.Learning the parts of objects by non­negative matrix factorization.Nature,1999,401(6755):788-791.
[13] Lee D,Seung H.Algorithms for non­negative matrix factorization.In:Advances in Neural Information Processing Systems.San Francisco,USA:Morgan Kaufmann Publishers,2001:556-562. 
[14] Li T,Ding C.The relationships among various nonnegative matrix factorization methods for clustering.In:Proceedings of the 6th International Conference on Data Mining.Hong Kong,China:IEEE,2006:362-371.
[15] Luxburg U.A tutorial on spectral clustering.Statistics & Computing,2007,17(4):395-416.
[16] Huang H C,Chuang Y Y,Chen C S.Affinity aggregation for spectral clustering.In:IEEE Conference on Computer Vision and Pattern Recognition.Providence,USA:IEEE,2012:773-780. 
[17] Boyd S,Vandenberghe L.Convex optimization.Cambridge:Cambridge University Press,2004,727. 
[18] Cai D,He X,Han J.Document clustering using locality preserving indexing.IEEE Transactions on Knowledge and Data Engineering,2005,17(12):1624-1637.
[19] Zhang X,You Q.Clusterability analysis and incremental sampling for nystrom extension based spectral clustering.In:IEEE International Conference on Data Mining.Vancouver,Canada:IEEE,2011:942-951.
[20] Hubert L,Arabie P.Comparing partitions.Journal of Classification,1985,2:193-218.
PDF(3877110 KB)

1668

Accesses

0

Citation

Detail

Sections
Recommended

/