南京大学学报(自然科学版) ›› 2018, Vol. 54 ›› Issue (4): 725–.

• • 上一篇    下一篇

一种基于核对齐的分类器链的多标记学习算法

陈琳琳1*,陈德刚2   

  • 出版日期:2018-04-30
  • 作者简介:1.华北电力大学控制与计算机工程学院,北京,102206;2.华北电力大学数理学院,北京,102206
  • 基金资助:
    基金项目:国家自然科学基金(71471060),中央高校基金(JB2017165) 收稿日期:2018-05-09 *通讯联系人,E-mail:chenlinlin0508@163.com

A classifier chain method for multi-label learning based on kernel alignment

Chen Linlin1*,Chen Degang2   

  • Online:2018-04-30
  • About author:1.School of Control and Computer Engineering,North China Electric Power University,Beijing,102206,China; 2.School of Mathematics and Physics,North China Electric Power University,Beijing,102206,China

摘要: 在解决多标记分类问题的问题转换方法中,二值相关是一种常用的方法,其对于标记间相互独立的假设忽略了标记之间的相关性. 多标记分类的分类器链算法通过标记信息在分类器之间的传递考虑了标记间的相关性,从而克服了二值相关算法中标记独立性问题. 然而此算法中,分类器链的排序是任意指定的,不同的排序具有不同的分类结果. 为了解决这个问题,引入核对齐方法对分类器进行排序并提出了两种算法,其中核对齐是用来衡量两个核函数之间一致性程度的量. 一种是最大化特征空间中核函数和标记空间中理想核的凸组合的对齐值,根据每个理想核的权重进行排序,其中理想核是由每个标记定义的. 另一种是直接计算核函数与每个理想核的对齐值,根据对齐值进行排序. 实验结果表明,提出的基于核对齐的分类器链的多标记学习算法是有效的.

Abstract: In problem transaction methods to solve the problem of multi-label classification,binary relevance is a commonly used method. However,there usually exits an assumption that labels are independent of each other in binary relevance,which will lead to the neglection of the correlations between labels. Classifier chain for multi-label classification takes label correlations into account through passing label information between classifiers,which is improved based on binary relevance. In this way,this improved method overcomes the label independence in binary relevance. However,the order of classifier chain is arbitrary in this algorithm. Moreover,different order of the classifier chain will lead to different classification accuracy of the learning task. In kernel theory,kernel alignment is a quantity to measure the degree of consistency between two kernels. In order to solve the problem of arbitrary classifier chain order,kernel alignment is introduced into classifier chain for multi-label classification to sort the classifier chain,and two algorithms based on kernel alignment are proposed. The first algorithm maximizes the kernel alignment value between kernel function in feature space and convex combination of ideal kernels in label space,where each ideal kernel is defined by each label in label space. Then the weight in the convex combined ideal kernel is obtained through solving this optimization problem,and the classifier chain is sorted based on the weights of each ideal kernel. The second algorithm directly computes the kernel alignment values between kernel in feature space and each ideal kernel in label space,thus the alignment values corresponding to each label are obtained. Then the order of classifier chain can be sorted based on these alignment values. Our idea of introducing kernel alignment into classifier chain for multi-label classification to order the classifier chain is experimentally demonstrated to be effective.

[1] Sanden C,Zhang J Z. Enhancing multi-label music genre classification through ensemble techniques ∥ Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval. Beijing,China:ACM Press,2011:705-714. [2] Barutcuoglu Z,Schapire R E,Troyanskaya O G. Hierarchical multi-label prediction of gene function. Bioinformatics,2006,22(7):830-836. [3] Qi G J,Hua X S,Rui Y,et al. Correlative multi-label video annotation ∥ Proceedings of the 15th ACM International Conference on Multimedia. Augsburg,Germany:ACM Press,2007:17-26. [4] Tang L,Rajan S,Narayanan V K. Large scale multi-label classification via metalabeler ∥ Proceedings of the 18th International Conference on World Wide Web. Madrid,Spain:ACM Press,2009:211-220. [5] 李志欣,卓亚琦,张灿龙等. 多标记学习研究综述. 计算机应用研究,2014,31(6):1601-1605.(Li Z X,Zhuo Y Q,Zhang C L,et al. Survey on multi-label learning. Application Research of Computers,2014,31(6):1601-1605.) [6] Tsoumakas G,Katakis I. Multi-label classification:An overview. International Journal of Data Warehousing and Mining,2007,3(3):1-13. [7] Read J. A pruned problem transformation method for multi-label classification ∥ Proceedings of 2008 New Zealand Computer Science Research Student Conference. New Zealand:New Zealand Computer Science Research Student Conference Press,2008:143-150. [8] Tsoumakas G,Vlahavas I. Random k-labelsets:An ensemble method for multilabel classification ∥ Proceedings of the 18th European Conference on Machine Learning. Springer Berlin Heidelberg,2007:406-417. [9] Boutell M R,Luo J B,Shen X P,et al. Learning multi-label scene classification. Pattern Recognition,2004,37(9):1757-1771. [10] Zhang M L,Zhou Z H. ML-KNN:A lazy learning approach to multi-label learning. Pattern Recognition,2007,40(7):2038-2048. [11] Clare A,King R D. Knowledge discovery in multi-label phenotype data ∥ Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery. Springer Berlin Heidelberg,2001:42-53. [12] Elisseeff A,Weston J. A kernel method for multi-labelled classification ∥ Proceedings of the 14th International Conference on Neural Information Processing Systems:Natural and Synthetic. Vancouver,Canada:MIT Press,2001:681-687. [13] Read J,Pfahringer B,Holmes G,et al. Classifier chains for multi-label classification ∥ Proceedings of Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer Berlin Heidelberg,2009:254-269. [14] Read J,Pfahringer B,Holmes G,et al. Classifier chains for multi-label classification. Machine Learning,2011,85(3):333-359. [15] Godbole S,Sarawagi S. Discriminative methods for multi-labeled classification ∥ Proceedings of Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer Berlin Heidelberg,2004:22-30. [16] Zhang M L,Zhang K. Multi-label learning by exploiting label dependency ∥ Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Washington DC,USA:ACM Press,2010:999-1007. [17] Cristianini N,Kandola J,Elisseeff A,et al. On kernel target alignment. Innovations in Machine Learning,2006,194:205-256. [18] Wang T H,Zhao D Y,Tian S F. An overview of kernel alignment and its applications. Artificial Intelligence Review,2015,43(2):179-192. [19] Cortes C,Mohri M,Rostamizadeh A. Algorithms for learning kernels based on centered alignment. Journal of Machine Learning Research,2012,13(1):795-828. [20] Zhang M L,Zhou Z H. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering,2014,26(8):1819-1837. [21] Zhang M L,Li Y K,Liu X Y,et al. Binary relevance for multi-label learning:An overview. Frontiers of Computer Science,2018,12(2):191-202.
No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!