自适应全局局部集成判别分析

PDF(2394376 KB)

南京大学学报(自然科学版) ›› 2014, Vol. 50 ›› Issue (4) : 517.

自适应全局局部集成判别分析

魏莱

作者信息 +

Adaptive ntegrated global and local discriminant analysis

Wei Lai

Author information +

文章历史 +

摘要

将数据集进行合理的维数约简，对于提高一些机器学习算法的效率起着至关重要的影响。本文提出了一种自适应全局—局部集成判别分析算法（Adaptive integrated global and local discriminant analysis, AIGLD）。AILGD利用数据集的全局判别结构和局部判别结构，将线性判别算法（Linear Discriminant Analysis, LDA）与提出的局部判别算法自适应的相结合。在UCI数据库及标准人脸数据库上的识别实验证明，相比于现有算法，AIGLD具有更高的识别准确率及更强的鲁棒性。

Abstract

In computer vision and information retrieval fields, many applications, such as appearance-based
image recognition, often confront high-dimensional data samples. The curse of high dimensionality is usually a major cause of limitations of many machine learning algorithms. Hence, it is desired to consider methods of feature extraction (or dimensionality reduction) which are able to find the low-dimensional and compact representations for the high-dimensional data points. The subspace learning algorithms are one of the most popular feature extraction methods. Supervised subspace learning algorithms usually achieve better performances than unsupervised ones. And supervised subspace learning algorithms can be divided into two categories, the global structures based discriminator, such as linear discriminative analysis (LDA), and the local structures based methods, such as marginal Fisher analysis (MFA). From the experiments on image recognition, we can find that the global structures based discriminator and the local structures based dis-criminator are suitable for different feature extraction tasks. Hence, we hope to seek a discriminative analysis method which can combine the global structures and local structures of data sets together. In this paper, a new supervised extraction method, called adaptive integrated global and local discriminant analysis (AIGLD), is proposed. The AIGLD algorithm combines the global structure based discriminator (namely, Linear Discriminant Analysis, LDA) with a proposed local structure based discriminator together so that it can use both of the global and the local discriminant information of data sets simultaneously. Compared with LDA and the existing local structure based discriminators, AIGLD is capable of feature extraction for different types of data sets. Moreover, an adaptive method for choosing the parameter which is used the balance the effect of local and global discriminators has also been proposed. This method is much more efficient than the classical method for parameters selections, namely cross validation. The efficiency of the proposed algorithm is demonstrated by extensive experiments using UCI data sets and benchmark face image data sets including ORL database and CMU PIE database. And the experimental results show that IGLD outperforms other classical and state of art algorithms.

引用本文

EndNote

Ris (Procite)

Bibtex

导出引用

魏莱. 自适应全局局部集成判别分析[J]. 南京大学学报(自然科学版), 2014, 50(4): 517

Wei Lai. Adaptive ntegrated global and local discriminant analysis[J]. Journal of Nanjing University(Natural Sciences), 2014, 50(4): 517

参考文献

1. Wei L, Xu F. Local CCA alignment and its application. Neurocomputing, 2012, 89(15): 78~88.
2. Ehsan Z B, Massimo P, Richard Y D X. A discriminative prototype selection methods for graph embed-ding. Pattern Recognition, 2013, 46(6): 1648~1657.
3. Belhumeur P, Hespanha J, Kriegman D. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997: 19 (7): 711~720.
4. Zhi X B, Fan J L, Zhao F. Fuzzy linear siscriminant analysis-guided maximum entropy fuzzy clustering algorithm. Pattern Recognition, 2013, 46(6): 1604~1615.
5. He X, Yan S, Hu Y, et al. Face Recognition Using Laplacianfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27: 328~340.
6. Yan S, Xu D, Zhang B, et al. Graph embedding and extensions: A general framework for dimensionality reduction. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2007, 29(1):40~51.
7. 魏莱, 王守觉, 徐菲菲等. 近邻边界Fisher判别分析. 电子与信息学报, 2009, 31(3): 509~513.
8. UCI Machine Learning Repository. http://archive.ics.uci.edu/ml/, 2007-01-01
9. Ren Y. Local and global structure preserving based feature selection. Neurocomputing, 2012, 89: 147~157.
10. Peng X, Xu D. A local information-based feature-selection algorithm for data regression. Pattern Recognition, 2013. 46(9): 2519~2530.
11. Mu Y, Ding W, Tao D. Local discriminative distance metrics ensemble learning. Pattern Recognition, 2013, 46(8): 2337~2349.
12. Cai D, He X, Han J. Semi-supervised discriminant analysis. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), Rio de Janeiro, Brazil, 2007: 1~7
13. Lei Z, Zhang Z, Li S Z. Feature space locality constraint for kernel based nonlinear discriminant analysis. Pattern Recognition, 2012, 45(7):2733~2742.
14. Wang F, Ding C, Li T. Integrated KL (K-means - Laplacian) clustering: A new clustering approach by combining attribute data and pairwise relations. SIAM: SIAM International Conference on Data Mining, Reno-Sparks-Tahoe area, Nevada, USA, 2009, 14~21.
15. Wang H, Huang H, Ding C. Discriminant laplacian embedding. In: Proceedings of the 24th AAAI Conference on Artificial Intelligence , Atlanta, Georgia, USA, 2010: 167~174
16. Yang J, Zhang L, Yang J, et al. From classifiers to discriminators: A nearest neighbor rule induced discriminant analysis. Pattern Recognition, 2011, 44 (7): 1387~1402.
17. Pang Y H, Andrew B J T, Abas F S. Regularized locality preserving discriminant embedding for face recognition. Neurocomputing, 2012, 77(1):156~166.
18. Lu J, Tan Y P. Regularized locality preserving projections and its extensions for face recognition. IEEE Transactions on Systems, Man and Cybernetics, Part B, 2012, 40(3): 958~963.
19. Friedman J H. Regularized discriminant analysis. Journal of the American Statistical Association, 1998, 84(405):165~175.
20. Duda R, Hart P, Stork D. Pattern classification. The 2nd Edition. Hoboken, NJ: Wiley, 2000, 96~97
21. ORL人脸数据库. http://www.uk.research.att.com/facedatabase.html, 2002-01-01
22. CMU PIE人脸数据库. http://cvc.yale.edu/projects/yalefaces/yalefaces.html, 2012-02-27