南京大学学报(自然科学版) ›› 2017, Vol. 53 ›› Issue (3): 497–.

• • 上一篇    下一篇

DBM­ELM深层网络模型

刘世蕾,崔晓明,聂 茹*   

  • 出版日期:2017-05-30 发布日期:2017-05-30
  • 作者简介:中国矿业大学计算机科学与技术学院,徐州,221116
  • 基金资助:
    收稿日期:2016-12-01 *通讯联系人,E­mail:nr@cumt.edu.cn

The DBM­ELM deep network model

Liu Shilei,Cui Xiaoming,Nie Ru*   

  • Online:2017-05-30 Published:2017-05-30
  • About author:School of Computer Science and Technology,China University of Mining and Technology,Xuzhou,221116,China

摘要: 使用深层限制波尔兹曼机实现高维数据非线性降维,再结合极速学习机算法,提出了一种复合的DBM­ELM深层网络模型.该模型在复杂高维数据的分类问题上,能较好的将高维数据简化到低维空间,进而得到较好的分类效果,实现复杂函数的表示.最后在人脸和手写数字识别实验上得到了很好的证明.

Abstract: Deep learning is currently an extremely active research area in machine learning and pattern recognition society.Deep learning and Big Data are two hottest trends in rapidly growing digital world.Today,big data for the development of various industry has brought the huge opportunity and potential.On the other hand it has also brought unprecedented challenges.While big data has been defined in different ways,it is referred to the exponential growth and wide availability of digital data.It is difficult or even impossible to manage and analyze them using conventional software tools and technologies.It has gained huge successes in a broad area of applications such as speech recognition,computer vision and natural language processing.In the field of computer vision optical character recognition (OCR) concept was put forward in early 1920s.It is a representative in the field of pattern recognition research important topic.Recently,RBM(Restricted Boltzmann Machines) becomes increasingly popular because of its fast learning algorithm,Contrastive Divergence.For the theoretic perspective,the success of RBM has greatly encouraged the research about the stochastic approximation theory,energy­based models and unnormalized statistical models.For the application perspective,RBM has been successfully applied in various machine learning domains,such as classification,regression,dimension reduction,high­dimensional time series modeling,sparse over­complete representations,image transformations and collaborative filtering.In this article,we proposed a new compositional DBM­ELM network model based on deep Restricted Boltzmann machines which realize data nonlinear dimension reduction and Extreme Learning Machines algorithm.This model can simplify the high­dimensional data into low­dimensional space better and then get a better classification effect to represent complicated functions.Finally the experiments on face and handwritten digit recognition prove the superiority.

[1] 吴晓婷,闫德勤.数据降维方法分析与研究.计算机应用研究,2009,26(8):2832-2835.(Wu X T,Yan D Q.Analysis and research on method of data dimensionality reduction.Application Research of Computers,2009,26(8):2832-2835.)  [2] Roweis S T,Saul L K.Nonlinear dimensionality reduction by locally linear embedding.Science,2000,2(9):2323-2326. [3] Yang B,Xiang M,Zhang Y.Multi­manifold Discriminant Isomap for visualization and classi­fication.Pattern Recognition,2016,55:215-230. [4] Hettiarachchi R,Peters J F.Multi­manifold LLE learning in pattern recognition.Pattern Recogni­tion,2015,48(9):2947-2960. [5] Belkinm,Niyogi P.Laplacian eigenmaps for dimensionality reduction and data representation.Neural Computation,2003,15(6):1373-1396. [6] Marc’Aurelio R,Christopher P,Sumit C.Efficient learning of sparse representations with an energy­based model.In:Platt J.Advances in Neural Information Processing Systems(NIPS 2006).Cambridge,USA:MIT Press,2006:1137-1144. [7] Hinton G,Salakhutdinov R.Reducing the dimensionality of data with neural network.Science,2006,6(313):504-507. [8] Earnest P I,Krishna M C.Classification of human actions using pose­based features and stacked auto encoder.Pattern Recognition Letters,2016,11(83):268-277. [9] Liu W,Ma T,Tao D.HSAE:A Hessian regularized sparse auto­encoders.Neurocomputing,2016,1(187):59-65. [10] Yoshua B,Pascal L,Dan P.Greedy layer wise training of deep networks.In:Platt J.Advances in Neural Information Processing Systems(NIPS 2006).Cambridge,USA:MIT Press,2006:153-160.  [11] Huang G B,Zhu Q Y,Siew C K.Extreme learning machine:A new learning scheme of feed forward neural networks.In:Dave R N,Sudkamp T.The International Joint Conference on Neural Net Works(IJCNN 2004).Budapest,Hungary:IEEE Press,2004:985-990. [12] Huang G B,Zhu Q Y,Siew C K.Extreme learning machine:Theory and applications.Neuro Computing,2006,70(1-3):489-501. [13] 胡昭华,宋耀良.基于Autoencoder网络的数据降维和重构.电子与信息学报,2009,31(5):1189-1192.(Hu Z H,Song Y L.Dimensionality reduction and reconstruction of data based on autoendcoder network.Journal of Electronics & Information Technology,2009,31(5):1189-1192.)  [14] 刘建伟,刘 媛,罗雄麟.玻尔兹曼机的研究进展.计算机研究与发展.2014,51(1):1-6.(Liu J W,Liu Y,Luo X L.Research and development on Boltzmann machine.Journal of Computer Research and Development,2014,51(1):1-6.) [15] 马 勇,鲍长春,夏丙寅.基于辨别性深度信念网络的说话人分割.清华大学学报(自然科学版),2013,53(6):804-807.(Ma Y,Bao C C,Xia B Y.Speaker segmentation base on discriminative deep belief networks.Journal of Tsinghua University(Science & Technology),2013,53(6):804-807.) [16] Hinton G,Osindero S,The Y.A fast learning algorithm for deep belief nets.Neural Computa­tion,2006,18(7):1527-1554.
No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!