南京大学学报(自然科学版) ›› 2013, Vol. 49 ›› Issue (2): 196–201.

• • 上一篇    下一篇

 一种改进的基于梯度搜索的粒子群优化算法*

  韩飞**,杨春生,刘清   

  • 出版日期:2015-10-30 发布日期:2015-10-30
  • 作者简介:
     (江苏大学计算机科学与通信工程学院,镇江,212013)
  • 基金资助:
     国家自然科学基金(61271385, 60702056,江苏省自然科学基金(BK2009197)

 An improved particle swarm optimization based on gradient search

 Han Fei ,Yang Chun-Sheng,Liu Qing
  

  • Online:2015-10-30 Published:2015-10-30
  • About author: (School of Computer Science and Telecommunication Engineering,Jiangsu University,Zhenjiang,212003,China)

摘要:  针对粒子群优化算法在优化过程因失去种群多样性而陷入局部极小点问题,提出一种改进的
基于梯度搜索的粒子群优化算法,从两个方面来提高粒子群的搜索性能.一方面,在粒子相互吸引过程
中,粒子沿着负梯度的方向进行搜索.在搜索过程中,不断减小粒子的飞行速度,从而增大收敛到全局最
优点的可能性.另一方面,在粒子的排斥过程中,粒子散开的速度根据种群多样性做自适应调整.该算法
在搜索过程中有效保持种群多样性从而保证其全局搜索性能,同时因粒子沿梯度卜降的方向进行搜索,
具有很强的局部搜索能力.实验结果表明这种算法比标准粒子群优化算法及相关改进有更好的收敛
性能.
关键词:

Abstract:  Particle swarm optimization(PSO)algorithm is a populatiorrbased search strategy, which has exhibited good per-
formance in dealing with difficult optimization tasks. However,as a stochastic optimization algorithm,PSO tends to suffer from
premature convergence on most problems,which is resulted from the swarm losing its diversity.To solve the problem of being
trapped in local minima owing to the loss of the diversity in the optimi}ztion process,an improved particle swarm optimi}ztion
based on gradient search is proposed in this paper.The proposed method improves its search performance from two aspects. On
one hand ,in the attraction phase,centering around the global best particle,particles search linearly flowing in their negative gra-
dicnt directions. When the particle is very close to the neighborhood of the global minima,its velocity is decreased little by little
by a similar dichotomy method ,and the global search is well performed. On the other hand ,in the repulsion course,the repulsion
velocities of the particles are adjusted,according to the diversity of the swarm. The more the diversity is,thc less the repulsion
velocities decrcase,and vice-versa,and thus the population activity is maintained.The proposed algorithm could not only retain
swarm diversity,but also possess strong local search ability as well as global search ability. Experimental results verify that the
proposed algorithm has better convergence performance and more robust property than basic PSO and some corresponding im
provcmcnts,cspccially on finding minima of multimodal and high dimension functions.

[1]Kennedy J,Eberhart R C. Particle swarm optimiza- tion. Proceedings of the IEEE international Conference
on Neural Networks,Perth, 1995:1942一1948.
[2]Das M T,Dulger L C. Signature verification(SV) toolbox; Application of PSO-NN. Engineering
Applications of Artificial intelligence, 2009,22: 688一694.
[3]Valle Y D, Venayagamoorghy G K,Mohaghcghi S, et al. Particle swarm optimization; Basic con-
cepts, variants and applications in power sys- tans. IEEE Transactions on Evolutionary Com- putation, 2008,2(12):171一195.
[4]Kulkarni R V, Venayagamoorthy G K. Particle swarm optimization in wireless-sensor networks;
A brief survey. IEEE Transactions on Systems,Man,and Cybernetics,2011,2(41);262一267.
[5]Wei J X,Sun Y H,Su X N. A novel particle swarm optimization based on immune selection.
Journal of Nanjing University(Natural Sciences),2010,46(1);1-8.魏建香,孙越乱,苏新宁.一
种基于免疫选择的粒子群优化算法.南京大学学报(自然科学),2010,46(1);1-8).
[6]Rigetand J, Vesterstrom J S. A diversity-guided parti- cle swarm optimizer一The ARPSO. Technical Re
port. University of Aarhus,Denmark,2002.
[7]Wang J W, Wang D W. Particle swarm optimization algorithm with gradient acceleration. Control and De
cision,2004 ,19(11):1298-1300. )(王俊伟,汪定伟. 一种带有梯度加速的粒子群算法.控制与决策,2004,19(11):1298一1300).
[8]Shi Y,Eberhart R C. A modified particle swarm opti mizer. Proceedings of the IEEE Congress on Evolu
tionary Computation, Anchorage, 1998 ; 69一73.
[9]Clere M, Kennedy J.The particle swarm:Explosion stability and convergence in a multi-dimensional
complex space, IEEE Transactions on Evolutionary Computation, 2002,6(1):58一73.
[10]Trelea I C.The particle swarm optimization algo rithm; convergence analysis and parameter selec
tion, lnformation Processing Letters, 2003,85 (6):317一325.
[11]Eberhart R C, Shi Y. Comparing inertia weights and constriction factors in particle swarm optimi-
nation. Proceedings of the IEEE Congress on Evo- lutionary Computation,2000,84一88.
[12]Van den Bergh F. An analysis of particle swarm optimizers. Ph. D Thesis. Pretoria; University of Pretoria, 2002.
No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!