DONG Qing, SONG Wei. Deep neural network classification algorithm based on particle swarm optimization[J]. 2017, 36(9): 143-146+150. DOI: 10.13873/j.1000-9787(2017)09-0143-04.
基于粒子群优化的深度神经网络分类算法
摘要
针对神经网络分类算法中节点函数不可导
分类精度不够高等问题
提出了一种基于粒子群优化(PSO)算法的深度神经网络分类算法。使用深度学习中的自动编码机
结合PSO算法优化权值
利用自动编码机对输入样本数据进行编解码
为提高网络分类精度
以编码机本身的误差函数和Softmax分类器的代价函数加权求和共同作为PSO算法的评价函数
使编码后的数据更加适应分类器。实验结果证明:与其他传统的神经网络相比
在邮件分类问题上
此分类算法有更高的分类精度。
Abstract
Aiming at problem that classification precision of neural network algorithm is not very high and node function doesn ’t have derivate
a new classification algorithm of deep neural network based on particle swarm optimization( PSO) is presented. Use autoencoder of deep study
and combined with PSO algorithm to optimize the weight
coder and decoder for input sample data using autoencoder. In order to improve the classification precision of network
take the error function of autoencoder and cost function of softmax classifier weight sum as evaluation function of PSO algorithm in common
making coded data more adapter to the classifier. The experimental results show that compared with other traditional neural network
the classification algorithm has higher classification precision on Email classification.
A growing and pruning sequential learning algorithm of hyper basis function neural network for function approximation [J] . Najdan Vukovi?,Zoran Miljkovi?. Neural Networks . 2013
A Resource-Allocating Network for Function Interpolation [J] . John Platt. Neural Computation . 1991 (2)