TITLE:
A Study on the Convergence of Gradient Method with Momentum for Sigma-Pi-Sigma Neural Networks
AUTHORS:
Xun Zhang, Naimin Zhang
KEYWORDS:
Sigma-Pi-Sigma Neural Network, Momentum Term, Gradient Method, Convergence
JOURNAL NAME:
Journal of Applied Mathematics and Physics,
Vol.6 No.4,
April
26,
2018
ABSTRACT: In this paper, a gradient method with momentum for
sigma-pi-sigma neural networks (SPSNN) is considered in order to accelerate the
convergence of the learning procedure for the network weights. The momentum
coefficient is chosen in an adaptive manner, and the corresponding weak
convergence and strong convergence results are proved.