Author(s)

Xun Zhang, Naimin Zhang^*

School of Mathematics and Information Science, Wenzhou University, Wenzhou, China.

In this paper, a gradient method with momentum for sigma-pi-sigma neural networks (SPSNN) is considered in order to accelerate the convergence of the learning procedure for the network weights. The momentum coefficient is chosen in an adaptive manner, and the corresponding weak convergence and strong convergence results are proved.

Sigma-Pi-Sigma Neural Network, Momentum Term, Gradient Method, Convergence

Zhang, X. and Zhang, N. (2018) A Study on the Convergence of Gradient Method with Momentum for Sigma-Pi-Sigma Neural Networks. Journal of Applied Mathematics and Physics, 6, 880-887. doi: 10.4236/jamp.2018.64075.