A Study on the Convergence of Gradient Method with Momentum for Sigma-Pi-Sigma Neural Networks

• 作者: Naimin Zhang Xun Zhang
• 来源期刊: 应用数学与应用物理(英文)
• 学科: 数学
• 关键词: Sigma-Pi-Sigma Neural Network MOMENTUM TERM GRADIENT Method CONVERGENCE
• 年，卷（期）: 2018,（4）
• 页码范围: 880-887
• 页数: 8页
• 分类号: O1

摘要

In this paper, a gradient method with momentum for sigma-pi-sigma neural networks (SPSNN) is considered in order to accelerate the convergence of the learning procedure for the network weights. The momentum coefficient is chosen in an adaptive manner, and the corresponding weak convergence and strong convergence results are proved.