A New Weight Initialization Method Using Cauchy’s Inequality Based on Sensitivity Analysis

• 作者: Subramanian Jeyaseeli Subavathi Thangairulappan Kathirvalavakumar
• 来源期刊: 智能学习系统与应用(英文)
• 学科: 数学
• 关键词: WEIGHT INITIALIZATION Backpropagation FEEDFORWARD NEURAL Network Cauchy’s INEQUALITY Linear System of EQUATIONS
• 年，卷（期）: 2011,（4）
• 页码范围: 242-248
• 页数: 7页
• 分类号: O1

摘要

In this paper, an efficient weight initialization method is proposed using Cauchy’s inequality based on sensitivity analy- sis to improve the convergence speed in single hidden layer feedforward neural networks. The proposed method ensures that the outputs of hidden neurons are in the active region which increases the rate of convergence. Also the weights are learned by minimizing the sum of squared errors and obtained by solving linear system of equations. The proposed method is simulated on various problems. In all the problems the number of epochs and time required for the proposed method is found to be minimum compared with other weight initialization methods.