N. N. Schrusolph, “Fast Curvature Matrix-Vector Products for Second Order Gradient Descent,” Neural Computation, Vol. 14, No. 7, 2002, pp. 1723-1738. doi:10.1162/08997660260028683

has been cited by the following article:

• TITLE: A New Weight Initialization Method Using Cauchy’s Inequality Based on Sensitivity Analysis

  AUTHORS: Thangairulappan Kathirvalavakumar, Subramanian Jeyaseeli Subavathi

  KEYWORDS: Weight Initialization, Backpropagation, Feedforward Neural Network, Cauchy’s Inequality, Linear System of Equations

  JOURNAL NAME: Journal of Intelligent Learning Systems and Applications, Vol.3 No.4, November 29, 2011

  ABSTRACT: In this paper, an efficient weight initialization method is proposed using Cauchy’s inequality based on sensitivity analy- sis to improve the convergence speed in single hidden layer feedforward neural networks. The proposed method ensures that the outputs of hidden neurons are in the active region which increases the rate of convergence. Also the weights are learned by minimizing the sum of squared errors and obtained by solving linear system of equations. The proposed method is simulated on various problems. In all the problems the number of epochs and time required for the proposed method is found to be minimum compared with other weight initialization methods.